Hybrid HPC in Azure with HPC Pack

Virtual Machines
Windows Server

Solution Idea

If you'd like to see us expand this article with more information, such as potential use cases, alternative services, implementation considerations, or pricing guidance, let us know with GitHub Feedback!

Microsoft HPC Pack is a free high-performance computing (HPC) solution built on Microsoft Azure and Windows Server technologies. HPC Pack combines a comprehensive set of deployment, administration, job scheduling, and monitoring tools for your Windows and Linux HPC cluster environment, providing a flexible platform for developing and running HPC applications on premises and in Azure.

This solution shows the process for using HPC Pack to create a hybrid (on-premises and Azure) HPC environment.

The links below provide documentation on deploying and managing the Azure products that are included in this solution idea:

Architecture

Architecture Diagram Download an SVG of this architecture.

Data flow

  1. Log into an on-premises head node.
  2. Add Azure compute nodes to the cluster.
  3. Start the compute nodes.
  4. Submit jobs to the cluster.
  5. HPC Pack sends jobs to on-premises and Azure nodes, based upon the node group selected.
  6. Monitor the job progress.
  7. Stop the compute nodes or configure autoscaling.

Components

  • Virtual Machines: Create Linux and Windows virtual machines in seconds.
  • Microsoft HPC Pack: Free high-performance computing (HPC) solution built on Microsoft Azure and Windows Server technologies.

Next steps