Hybrid HPC in Azure with HPC Pack

Solution Idea

If you'd like to see us expand this article with more information (implementation details, pricing guidance, code examples, etc), let us know with GitHub Feedback!

Microsoft HPC Pack is a free high performance computing (HPC) solution built on Microsoft Azure and Windows Server technologies. HPC Pack combines a comprehensive set of deployment, administration, job scheduling, and monitoring tools for your Windows and Linux HPC cluster environment, providing a flexible platform for developing and running HPC applications on premises and in Azure.

This solution shows the process for using HPC Pack to create a hybrid (on-premises and Azure) HPC environment.

The links to the right provide documentation on deploying and managing the Azure products listed in the solution architecture above.

Documentation Home Page

HPC Pack Azure Deployment Options

Architecture

1 2 3 4 5 6 7

Data Flow

  1. Log into on-premises head node
  2. Add Azure compute nodes to the cluster
  3. Start the compute nodes
  4. Submit jobs to the cluster
  5. HPC Pack sends jobs to on-premises and Azure nodes based upon the node group selected
  6. Monitor job progress
  7. Stop the compute nodes or configure auto-scaling

Components

  • Virtual Machines: Create Linux and Windows virtual machines in seconds.
  • Microsoft HPC Pack: Free high performance computing (HPC) solution built on Microsoft Azure and Windows Server technologies.

Next Steps