Home
%3CLINGO-SUB%20id%3D%22lingo-sub-778513%22%20slang%3D%22en-US%22%3EDeploy%20an%20end%20to%20end%20Azure%20environment%20easily%20and%20run%20your%20benchmarks%20with%20azhpc!%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-778513%22%20slang%3D%22en-US%22%3E%3CP%3EThe%20Azure%20Customer%20Advisory%20team%20works%20with%20many%20customers%20helping%20them%20architect%20and%20build%20their%20end%20to%20end%20solutions%20to%20run%20successfully%20on%20Azure.%20Ability%20to%20deploy%20an%20Azure%20HPC%20environment%20reliably%20and%20quickly%20is%20one%20of%20the%20key%20asks%20from%20all%20our%20customers%20and%20partners%20so%20we%20wanted%20to%20build%20infrastructure%20framework%20that%20we%20can%20use%20not%20only%20in%20our%20own%20daily%20role%20but%20also%20share%20with%20the%20community%20to%20help%20them%20get%20a%20quick%20start%20on%20Azure.%26nbsp%3B%20In%20this%20blog%20I%20would%20like%20to%20introduce%20you%20to%20this%20framework%20built%20by%20the%20Azure%20HPC%20Customer%20Advisory%20team%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%3C%2FA%3E.%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThis%20project%20is%20aimed%20at%20simplifying%20deployment%20and%20setup%20for%20HPC%20environments%20in%20Azure.%20The%20deployment%20scripts%20include%20setting%20up%20various%20building%20blocks%20available%20for%20Networking%2C%20Compute%2C%20Scheduler%20and%20Storage%20that%20are%20needed%20for%20an%20e2e%20setup.%20You%20can%20do%20this%20all%20with%20a%20few%20commands%20and%20fast%20as%20these%20are%20run%20in%20parallel.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThey%20key%20motivation%20is%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CSTRONG%3ESimplified%20Automation%3C%2FSTRONG%3E%3C%2FLI%3E%0A%3CLI%3EFlexibility%3C%2FLI%3E%0A%3CLI%3ESpeed%20of%20deployment%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20basis%20for%20the%20project%20is%20a%20single%20JSON%20config%20file%20and%20some%20shell%20scripts%20for%20installing.%20The%20key%20point%20about%20the%20config%20file%20is%20that%20you%20can%20describe%20network%2C%20resources%20and%20installation%20steps.%20Tags%20are%20applied%20to%20resources%20that%20determine%20which%20scripts%26nbsp%3Brun%20in%20each%20install%20step.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EMultiple%26nbsp%3B%3C%2FSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%2Ftree%2Fmaster%2Fexamples%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3Eexamples%3C%2FA%3E%3CSPAN%3E%26nbsp%3Bfor%20building%20blocks%20commonly%20used%2C%20scripts%20for%20building%2C%20installing%20and%20running%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%2Ftree%2Fmaster%2Fapps%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3Esome%20applications%3C%2FA%3E%26nbsp%3Bare%20included%20here%20so%20they%20can%20be%20used%20as%20you%20build%20your%20environment%20and%20run%20benchmarks.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EWe%20have%20also%20made%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%2Ftree%2Fmaster%2Ftutorials%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3Esome%20tutorials%3C%2FA%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3Eavailable%20that%20you%20can%20follow%20to%20not%20only%20learn%20more%20about%20the%20framework%20but%20also%20to%20understand%20how%20you%20can%20easily%20set%20an%20environment%20up%20e2e%20for%20your%20own%20application.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EGive%20it%20a%20spin%20and%20let%20us%20know%20if%20you%20have%20any%20feedback%20or%20hit%20issues%20by%20opening%20an%20issue%20in%20GitHub%20or%20better%20yet%20send%20us%20a%20pull%20request%20and%20help%20us%20make%20this%20even%20better.%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-778513%22%20slang%3D%22en-US%22%3E%3CP%3EIntroducing%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%20target%3D%22_blank%22%3Ehttps%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%3C%2FA%3E%26nbsp%3Bfor%20deploying%20end%20to%20end%20HPC%20environments%20quickly%20including%26nbsp%3BNetworking%2C%20Compute%2C%20Scheduler%20and%20Storage%20and%20running%20benchmarks.%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-778513%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EHPC%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Microsoft

The Azure Customer Advisory team works with many customers helping them architect and build their end to end solutions to run successfully on Azure. Ability to deploy an Azure HPC environment reliably and quickly is one of the key asks from all our customers and partners so we wanted to build infrastructure framework that we can use not only in our own daily role but also share with the community to help them get a quick start on Azure.  In this blog I would like to introduce you to this framework built by the Azure HPC Customer Advisory team https://github.com/Azure/azurehpc

 

This project is aimed at simplifying deployment and setup for HPC environments in Azure. The deployment scripts include setting up various building blocks available for Networking, Compute, Scheduler and Storage that are needed for an e2e setup. You can do this all with a few commands and fast as these are run in parallel.

 

They key motivation is:

  • Simplified Automation
  • Flexibility
  • Speed of deployment

 

The basis for the project is a single JSON config file and some shell scripts for installing. The key point about the config file is that you can describe network, resources and installation steps. Tags are applied to resources that determine which scripts run in each install step.

 

Multiple examples for building blocks commonly used, scripts for building, installing and running some applications are included here so they can be used as you build your environment and run benchmarks.

 

We have also made some tutorials available that you can follow to not only learn more about the framework but also to understand how you can easily set an environment up e2e for your own application.

 

Give it a spin and let us know if you have any feedback or hit issues by opening an issue in GitHub or better yet send us a pull request and help us make this even better.