Azure HPC Powers CernVM-FS Tutorial

Published 04-08-2021 08:47 AM 641 Views
Microsoft

EasyBuild is a software build and installation framework that allows the efficient management of scientific software on HPC systems. Originally developed by the HPC team at Ghent University, EasyBuild is today developed by the EasyBuild community which spans several hundred HPC sites globally.

 

As part of the 6th EasyBuild User Meeting (EUM’21), Microsoft provided dedicated Azure HPC Cloud resources to support a CernVM File System (CernVM-FS) tutorial which was organised and delivered by Kenneth Hoste (HPC team at Ghent University), Bob Dröge (University of Groningen), and Jakob Blomer (lead developer of CernVM-FS at CERN).

 

This CernVM-FS tutorial was organised in the context of the European Environment for Scientific Software Installations (EESSI) project, which aims to set up a shared repository of optimised scientific software installations that can be used across different  platforms including personal workstations, cloud environments, and HPC clusters. CernVM-FS and EasyBuild are key components in the EESSI project, alongside other open source projects like archspec, Lmod, Gentoo Prefix, Ansible, Terraform, and ReFrame.

 

           

laredfer_1-1617896266758.png

Tutorial Description

CernVM-FS was originally developed to assist High Energy Physics (HEP) collaborations to deploy software on the worldwide-distributed computing infrastructure used to run data processing applications.

 

The tutorial was split into an introductory talk by lead developer Jakob Blomer and four tutorial sessions with hands-on exercises and support provided through a dedicated Slack channel. Dedicated cloud resources in Microsoft Azure (sponsored by Microsoft) were made available to registered tutorial attendees for working on the hands-on exercises.

 

The CycleCloud environment set up by Kai Neuffer and Karl Podesta (Snr Technical Specialists from the Azure EMEA Global Black Belt Team) was found to be a very good fit for the tutorial. A cluster template was set up in CycleCloud so that a cluster could be created per attendee. The template was used to specify names and open ports for each of the different node types in the cluster, and once this was in place then creating the clusters was found to be very easy.

 

Clusters needed to be created manually via the Azure CLI with accounts also being assigned manually to the clusters. This took some effort, and as an advanced topic it was recommended that this could be automated in a production setup with a tool like Ansible or Puppet.

 

The green status bar shown in the example below shows all the nodes in the cluster which started successfully and were ready to be connected via the Secure Shell (SSH) protocol in the next stage of the exercise using an assigned username and the public IP address of the node:

 

laredfer_4-1617895082388.png

 

With all the components for hosting and accessing a CernVM-FS repository in place, it could now be used and the next practical stages of the tutorial focused on adding files to the repository (referred to as publishing) by starting a transaction on the server and then publishing the changes, adding tags, recommendations around handling the metadata in a file catalog, and making use of nested catalogs by having separate catalogs for different subtrees of the repository.

 

Conclusion & Feedback

Over 30 people were registered, each of whom were assigned 4 Virtual Machines (VMs) with 2 cores each. As this was the first tutorial of this kind to make use of CycleCloud, a lesson learned for next time would be to ensure a larger pool of external IP addresses. However, this was overcome with assistance from Karl Podesta of the Azure EMEA Global Black Belt HPC team by relocating some of the clusters to another region (North Europe rather than West Europe) which provided extra IP addresses.

 

Minor teething-troubles aside, Dr Hoste reported that CycleCloud had been a good a good fit for the tutorial, both for attendees and for the tutorial organizers, and that it would certainly be something he would like to consider again for future tutorials:

 

“I feel that the Azure CycleCloud environment was a very good fit for the tutorial. Attendees found it quite intuitive to navigate, and it was very useful for us to have access to the individual clusters to help troubleshoot things in case something went wrong.

 

Overall, I think we can state that the CernVM-FS tutorial went well: content-wise the tutorial was well received, and we are also quite happy with how it worked out. We feel this will be a valuable asset for both

the EESSI and CernVM-FS communities going forward.”

 

Further Information

 

 

%3CLINGO-SUB%20id%3D%22lingo-sub-2261437%22%20slang%3D%22en-US%22%3EAzure%20HPC%20Powers%20CernVM-FS%20Tutorial%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2261437%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSPAN%3E%3CA%20href%3D%22https%3A%2F%2Feasybuild.io%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3EEasyBuild%3C%2FA%3E%3C%2FSPAN%3E%20is%20a%20software%20build%20and%20installation%20framework%20that%20allows%20the%20efficient%20management%20of%20scientific%20software%20on%20HPC%20systems.%20Originally%20developed%20by%20the%20HPC%20team%20at%20Ghent%20University%2C%20EasyBuild%20is%20today%20developed%20by%20the%20EasyBuild%20community%20which%20spans%20several%20hundred%20HPC%20sites%20globally.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EAs%20part%20of%20the%20%3CSPAN%3E%3CA%20href%3D%22https%3A%2F%2Feasybuild.io%2Feum%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3E6%3CSUP%3Eth%3C%2FSUP%3E%20EasyBuild%20User%20Meeting%20(EUM%E2%80%9921)%3C%2FA%3E%3C%2FSPAN%3E%2C%20Microsoft%20provided%20dedicated%20Azure%20HPC%20Cloud%20resources%20to%20support%20a%20CernVM%20File%20System%20(CernVM-FS)%20tutorial%20which%20was%20organised%20and%20delivered%20by%20Kenneth%20Hoste%20(HPC%20team%20at%20Ghent%20University)%2C%20Bob%20Dr%C3%B6ge%20(University%20of%20Groningen)%2C%20and%20Jakob%20Blomer%20(lead%20developer%20of%20CernVM-FS%20at%20CERN).%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThis%20CernVM-FS%20tutorial%20was%20organised%20in%20the%20context%20of%20the%20%3CSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fwww.eessi-hpc.org%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3EEuropean%20Environment%20for%20Scientific%20Software%20Installations%20(EESSI)%3C%2FA%3E%3C%2FSPAN%3E%20project%2C%20which%20aims%20to%20set%20up%20a%20shared%20repository%20of%20optimised%20scientific%20software%20installations%20that%20can%20be%20used%20across%20different%20%26nbsp%3Bplatforms%20including%20personal%20workstations%2C%20cloud%20environments%2C%20and%20HPC%20clusters.%20CernVM-FS%20and%20EasyBuild%20are%20key%20components%20in%20the%20EESSI%20project%2C%20alongside%20other%20open%20source%20projects%20like%20%3CSPAN%3E%3CA%20href%3D%22https%3A%2F%2Farchspec.readthedocs.io%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3Earchspec%3C%2FA%3E%3C%2FSPAN%3E%2C%20%3CSPAN%3E%3CA%20href%3D%22https%3A%2F%2Flmod.readthedocs.io%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3ELmod%3C%2FA%3E%3C%2FSPAN%3E%2C%20%3CSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fwiki.gentoo.org%2Fwiki%2FProject%3APrefix%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3EGentoo%20Prefix%3C%2FA%3E%3C%2FSPAN%3E%2C%20%3CSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fwww.ansible.com%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3EAnsible%3C%2FA%3E%3C%2FSPAN%3E%2C%20%3CSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fwww.terraform.io%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3ETerraform%3C%2FA%3E%3C%2FSPAN%3E%2C%20and%20%3CSPAN%3E%3CA%20href%3D%22https%3A%2F%2Freframe-hpc.readthedocs.io%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3EReFrame%3C%2FA%3E%3C%2FSPAN%3E.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22laredfer_1-1617896266758.png%22%20style%3D%22width%3A%20920px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F271110i9BF119B49F046009%2Fimage-dimensions%2F920x230%3Fv%3Dv2%22%20width%3D%22920%22%20height%3D%22230%22%20role%3D%22button%22%20title%3D%22laredfer_1-1617896266758.png%22%20alt%3D%22laredfer_1-1617896266758.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId--494758691%22%20id%3D%22toc-hId--494758691%22%3E%3CSPAN%3ETutorial%20Description%3C%2FSPAN%3E%3C%2FH2%3E%0A%3CP%3E%3CSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fcernvm.cern.ch%2Ffs%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3ECernVM-FS%3C%2FA%3E%20was%20originally%20developed%20to%20assist%20High%20Energy%20Physics%20(HEP)%20collaborations%20to%20deploy%20software%20on%20the%20worldwide-distributed%20computing%20infrastructure%20used%20to%20run%20data%20processing%20applications.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EThe%20tutorial%20was%20split%20into%20an%20introductory%20talk%20by%20lead%20developer%20Jakob%20Blomer%20and%20four%20tutorial%20sessions%20with%20hands-on%20exercises%20and%20support%20provided%20through%20a%20dedicated%20Slack%20channel.%20Dedicated%20cloud%20resources%20in%20Microsoft%20Azure%20(sponsored%20by%20Microsoft)%20were%20made%20available%20to%20registered%20tutorial%20attendees%20for%20working%20on%20the%20hands-on%20exercises.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EThe%20CycleCloud%20environment%20set%20up%20by%20Kai%20Neuffer%20and%20Karl%20Podesta%20(Snr%20Technical%20Specialists%20from%20the%20Azure%20EMEA%20Global%20Black%20Belt%20Team)%20was%20found%20to%20be%20a%20very%20good%20fit%20for%20the%20tutorial.%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3EA%20cluster%20template%20was%20set%20up%20in%20CycleCloud%20so%20that%20a%20cluster%20could%20be%20created%20per%20attendee.%20The%20template%20was%20used%20to%20specify%20names%20and%20open%20ports%20for%20each%20of%20the%20different%20node%20types%20in%20the%20cluster%2C%20and%20once%20this%20was%20in%20place%20then%20creating%20the%20clusters%20was%20found%20to%20be%20very%20easy.%20%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EClusters%20needed%20to%20be%20created%20manually%20via%20the%20Azure%20CLI%20with%20accounts%20also%20being%20assigned%20manually%20to%20the%20clusters.%20This%20took%20some%20effort%2C%20and%20as%20an%20advanced%20topic%20it%20was%20recommended%20that%20this%20could%20be%20automated%20in%20a%20production%20setup%20with%20a%20tool%20like%20Ansible%20or%20Puppet.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EThe%20green%20status%20bar%20shown%20in%20the%20example%20below%20shows%20all%20the%20nodes%20in%20the%20cluster%20which%20started%20successfully%20and%20were%20ready%20to%20be%20connected%20via%20the%20Secure%20Shell%20(SSH)%20protocol%20in%20the%20next%20stage%20of%20the%20exercise%20using%20an%20assigned%20username%20and%20the%20public%20IP%20address%20of%20the%20node%3A%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22laredfer_4-1617895082388.png%22%20style%3D%22width%3A%20701px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F271103iB92728520234C09E%2Fimage-dimensions%2F701x480%3Fv%3Dv2%22%20width%3D%22701%22%20height%3D%22480%22%20role%3D%22button%22%20title%3D%22laredfer_4-1617895082388.png%22%20alt%3D%22laredfer_4-1617895082388.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EWith%20all%20the%20components%20for%20hosting%20and%20accessing%20a%20CernVM-FS%20repository%20in%20place%2C%20it%20could%20now%20be%20used%20and%20the%20next%20practical%20stages%20of%20the%20tutorial%20focused%20on%20adding%20files%20to%20the%20repository%20(referred%20to%20as%20publishing)%20by%20starting%20a%20transaction%20on%20the%20server%20and%20then%20publishing%20the%20changes%2C%20adding%20tags%2C%20recommendations%20around%20handling%20the%20metadata%20in%20a%20file%20catalog%2C%20and%20making%20use%20of%20nested%20catalogs%20by%20having%20separate%20catalogs%20for%20different%20subtrees%20of%20the%20repository.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-1992754142%22%20id%3D%22toc-hId-1992754142%22%3E%3CSPAN%3EConclusion%20%26amp%3B%20Feedback%3C%2FSPAN%3E%3C%2FH2%3E%0A%3CP%3E%3CSPAN%3EOver%2030%20people%20were%20registered%2C%20each%20of%20whom%20were%20assigned%204%20Virtual%20Machines%20(VMs)%20with%202%20cores%20each.%20As%20this%20was%20the%20first%20tutorial%20of%20this%20kind%20to%20make%20use%20of%20CycleCloud%2C%20a%20lesson%20learned%20for%20next%20time%20would%20be%20to%20ensure%20a%20larger%20pool%20of%20external%20IP%20addresses.%20However%2C%20this%20was%20overcome%20with%20assistance%20from%20Karl%20Podesta%20of%20the%20Azure%20EMEA%20Global%20Black%20Belt%20HPC%20team%20by%20relocating%20some%20of%20the%20clusters%20to%20another%20region%20(North%20Europe%20rather%20than%20West%20Europe)%20which%20provided%20extra%20IP%20addresses.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EMinor%20teething-troubles%20aside%2C%20Dr%20Hoste%20reported%20that%20CycleCloud%20had%20been%20a%20good%20a%20good%20fit%20for%20the%20tutorial%2C%20both%20for%20attendees%20and%20for%20the%20tutorial%20organizers%2C%20and%20that%20it%20would%20certainly%20be%20something%20he%20would%20like%20to%20consider%20again%20for%20future%20tutorials%3A%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%E2%80%9CI%20feel%20that%20the%20Azure%20CycleCloud%20environment%20was%20a%20very%20good%20fit%20for%20the%20tutorial.%20Attendees%20found%20it%20quite%20intuitive%20to%20navigate%2C%20and%20it%20was%20very%20useful%20for%20us%20to%20have%20access%20to%20the%20individual%20clusters%20to%20help%20troubleshoot%20things%20in%20case%20something%20went%20wrong.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EOverall%2C%20I%20think%20we%20can%20state%20that%20the%20CernVM-FS%20tutorial%20went%20well%3A%20content-wise%20the%20tutorial%20was%20well%20received%2C%20and%20we%20are%20also%20quite%20happy%20with%20how%20it%20worked%20out.%20We%20feel%20this%20will%20be%20a%20valuable%20asset%20for%20both%20%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3Ethe%20EESSI%20and%20CernVM-FS%20communities%20going%20forward.%E2%80%9D%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-185299679%22%20id%3D%22toc-hId-185299679%22%3E%3CSPAN%3EFurther%20Information%3C%2FSPAN%3E%3C%2FH2%3E%0A%3CUL%3E%0A%3CLI%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3EThe%20CernVM-FS%20tutorial%20itself%20is%20available%20at%20%3CA%20style%3D%22background-color%3A%20%23ffffff%3B%22%20href%3D%22https%3A%2F%2Fcvmfs-contrib.github.io%2Fcvmfs-tutorial-2021%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3ECernVM-FS%20tutorial%20(cvmfs-contrib.github.io)%3C%2FA%3E%2C%20and%20a%20detailed%20overview%20of%20the%20CycleCloud%20interface%20(including%20screenshots)%20can%20be%20found%20at%20%3CA%20style%3D%22background-color%3A%20%23ffffff%3B%22%20href%3D%22https%3A%2F%2Fcvmfs-contrib.github.io%2Fcvmfs-tutorial-2021%2F00_azure_cloud_resources%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3EAzure%20cloud%20resources%20-%20CernVM-FS%20tutorial.%26nbsp%3B%26nbsp%3B%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CSPAN%3EAll%20talks%20at%20EUM%E2%80%9921%20were%20recorded%20and%20are%20available%20via%20YouTube%20at%20%3CA%20href%3D%22https%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLhnGtSmEGEQh0pCtmkFQsDzeoo6tbYnyZ%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3E6th%20EasyBuild%20User%20Meeting%20(2021)%20-%20YouTube%3C%2FA%3E.%3C%2FSPAN%3E%3C%2FLI%3E%0A%3CLI%3E%3CSPAN%3E%26nbsp%3BA%20separate%20playlist%20for%20the%20CernVM-FS%20tutorial%20is%20available%20at%20%3CA%20href%3D%22https%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLhnGtSmEGEQg8fY5t6nfjxGOYTfueDHwM%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3ECernVM-FS%20tutorial%20at%206th%20EasyBuild%20User%20Meeting%20-%20YouTube%3C%2FA%3E%3C%2FSPAN%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-2261437%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSPAN%3EAzure%20HPC%20Cloud%20resources%20are%20provided%20to%20support%20the%206th%20EasyBuild%20User%20Meeting's%20tutorial%20on%20the%20CernVM-FS%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-TEASER%3E
Version history
Last update:
‎Apr 08 2021 08:45 AM
Updated by: