Home
%3CLINGO-SUB%20id%3D%22lingo-sub-847264%22%20slang%3D%22en-US%22%3EHow%20to%20deploy%20Azure%20Netapp%20Files%20(NFS%20and%20SMB)%20for%20testing%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-847264%22%20slang%3D%22en-US%22%3E%3CH2%20id%3D%22toc-hId-1820261631%22%20id%3D%22toc-hId-1820261631%22%3E%26nbsp%3B%3C%2FH2%3E%0A%3CH2%20id%3D%22toc-hId--731895330%22%20id%3D%22toc-hId--731895330%22%3EIntroduction%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20%3CA%20href%3D%22https%3A%2F%2Fazure.microsoft.com%2Fen-us%2Fservices%2Fnetapp%2F%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20Netapp%20Files%3C%2FA%3Eservice%20has%20become%20very%20popular%20storage%20solution%2C%20satisfying%20the%20I%2FO%20requirements%20for%20many%20customer%20workloads%20(e.g.%20Oil%20and%20Gas%2C%20Manufacturing%20and%20Financial).%20Procedures%20for%20deploying%20Azure%20Netapp%20Files%20using%20the%20NFS%20and%20SMB%20protocols%20and%20accessing%20it%20from%20a%20Linux%20client%20and%20Windows%20client%20respectively%20will%20be%20discussed.%20The%20AzureCAT%20HPC%20azurehpc%20and%20Azure%20azure-quickstart-templates%20repositories%20will%20be%20used%20for%20the%20deployment.%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-1010915005%22%20id%3D%22toc-hId-1010915005%22%3E%26nbsp%3B%3C%2FH2%3E%0A%3CH2%20id%3D%22toc-hId--1541241956%22%20id%3D%22toc-hId--1541241956%22%3EProcedure%20to%20deploy%20Azure%20Netapp%20Files%20using%20the%20NFS%20protocol%3C%2FH2%3E%0A%3CH2%20id%3D%22toc-hId-201568379%22%20id%3D%22toc-hId-201568379%22%3E%26nbsp%3B%3C%2FH2%3E%0A%3COL%3E%0A%3CLI%3E%3CP%3EUse%20the%20azurehpc%20repository%20to%20deploy%20the%20network%2C%20Linux%20client%2C%20Windows%20client%2C%20ANF%20account%2C%20ANF%20pool%20and%20ANF%20volume%20(NFS).%20First%20get%20the%20azurehpc%20repository.%3C%2FP%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%3CPRE%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20git%20clone%26nbsp%3Bgit%40github.com%3AAzure%2Fazurehpc.git%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BCreate%20a%20config.json%20file%20for%20the%20deployment.%20The%20config.json%20deploys%20a%20Linux%20client%20and%20windows%20client.%20ANF%2FNFS%20is%20mounted%20on%20the%20Linux%20client%20(See%20the%20appendix%20for%20the%20complete%20config.json%20file.)%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3COL%3E%0A%3CLI%20style%3D%22list-style-type%3A%20none%3B%22%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%26nbsp%3BDeploy%20infrastructure%20(Make%20sure%20you%20are%20in%20the%20same%20directory%20as%20your%20config.json)%3CBR%20%2F%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3Bazure-build%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3E%26nbsp%3BLog-in%20to%20Linux%20headnode%3C%2FP%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3Bazhpc-connect%20headnode%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3E%26nbsp%3BCheck%20that%20anf%20is%20mount%20correctly%3C%2FP%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3Bdf%20-h%3CBR%20%2F%3EFilesystem%20Size%20Used%20Avail%20Use%25%20Mounted%20on%3CBR%20%2F%3E%2Fdev%2Fsda2%2030G%204.4G%2026G%2015%25%20%2F%3CBR%20%2F%3Edevtmpfs%2032G%200%2032G%200%25%20%2Fdev%3CBR%20%2F%3Etmpfs%2032G%200%2032G%200%25%20%2Fdev%2Fshm%3CBR%20%2F%3Etmpfs%2032G%209.1M%2032G%201%25%20%2Frun%3CBR%20%2F%3Etmpfs%2032G%200%2032G%200%25%20%2Fsys%2Ffs%2Fcgroup%3CBR%20%2F%3E%2Fdev%2Fsda1%20497M%2065M%20433M%2013%25%20%2Fboot%3CBR%20%2F%3E%2Fdev%2Fsdb1%20126G%2061M%20120G%201%25%20%2Fmnt%2Fresource%3CBR%20%2F%3E10.2.3.4%3A%2Fanfvol1%20100T%20256K%20100T%201%25%20%2Fnetapps%3CBR%20%2F%3Etmpfs%206.3G%200%206.3G%200%25%20%2Frun%2Fuser%2F1000%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-1944378714%22%20id%3D%22toc-hId-1944378714%22%3EProcedure%20to%20deploy%20Azure%20Netapp%20Files%20using%20the%20SMB%20protocol%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3COL%3E%0A%3CLI%3E%26nbsp%3BDeploy%20an%20Active%20directory%20server%20using%20active-directory-new-domain%20from%20the%20azure-quickstart-templates.%3CBR%20%2F%3E%0A%3COL%3E%0A%3CLI%3E%26nbsp%3BFirst%20get%20the%20repository%20and%20go%20to%20the%20active-directory-new-domain%20directory%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3Bgit%20clone%26nbsp%3Bgit%40github.com%3AAzure%2Fazure-quickstart-templates.git%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BEdit%20azuredeploy.json%20to%20allow%20it%20to%20be%20deployed%20via%20az%20cli%20and%20use%20the%20existing%20azurehpc%20infrastructure.%20The%20detailed%20edits%20are%20documented%20in%20the%20appendix.%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BEdit%26nbsp%3Bazuredeploy.parameters.json%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3B%7B%3CBR%20%2F%3E%22%24schema%22%3A%20%22https%3A%2F%2Fschema.management.azure.com%2Fschemas%2F2015-01-01%2F%3CBR%20%2F%3EdeploymentParameters.json%23%22%2C%3CBR%20%2F%3E%22contentVersion%22%3A%20%221.0.0.0%22%2C%3CBR%20%2F%3E%22parameters%22%3A%20%7B%3CBR%20%2F%3E%20%20%22adminUsername%22%3A%20%7B%3CBR%20%2F%3E%20%20%20%20%22value%22%3A%20%22hpcadmin%22%3CBR%20%2F%3E%20%20%7D%2C%3CBR%20%2F%3E%20%20%22adminPassword%22%3A%20%7B%3CBR%20%2F%3E%20%20%20%20%22value%22%3A%20%22hpcadmin.123%22%3CBR%20%2F%3E%20%20%7D%2C%3CBR%20%2F%3E%20%20%22domainName%22%3A%20%7B%3CBR%20%2F%3E%20%20%20%20%22value%22%3A%20%22anf.local%22%3CBR%20%2F%3E%20%20%7D%2C%3CBR%20%2F%3E%20%20%22dnsPrefix%22%3A%20%7B%3CBR%20%2F%3E%20%20%20%20%22value%22%3A%20%22anf%22%3CBR%20%2F%3E%20%20%7D%3CBR%20%2F%3E%7D%3CBR%20%2F%3E%7D%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3E%26nbsp%3BDeploy%20AD%20server%2C%20note%3A%20deploy%20AD%20in%20its%20own%20resource%20group.%3C%2FP%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3Baz%20group%20deployment%20create%20-g%20anf-smb-ad-wus2%20--template-file%20%3CBR%20%2F%3E%20%20%20%20azuredeploy.json%20--parameters%20%40azuredeploy.parameters.json%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BUsing%20the%20ANF%20pools%2C%20create%20ANF%20volume%20using%20the%20SMB%20protocol%2C%20set%20volume%20size%20and%20SMB%20share%20name.%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BLog-in%20to%20windows%20client%20using%20the%20user%2Fpassword%20defined%20in%20the%20azurehpc%20deployment.%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BChange%20Windows%20client%20DNS%20server%20(set%20it%20to%20the%20private%20IP%20of%20the%20AD%20server)%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%26nbsp%3BFirst%20find%20the%20Interfaceindex%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3BPS%20C%3A%5CUsers%5Cazureuser%26gt%3B%20Get-NetIPConfiguration%3CBR%20%2F%3E%20InterfaceAlias%20%3A%20Ethernet%3CBR%20%2F%3E%20InterfaceIndex%20%3A%206%3CBR%20%2F%3E%20InterfaceDescription%20%3A%20Microsoft%20Hyper-V%20Network%20Adapter%3CBR%20%2F%3E%20NetProfile.Name%20%3A%20Network%3CBR%20%2F%3E%20IPv4Address%20%3A%2010.2.4.5%3CBR%20%2F%3E%20IPv6DefaultGateway%20%3A%3CBR%20%2F%3E%20IPv4DefaultGateway%20%3A%2010.2.4.1%3CBR%20%2F%3E%20DNSServer%20%3A%20168.63.129.16%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BChange%20DNS%20server%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3BSet-DnsClientServerAddress%20-InterfaceIndex%206%20-ServerAddresses%2010.2.1.4%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BCheck%20the%20DNS%20server%20is%20working.%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3BPS%20C%3A%5CUsers%5Chpcadmin%26gt%3B%20nslookup%20anf.local%3CBR%20%2F%3E%20Server%3A%20UnKnown%3CBR%20%2F%3EAddress%3A%2010.2.1.4%3CBR%20%2F%3E%3CBR%20%2F%3EDNS%20request%20timed%20out.%3CBR%20%2F%3Etimeout%20was%202%20seconds.%3CBR%20%2F%3EDNS%20request%20timed%20out.%3CBR%20%2F%3Etimeout%20was%202%20seconds.%3CBR%20%2F%3EName%3A%20anf.local%3CBR%20%2F%3EAddress%3A%2010.2.1.4%3CBR%20%2F%3E%3CBR%20%2F%3E%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BJoin%20the%20Windows%20client%20to%20AD%20(you%20will%20be%20prompted%20for%20a%20password)%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3BPS%20C%3A%5CUsers%5Cazureuser%26gt%3B%20Add-Computer%20-DomainName%20anf.local%20-Credential%20anf%5Chpcadmin%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3ERestart%20the%20Windows%20client.%3C%2FP%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BMap%20network%20drive%2C%20go%20to%20the%20Azure%20portal%20to%20the%20ANF%20SMB%20volume%20you%20created%20and%20take%20note%20of%20the%20SMB%20mounting%20instructions%20(e.g%26nbsp%3B%5C%5Ctesting-2e7d.anf.local%5Canfvol2).%26nbsp%3B%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%26nbsp%3BFile%20explorer%20--%26gt%3B%20network%20--%26gt%3B%20map%20network%20drive%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3E%26nbsp%3BSpecify%20drive%20(e.g%20Z%3A)%20and%20file%20share%20location%20(e.g%20%5C%5Ctesting-2e7d.anf.local%5Canfvol2)%3C%2FP%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%26nbsp%3BCheck%20that%20the%20ANF%2FSMB%20file%20share%20is%20mounted%20and%20available%20on%20the%20Windows%20client.%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%26nbsp%3BClick%20on%20%22This%20PC%22%2C%20should%20see%20the%20mounted%20ANF%2FSMB%20drive%2C%20click%20on%20properties%20to%20see%20more%20details%20about%20the%20file%20share.%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3CH2%20id%3D%22toc-hId--607778247%22%20id%3D%22toc-hId--607778247%22%3E%26nbsp%3B%3C%2FH2%3E%0A%3CH2%20id%3D%22toc-hId-1135032088%22%20id%3D%22toc-hId-1135032088%22%3ETesting%20Azure%20Netapp%20Files%3C%2FH2%3E%0A%3CP%3EThe%20azurehpc%20repository%20contains%20scripts%20for%20running%20IOR%20and%20FIO%20throughput%20and%20IOPS%20storage%20benchmarks%2C%20see%20azurehpc%2Fapps%2Fior%20and%20azurehpc%2Fapps%2Ffio.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId--1417124873%22%20id%3D%22toc-hId--1417124873%22%3E%26nbsp%3B%3C%2FH2%3E%0A%3CH2%20id%3D%22toc-hId-325685462%22%20id%3D%22toc-hId-325685462%22%3EAppendix%3C%2FH2%3E%0A%3CH5%20id%3D%22toc-hId-1857885581%22%20id%3D%22toc-hId-1857885581%22%3E%26nbsp%3B%3C%2FH5%3E%0A%3CH4%20id%3D%22toc-hId-1102679979%22%20id%3D%22toc-hId-1102679979%22%3EAzurehpc%20config.json%20file%20used%20to%20deploy%2C%20ANF%2FNFS%2C%20headnode%20and%20Windows%20client.%3C%2FH4%3E%0A%3CH4%20id%3D%22toc-hId--1449476982%22%20id%3D%22toc-hId--1449476982%22%3E%26nbsp%3B%3C%2FH4%3E%0A%3CPRE%3E%3CBR%20%2F%3E%7B%3CBR%20%2F%3E%22location%22%3A%20%22variables.location%22%2C%3CBR%20%2F%3E%22resource_group%22%3A%20%22variables.resource_group%22%2C%3CBR%20%2F%3E%22install_from%22%3A%20%22headnode%22%2C%3CBR%20%2F%3E%22admin_user%22%3A%20%22hpcadmin%22%2C%3CBR%20%2F%3E%22variables%22%3A%20%7B%3CBR%20%2F%3E%22hpc_image%22%3A%20%22OpenLogic%3ACentOS-HPC%3A7.6%3Alatest%22%2C%3CBR%20%2F%3E%22win_image%22%3A%20%22MicrosoftWindowsDesktop%3AWindows-10%3Ars5-pron%3Alatest%22%2C%3CBR%20%2F%3E%22win_password%22%3A%20%22%22%2C%3CBR%20%2F%3E%22location%22%3A%20%22%22%2C%3CBR%20%2F%3E%22resource_group%22%3A%20%22%22%2C%3CBR%20%2F%3E%22vm_type%22%3A%20%22Standard_D16s_v3%22%2C%3CBR%20%2F%3E%22win_vm_type%22%3A%20%22Standard_D16s_v3%22%2C%3CBR%20%2F%3E%22vnet_resource_group%22%3A%20%22variables.resource_group%22%3CBR%20%2F%3E%7D%2C%3CBR%20%2F%3E%22vnet%22%3A%20%7B%3CBR%20%2F%3E%22resource_group%22%3A%20%22variables.vnet_resource_group%22%2C%3CBR%20%2F%3E%22name%22%3A%20%22hpcvnet%22%2C%3CBR%20%2F%3E%22address_prefix%22%3A%20%2210.2.0.0%2F20%22%2C%3CBR%20%2F%3E%22subnets%22%3A%20%7B%3CBR%20%2F%3E%22admin%22%3A%20%2210.2.1.0%2F24%22%2C%3CBR%20%2F%3E%22viz%22%3A%20%2210.2.2.0%2F24%22%2C%3CBR%20%2F%3E%22storage%22%3A%20%2210.2.3.0%2F24%22%2C%3CBR%20%2F%3E%22compute%22%3A%20%2210.2.4.0%2F22%22%3CBR%20%2F%3E%7D%3CBR%20%2F%3E%7D%2C%3CBR%20%2F%3E%22storage%22%3A%20%7B%3CBR%20%2F%3E%22hpcnetapp%22%3A%20%7B%3CBR%20%2F%3E%22type%22%3A%20%22anf%22%2C%3CBR%20%2F%3E%22subnet%22%3A%20%22storage%22%2C%3CBR%20%2F%3E%22pools%22%3A%20%7B%3CBR%20%2F%3E%22anfpool%22%20%3A%20%7B%3CBR%20%2F%3E%22size%22%3A%208%2C%20%3CBR%20%2F%3E%22service_level%22%3A%20%22Premium%22%2C%20%3CBR%20%2F%3E%22volumes%22%3A%20%7B%20%3CBR%20%2F%3E%22anfvol1%22%20%3A%20%7B%3CBR%20%2F%3E%22size%22%3A%204%2C%20%3CBR%20%2F%3E%22mount%22%3A%20%22%2Fnetapps%22%3CBR%20%2F%3E%7D%20%7D%20%7D%7D%20%7D%20%7D%2C%20%3CBR%20%2F%3E%22resources%22%3A%20%7B%20%3CBR%20%2F%3E%22headnode%22%3A%20%7B%20%3CBR%20%2F%3E%22type%22%3A%20%22vm%22%2C%20%3CBR%20%2F%3E%22vm_type%22%3A%20%22variables.vm_type%22%2C%20%3CBR%20%2F%3E%22public_ip%22%3A%20true%2C%3CBR%20%2F%3E%22image%22%3A%20%22variables.hpc_image%22%2C%3CBR%20%2F%3E%22accelerated_networking%22%3A%20true%2C%20%3CBR%20%2F%3E%22subnet%22%3A%20%22compute%22%2C%3CBR%20%2F%3E%22tags%22%3A%20%5B%3CBR%20%2F%3E%22cndefault%22%2C%3CBR%20%2F%3E%22nfsserver%22%2C%3CBR%20%2F%3E%22loginnode%22%2C%3CBR%20%2F%3E%22localuser%22%2C%3CBR%20%2F%3E%22disable-selinux%22%2C%3CBR%20%2F%3E%22mount-anfpool%22%3CBR%20%2F%3E%5D%3CBR%20%2F%3E%7D%2C%3CBR%20%2F%3E%22winnode%22%3A%20%7B%3CBR%20%2F%3E%22type%22%3A%20%22vm%22%2C%3CBR%20%2F%3E%22vm_type%22%3A%20%22variables.win_vm_type%22%2C%3CBR%20%2F%3E%22accelerated_networking%22%3A%20true%2C%3CBR%20%2F%3E%22password%22%3A%20%22variables.win_password%22%2C%3CBR%20%2F%3E%22public_ip%22%3A%20true%2C%3CBR%20%2F%3E%22image%22%3A%20%22variables.win_image%22%2C%3CBR%20%2F%3E%22subnet%22%3A%20%22compute%22%2C%3CBR%20%2F%3E%22tags%22%3A%20%5B%3CBR%20%2F%3E%5D%3CBR%20%2F%3E%7D%3CBR%20%2F%3E%7D%2C%3CBR%20%2F%3E%22install%22%3A%20%5B%3CBR%20%2F%3E%7B%3CBR%20%2F%3E%22script%22%3A%20%22disable-selinux.sh%22%2C%3CBR%20%2F%3E%22tag%22%3A%20%22disable-selinux%22%2C%3CBR%20%2F%3E%22sudo%22%3A%20true%3CBR%20%2F%3E%7D%2C%3CBR%20%2F%3E%7B%3CBR%20%2F%3E%22script%22%3A%20%22cndefault.sh%22%2C%3CBR%20%2F%3E%22tag%22%3A%20%22cndefault%22%2C%3CBR%20%2F%3E%22sudo%22%3A%20true%3CBR%20%2F%3E%7D%2C%3CBR%20%2F%3E%7B%3CBR%20%2F%3E%22script%22%3A%20%22nfsserver.sh%22%2C%3CBR%20%2F%3E%22tag%22%3A%20%22nfsserver%22%2C%3CBR%20%2F%3E%22sudo%22%3A%20true%3CBR%20%2F%3E%7D%2C%3CBR%20%2F%3E%7B%3CBR%20%2F%3E%22script%22%3A%20%22auto_netappfiles_mount_anfpool.sh%22%2C%3CBR%20%2F%3E%22tag%22%3A%20%22mount-anfpool%22%2C%3CBR%20%2F%3E%22sudo%22%3A%20true%3CBR%20%2F%3E%7D%2C%3CBR%20%2F%3E%7B%3CBR%20%2F%3E%22script%22%3A%20%22nfsclient.sh%22%2C%3CBR%20%2F%3E%22args%22%3A%20%5B%3CBR%20%2F%3E%22%24(%3CHOSTLISTS%3E%3C%2FHOSTLISTS%3E%5D%2C%3CBR%20%2F%3E%22tag%22%3A%20%22nfsclient%22%2C%20%22sudo%22%3A%20true%3CBR%20%2F%3E%7D%2C%3CBR%20%2F%3E%7B%3CBR%20%2F%3E%22script%22%3A%20%22localuser.sh%22%2C%3CBR%20%2F%3E%22args%22%3A%20%5B%3CBR%20%2F%3E%22%24(%3CHOSTLISTS%3E%3C%2FHOSTLISTS%3E%5D%2C%3CBR%20%2F%3E%22tag%22%3A%20%22localuser%22%2C%3CBR%20%2F%3E%22sudo%22%3A%20true%3CBR%20%2F%3E%7D%3CBR%20%2F%3E%5D%3CBR%20%2F%3E%7D%3C%2FPRE%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId-293333353%22%20id%3D%22toc-hId-293333353%22%3EEdits%20required%20to%20the%20active-directory-new-domain%20azuredeploy.json%20arm%20template%20to%20allow%20it%20to%20use%20the%20azurehpc%20deployed%20infrastructure%3C%2FH4%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3COL%3E%0A%3CLI%3ESet%20the%20AD%20subnet%20address%20range%2C%20use%20admin%20subnet%20address%20range%20that%20was%20used%20in%20the%20azurehpc%20deployment.%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%22adSubnetName%22%3A%20%22admin%22%2C%3CBR%20%2F%3E%22adSubnetAddressPrefix%22%3A%20%2210.2.1.0%2F24%22%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3EChange%20virtualNetworkName%2C%20use%20same%20vnet%20deployed%20by%20azurehpc%20%3CBR%20%2F%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%22virtualNetworkName%22%3A%20%22hpcvnet%22%2C%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3EChange%20virtualNetworkAddressRange%2C%20use%20same%20address%20range%20that%20was%20deployed%20by%20azurehpc.%20%3CBR%20%2F%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%22virtualNetworkAddressRange%22%3A%20%2210.2.0.0%2F20%22%2C%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3ESet%20IP%20for%20AD%20server%20(pick%20any%20unused%20IP%20from%20the%20admin%20subnet)%3C%2FP%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%22adNicIPAddress%22%3A%20%2210.2.1.4%22%2C%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3ESet%20vnetRg%2C%20to%20be%20the%20resource%20group%20containing%20the%20vnet.%3C%2FP%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%22vnetRg%22%3A%20%22%22%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3ESet%20location%20of%20raw%20git%20files.%3C%2FP%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%22_artifactsLocation%22%3A%20%7B%3CBR%20%2F%3E%22type%22%3A%20%22string%22%2C%3CBR%20%2F%3E%22metadata%22%3A%20%7B%3CBR%20%2F%3E%22description%22%3A%20%22The%20location%20of%20resources%2C%20such%20as%20templates%20and%20%3CBR%20%2F%3EDSC%20modules%2C%20that%20the%20template%20depends%20on%22%3CBR%20%2F%3E%7D%2C%3CBR%20%2F%3E%22defaultValue%22%3A%20%22https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2F%3CBR%20%2F%3Eazure-quickstart-templates%2Fmaster%2Factive-directory-new-domain%22%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3EModify%20templateLink%20locations%20for%20files.%3C%2FP%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%22templateLink%22%3A%20%7B%3CBR%20%2F%3E%22uri%22%3A%20%22%5Bconcat(parameters('_artifactsLocation')%2C%20'%2Fnestedtemplates%2Fvnet.json'%2C%20%3CBR%20%2F%3Eparameters('_artifactsLocationSasToken'))%5D%22%2C%3CBR%20%2F%3E%22templateLink%22%3A%20%3CBR%20%2F%3E%7B%22uri%22%3A%20%22%5Bconcat(parameters('_artifactsLocation')%2C%20'%2Fnestedtemplates%2Fvnet-with-dns-server.json'%2C%20%3CBR%20%2F%3Eparameters('_artifactsLocationSasToken'))%5D%22%2C%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3ERemove%20deployment%20of%20VNet%2C%20will%20use%20azurehpc%20vnet%20instead.%20Also%20remove%20all%20references%20to%20VNet.%3C%2FP%3E%0A%3C%2FLI%3E%0A%3CLI%3E%0A%3CP%3EModify%20path%20to%20CreateADPDC.zip%3C%2FP%3E%0A%3COL%20style%3D%22list-style-type%3A%20lower-alpha%3B%22%3E%0A%3CLI%3E%0A%3CPRE%3E%22ModulesUrl%22%3A%20%22%5Bconcat(parameters('_artifactsLocation')%2C%20'%2FDSC%2FCreateADPDC..zip'%2C%26nbsp%3B%3CBR%20%2F%3Eparameters('_artifactsLocationSasToken'))%5D%22%2C%3C%2FPRE%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-847264%22%20slang%3D%22en-US%22%3E%3CP%3EA%20procedure%20for%20deploying%20an%20Azure%20Netapp%20Filesusing%20the%20NFS%20and%20SMB%20protocols%20for%20testing%20purposes%20is%20discussed.%3C%2FP%3E%3C%2FLINGO-TEASER%3E
Microsoft

 

Introduction

 

The Azure Netapp Files service has become very popular storage solution, satisfying the I/O requirements for many customer workloads (e.g. Oil and Gas, Manufacturing and Financial). Procedures for deploying Azure Netapp Files using the NFS and SMB protocols and accessing it from a Linux client and Windows client respectively will be discussed. The AzureCAT HPC azurehpc and Azure azure-quickstart-templates repositories will be used for the deployment.

 

Procedure to deploy Azure Netapp Files using the NFS protocol

 

  1. Use the azurehpc repository to deploy the network, Linux client, Windows client, ANF account, ANF pool and ANF volume (NFS). First get the azurehpc repository.

    1.       git clone git@github.com:Azure/azurehpc.git
    2.  Create a config.json file for the deployment. The config.json deploys a Linux client and windows client. ANF/NFS is mounted on the Linux client (See the appendix for the complete config.json file.)
    1.  Deploy infrastructure (Make sure you are in the same directory as your config.json)
      1.  azure-build
  1.  Log-in to Linux headnode

    1.  azhpc-connect headnode
  2.  Check that anf is mount correctly

    1.  df -h
      Filesystem Size Used Avail Use% Mounted on
      /dev/sda2 30G 4.4G 26G 15% /
      devtmpfs 32G 0 32G 0% /dev
      tmpfs 32G 0 32G 0% /dev/shm
      tmpfs 32G 9.1M 32G 1% /run
      tmpfs 32G 0 32G 0% /sys/fs/cgroup
      /dev/sda1 497M 65M 433M 13% /boot
      /dev/sdb1 126G 61M 120G 1% /mnt/resource
      10.2.3.4:/anfvol1 100T 256K 100T 1% /netapps
      tmpfs 6.3G 0 6.3G 0% /run/user/1000

 

Procedure to deploy Azure Netapp Files using the SMB protocol

 

  1.  Deploy an Active directory server using active-directory-new-domain from the azure-quickstart-templates.
    1.  First get the repository and go to the active-directory-new-domain directory
      1.  git clone git@github.com:Azure/azure-quickstart-templates.git
    2.  Edit azuredeploy.json to allow it to be deployed via az cli and use the existing azurehpc infrastructure. The detailed edits are documented in the appendix.
    3.  Edit azuredeploy.parameters.json
      1.  {
        "$schema": "https://schema.management.azure.com/schemas/2015-01-01/
        deploymentParameters.json#",
        "contentVersion": "1.0.0.0",
        "parameters": {
        "adminUsername": {
        "value": "hpcadmin"
        },
        "adminPassword": {
        "value": "hpcadmin.123"
        },
        "domainName": {
        "value": "anf.local"
        },
        "dnsPrefix": {
        "value": "anf"
        }
        }
        }
    4.  Deploy AD server, note: deploy AD in its own resource group.

      1.  az group deployment create -g anf-smb-ad-wus2 --template-file 
        azuredeploy.json --parameters @azuredeploy.parameters.json
    5.  Using the ANF pools, create ANF volume using the SMB protocol, set volume size and SMB share name.
    6.  Log-in to windows client using the user/password defined in the azurehpc deployment.
    7.  Change Windows client DNS server (set it to the private IP of the AD server)
      1.  First find the Interfaceindex
        1.  PS C:\Users\azureuser> Get-NetIPConfiguration
          InterfaceAlias : Ethernet
          InterfaceIndex : 6
          InterfaceDescription : Microsoft Hyper-V Network Adapter
          NetProfile.Name : Network
          IPv4Address : 10.2.4.5
          IPv6DefaultGateway :
          IPv4DefaultGateway : 10.2.4.1
          DNSServer : 168.63.129.16
        2.  Change DNS server
          1.  Set-DnsClientServerAddress -InterfaceIndex 6 -ServerAddresses 10.2.1.4
        3.  Check the DNS server is working.
          1.  PS C:\Users\hpcadmin> nslookup anf.local
            Server: UnKnown
            Address: 10.2.1.4

            DNS request timed out.
            timeout was 2 seconds.
            DNS request timed out.
            timeout was 2 seconds.
            Name: anf.local
            Address: 10.2.1.4

    8.  Join the Windows client to AD (you will be prompted for a password)
      1.  PS C:\Users\azureuser> Add-Computer -DomainName anf.local -Credential anf\hpcadmin
      2. Restart the Windows client.

    9.  Map network drive, go to the Azure portal to the ANF SMB volume you created and take note of the SMB mounting instructions (e.g \\testing-2e7d.anf.local\anfvol2). 
      1.  File explorer --> network --> map network drive
      2.  Specify drive (e.g Z:) and file share location (e.g \\testing-2e7d.anf.local\anfvol2)

    10.  Check that the ANF/SMB file share is mounted and available on the Windows client.
      1.  Click on "This PC", should see the mounted ANF/SMB drive, click on properties to see more details about the file share.

 

Testing Azure Netapp Files

The azurehpc repository contains scripts for running IOR and FIO throughput and IOPS storage benchmarks, see azurehpc/apps/ior and azurehpc/apps/fio.

 

 

Appendix

 

Azurehpc config.json file used to deploy, ANF/NFS, headnode and Windows client.

 


{
"location": "variables.location",
"resource_group": "variables.resource_group",
"install_from": "headnode",
"admin_user": "hpcadmin",
"variables": {
"hpc_image": "OpenLogic:CentOS-HPC:7.6:latest",
"win_image": "MicrosoftWindowsDesktop:Windows-10:rs5-pron:latest",
"win_password": "",
"location": "",
"resource_group": "",
"vm_type": "Standard_D16s_v3",
"win_vm_type": "Standard_D16s_v3",
"vnet_resource_group": "variables.resource_group"
},
"vnet": {
"resource_group": "variables.vnet_resource_group",
"name": "hpcvnet",
"address_prefix": "10.2.0.0/20",
"subnets": {
"admin": "10.2.1.0/24",
"viz": "10.2.2.0/24",
"storage": "10.2.3.0/24",
"compute": "10.2.4.0/22"
}
},
"storage": {
"hpcnetapp": {
"type": "anf",
"subnet": "storage",
"pools": {
"anfpool" : {
"size": 8,
"service_level": "Premium",
"volumes": {
"anfvol1" : {
"size": 4,
"mount": "/netapps"
} } }} } },
"resources": {
"headnode": {
"type": "vm",
"vm_type": "variables.vm_type",
"public_ip": true,
"image": "variables.hpc_image",
"accelerated_networking": true,
"subnet": "compute",
"tags": [
"cndefault",
"nfsserver",
"loginnode",
"localuser",
"disable-selinux",
"mount-anfpool"
]
},
"winnode": {
"type": "vm",
"vm_type": "variables.win_vm_type",
"accelerated_networking": true,
"password": "variables.win_password",
"public_ip": true,
"image": "variables.win_image",
"subnet": "compute",
"tags": [
]
}
},
"install": [
{
"script": "disable-selinux.sh",
"tag": "disable-selinux",
"sudo": true
},
{
"script": "cndefault.sh",
"tag": "cndefault",
"sudo": true
},
{
"script": "nfsserver.sh",
"tag": "nfsserver",
"sudo": true
},
{
"script": "auto_netappfiles_mount_anfpool.sh",
"tag": "mount-anfpool",
"sudo": true
},
{
"script": "nfsclient.sh",
"args": [
"$(<hostlists/tags/nfsserver)"
],
"tag": "nfsclient", "sudo": true
},
{
"script": "localuser.sh",
"args": [
"$(<hostlists/tags/nfsserver)"
],
"tag": "localuser",
"sudo": true
}
]
}

 

Edits required to the active-directory-new-domain azuredeploy.json arm template to allow it to use the azurehpc deployed infrastructure

 

  1. Set the AD subnet address range, use admin subnet address range that was used in the azurehpc deployment.
    1. "adSubnetName": "admin",
      "adSubnetAddressPrefix": "10.2.1.0/24"
  2. Change virtualNetworkName, use same vnet deployed by azurehpc
    1. "virtualNetworkName": "hpcvnet",
  3. Change virtualNetworkAddressRange, use same address range that was deployed by azurehpc.
    1. "virtualNetworkAddressRange": "10.2.0.0/20",
  4. Set IP for AD server (pick any unused IP from the admin subnet)

    1. "adNicIPAddress": "10.2.1.4",
  5. Set vnetRg, to be the resource group containing the vnet.

    1. "vnetRg": ""
  6. Set location of raw git files.

    1. "_artifactsLocation": {
      "type": "string",
      "metadata": {
      "description": "The location of resources, such as templates and
      DSC modules, that the template depends on"
      },
      "defaultValue": "https://raw.githubusercontent.com/Azure/
      azure-quickstart-templates/master/active-directory-new-domain"
  7. Modify templateLink locations for files.

    1. "templateLink": {
      "uri": "[concat(parameters('_artifactsLocation'), '/nestedtemplates/vnet.json',
      parameters('_artifactsLocationSasToken'))]",
      "templateLink":
      {"uri": "[concat(parameters('_artifactsLocation'), '/nestedtemplates/vnet-with-dns-server.json',
      parameters('_artifactsLocationSasToken'))]",
  8. Remove deployment of VNet, will use azurehpc vnet instead. Also remove all references to VNet.

  9. Modify path to CreateADPDC.zip

    1. "ModulesUrl": "[concat(parameters('_artifactsLocation'), '/DSC/CreateADPDC..zip', 
      parameters('_artifactsLocationSasToken'))]",