Home
%3CLINGO-SUB%20id%3D%22lingo-sub-824926%22%20slang%3D%22en-US%22%3EHIGH%20PERFORMANCE%20COMPUTING%20(HPC)%3A%20OIL%20AND%20GAS%20IN%20AZURE%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-824926%22%20slang%3D%22en-US%22%3E%3CP%20style%3D%22text-align%3A%20right%3B%22%3E%3CEM%3E%3CSTRONG%3ECo-Author%3A%3C%2FSTRONG%3E%3C%2FEM%3EHussein%20Shel%3C%2FP%3E%0A%3CP%20style%3D%22text-align%3A%20right%3B%22%3E%3CEM%3E%3CSTRONG%3ECredits%3A%3C%2FSTRONG%3E%3C%2FEM%3EEd%20Price%2C%20Azure%20CAT%20HPC%20Team%26nbsp%3B%3C%2FP%3E%0A%3CH1%20style%3D%22text-align%3A%20right%3B%22%20id%3D%22toc-hId-2014991668%22%20id%3D%22toc-hId-2014991668%22%3E%26nbsp%3B%3C%2FH1%3E%0A%3CH1%20id%3D%22toc-hId--537165293%22%20id%3D%22toc-hId--537165293%22%3EGoal%20of%20this%20Blog%3C%2FH1%3E%0A%3CP%3E%3CFONT%20size%3D%226%22%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20%23333333%3B%20font-family%3A%20%26amp%3Bquot%3B%20segoeui%26amp%3Bquot%3B%2C%26amp%3Bquot%3Blato%26amp%3Bquot%3B%2C%26amp%3Bquot%3Bhelvetica%20neue%26amp%3Bquot%3B%2Chelvetica%2Carial%2Csans-serif%3B%20font-size%3A%2032px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20300%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3EGoal%20of%20this%20Blog%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20goal%20of%20this%20blog%20is%20to%20share%20our%20experiences%20running%20key%20Oil%20and%20Gas%20workloads%20in%20Azure.%20We%20have%20worked%20with%20multiple%20customers%20running%20these%20workloads%20successfully%20in%20Azure.%20We%20now%20have%20a%20great%20potential%20for%20using%20the%20cloud%20in%20the%20Oil%20and%20Gas%20industry%2C%20to%20optimize%20the%20business%20workflows%20that%20were%20previously%20limited%20by%20capacity%20and%20older%20hardware.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId-1205645042%22%20id%3D%22toc-hId-1205645042%22%3ETargeted%20Business%20Workflows%3C%2FH1%3E%0A%3CP%3E%3CFONT%20size%3D%226%22%3ETargeted%20Business%20Workflows%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThere%20are%20multiple%20user%20scenarios%20and%20workflows%20in%20Oil%20and%20Gas%20that%20use%20high-performance%20computing%20(HPC)%20to%20solve%20problems%20and%20create%20simulations%20that%20require%20massive%20amounts%20of%20data.%20The%20workflows%20that%20we%20will%20be%20focusing%20on%20in%20this%20blog%20are%20Seismic%20Processing%20and%20Interpretation%2C%20Reservoir%20Simulation%20and%20Modeling%2C%20and%20Computational%20Chemistry.%20We%20will%20refer%20back%20to%20these%20three%20workflows%20throughout%20this%20article.%20See%20the%20figure%20below%20for%20more%20information%20about%20them%3A%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20494px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F128743i83F2646952005088%2Fimage-dimensions%2F494x289%3Fv%3D1.0%22%20width%3D%22494%22%20height%3D%22289%22%20alt%3D%22clipboard_image_0.png%22%20title%3D%22clipboard_image_0.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId--1346511919%22%20id%3D%22toc-hId--1346511919%22%3ERunning%20Your%20Oil%20and%20Gas%20Workload%20in%20Azure%3C%2FH1%3E%0A%3CP%3E%3CFONT%20size%3D%226%22%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20%23333333%3B%20font-family%3A%20%26amp%3Bquot%3B%20segoeui%26amp%3Bquot%3B%2C%26amp%3Bquot%3Blato%26amp%3Bquot%3B%2C%26amp%3Bquot%3Bhelvetica%20neue%26amp%3Bquot%3B%2Chelvetica%2Carial%2Csans-serif%3B%20font-size%3A%2032px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20300%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3ERunning%20Your%20Oil%20and%20Gas%20Workload%20in%20Azure%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20key%20advantage%20that%20the%20cloud%20brings%20is%20elasticity%20of%20resources%20and%20low%20infrastructure%20management%20overhead%20thus%20allowing%20our%20customers%20to%20focus%20on%20their%20primary%20business.%20%3CEM%3EThe%20IEEE%20article%20%3CA%20href%3D%22https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F8355463%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ehere%3C%2FA%3E(Section%201.2)%20presents%20these%20benefits%20in%20some%20more%20detail.%3C%2FEM%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3ENow%20you%20have%20decided%20to%20run%20your%20workload%20in%20Azure.%20Just%20like%20you%20would%20do%20for%20planning%20your%20on-premises%20infrastructure%2C%20you%20need%20to%20make%20some%20key%20infrastructure%20choices%20in%20the%20cloud%20that%20are%20based%20on%20your%20workload%E2%80%99s%20requirements.%20Azure%20offers%20many%20choices%20for%20you%2C%20because%20each%20business%20and%20workload%20have%20their%20unique%20needs.%20However%2C%20we%20are%20laying%20out%20the%20Azure%20service%20architectures%20and%20offerings%20that%20we%20have%20commonly%20used%20in%20our%20projects%20when%20working%20with%20some%20key%20O%26amp%3BG%20customers.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EFrom%20our%20experience%2C%20both%20Reservoir%20and%20Seismic%20workflows%20typically%20have%20similar%20requirements%20for%20compute%20and%20job%20scheduling.%26nbsp%3BHowever%2C%20Seismic%20workloads%20challenge%20the%20infrastructure%20on%20storage%20with%20its%20multi-PB%20storage%20requirements%20(a%20single%20seismic%20processing%20project%20may%20start%20with%20500%20TB%20of%20raw%20data%2C%20which%20requires%20a%20total%20of%20several%20PBs%20of%20long-term%20storage)%20and%20throughput%20requirements%20(measured%20in%20100's%20of%20GB%2Fs).%20We%20will%20share%20below%20a%20few%20options%20we%20have%20today%20so%20you%20can%20successfully%20meet%20the%20goals%20for%20running%20your%20application%20in%20Azure.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-199784911%22%20id%3D%22toc-hId-199784911%22%3ETypical%20Reference%20Deployments%20and%20Infrastructure%20Options%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EBelow%20we%20are%20demonstrating%20two%20of%20the%20common%20deployment%20architectures%20we%20see%20for%20the%20O%26amp%3BG%20workloads.%20While%20it%20is%20less%20complex%20to%20have%20all%20your%20resources%20in%20the%20cloud%20(compute%2C%20storage%2C%20and%20visualization)%2C%20it%20is%20not%20uncommon%20for%20our%20customers%20to%20have%20a%20hybrid%20model%20due%20to%20multiple%20business%20constraints.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CEM%3ECloud%20Only%3C%2FEM%3E%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-1942595246%22%20id%3D%22toc-hId-1942595246%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20683px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F128742i42525B85ADB32ABA%2Fimage-dimensions%2F683x268%3Fv%3D1.0%22%20width%3D%22683%22%20height%3D%22268%22%20alt%3D%22clipboard_image_1.png%22%20title%3D%22clipboard_image_1.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CEM%3EHybrid%3C%2FEM%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20662px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F128741i56AC942D7DEAFD92%2Fimage-dimensions%2F662x373%3Fv%3D1.0%22%20width%3D%22662%22%20height%3D%22373%22%20alt%3D%22clipboard_image_2.png%22%20title%3D%22clipboard_image_2.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EA%20typical%20HPC%20setup%20includes%20a%20front-end%20for%20submitting%20jobs%2C%20a%20job%20scheduler%20or%20orchestrator%2C%20a%20compute%20cluster%2C%20and%20a%20shared%20storage.%20Below%20we%20outline%20the%20typical%20infrastructure%20options%20that%20are%20used%20in%20the%20Oil%20%26amp%3B%20Gas%20workload%20deployments%20shown%20above%20for%20each%20of%20the%20key%20components.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EA%20few%20%3CEM%3Eimportant%3C%2FEM%3Ethings%20to%20note%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3ELustre%2FBeeGFS%20is%20typically%20used%20to%20handle%20the%20large%20throughput%20requirements%20of%20primarily%20seismic%20processing%20(but%20also%20reservoir%20simulation).%3C%2FLI%3E%0A%3CLI%3EAzure%20NetApp%20Files%20and%20local%20disks%20are%20typically%20used%20to%20handle%20the%20more%20latency%2FIOPS%20sensitive%20workloads%2C%20like%20seismic%20interpretation%2C%20model%20preparation%2C%20and%20visualization.%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fazure.microsoft.com%2Fen-us%2Fservices%2Fstorage%2Favere-vfxt%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAvere%20vFXT%3C%2FA%3Eis%20also%20very%20useful%20in%20the%20hybrid%20scenario%2C%20when%20there%20is%20a%20requirement%20to%20sync%20data%20between%20on%20premises%20and%20the%20cloud%2C%20with%20a%20high-read%20I%2FO%20pattern%20(for%20example%2C%20serving%20up%20a%20software%20stack).%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH3%20id%3D%22toc-hId--806075220%22%20id%3D%22toc-hId--806075220%22%3ECompute%20and%20Visualization%20Hardware%3C%2FH3%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EAzure%20offers%20a%20range%20of%20VM%20instances%20that%20are%20optimized%20for%20both%20CPU%20%26amp%3B%20GPU%20intensive%20workloads%20(both%20compute%20and%20visualization)%20that%20are%20greatly%20suitable%20for%20running%20Oil%20and%20Gas%20workloads.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EAzure%20is%20the%20only%20cloud%20platform%20that%20offers%20VM%20instances%20with%20InfiniBand-enabled%20hardware.%20This%20provides%20a%20significant%20performance%20advantage%20for%20running%20some%20reservoir%20simulation%20and%20seismic%20workloads.%20This%20improved%20performance%20narrows%20the%20performance%20gap%20and%20gets%20to%20near%20or%20better%20performance%20than%20current%20on-premises%20infrastructures.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EBelow%20are%20some%20details%20of%20the%20HPC%20SKUs%20available%20at%20the%20time%20of%20writing%20this%20blog%20that%20we%20have%20seen%20commonly%20used%20in%20the%20workloads%20stated%20above.%20You%20can%20find%20a%20complete%20and%20the%20most%20up-to-date%20list%20of%20the%20available%20HPC%20SKUs%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Ftopics%2Fhigh-performance-computing%2F%23compute%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ehere%3C%2FA%3E.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId-740221610%22%20id%3D%22toc-hId-740221610%22%3ECPU-enabled%20virtual%20machines%3C%2FH4%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20383px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F129391i4980D4D73E70371D%2Fimage-dimensions%2F383x441%3Fv%3D1.0%22%20width%3D%22383%22%20height%3D%22441%22%20alt%3D%22clipboard_image_0.png%22%20title%3D%22clipboard_image_0.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId--1811935351%22%20id%3D%22toc-hId--1811935351%22%3EGPU-enabled%20virtual%20machines%3A%20Compute%3C%2FH4%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20456px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F128746iE57EFC0516FB0896%2Fimage-dimensions%2F456x416%3Fv%3D1.0%22%20width%3D%22456%22%20height%3D%22416%22%20alt%3D%22clipboard_image_4.png%22%20title%3D%22clipboard_image_4.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId--69125016%22%20id%3D%22toc-hId--69125016%22%3E%26nbsp%3B%3C%2FH4%3E%0A%3CH4%20id%3D%22toc-hId--641913824%22%20id%3D%22toc-hId--641913824%22%3EGPU-enabled%20virtual%20machines%3A%20Visualization%3C%2FH4%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20429px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F129738i9E56C5302D035955%2Fimage-dimensions%2F429x311%3Fv%3D1.0%22%20width%3D%22429%22%20height%3D%22311%22%20alt%3D%22clipboard_image_0.png%22%20title%3D%22clipboard_image_0.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EHPC%20SKUs%20have%20been%20built%20specially%20for%20high-performance%20scenarios.%20However%2C%20Azure%20also%20offers%20other%20SKUs%20that%20may%20be%20suitable%20for%20certain%20workloads%20you%20are%20running%20on%20your%20HPC%20infrastructure%2C%20which%20could%20be%20run%20effectively%20on%20less%20expensive%20hardware.%20Some%20compute%20SKUs%20commonly%20used%20are%20the%20E%20and%20F%20series.%20Details%20for%20the%20available%20Azure%20VM%20SKUs%20can%20be%20found%20%3CA%20href%3D%22https%3A%2F%2Fazure.microsoft.com%2Fen-us%2Fservices%2Fvirtual-machines%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ehere%3C%2FA%3E.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId-1100896511%22%20id%3D%22toc-hId-1100896511%22%3EJob%20Scheduler%3C%2FH4%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EAzure%20offers%20some%20specialized%20services%20that%20one%20can%20use%20to%20schedule%20compute-intensive%20work%20to%20run%20on%20a%20managed%20pool%20of%20virtual%20machines%2C%20and%20you%20can%20automatically%20scale%20compute%20resources%20to%20meet%20the%20needs%20of%20your%20jobs.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20487px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F128750i98D9F1590D9A193A%2Fimage-dimensions%2F487x305%3Fv%3D1.0%22%20width%3D%22487%22%20height%3D%22305%22%20alt%3D%22clipboard_image_6.png%22%20title%3D%22clipboard_image_6.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CH3%20id%3D%22toc-hId-345690909%22%20id%3D%22toc-hId-345690909%22%3E%26nbsp%3B%3C%2FH3%3E%0A%3CH3%20id%3D%22toc-hId-2088501244%22%20id%3D%22toc-hId-2088501244%22%3EAzure%20Batch%3C%2FH3%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fbatch%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20Batch%3C%2FA%3E%26nbsp%3Bis%20a%20managed%20service%20for%20running%20large-scale%20HPC%20applications.%20Using%20Azure%20Batch%2C%20you%20configure%20a%20VM%20pool%2C%20and%20then%20you%20upload%20the%20applications%20and%20data%20files.%20Then%20the%20Batch%20service%20provisions%20the%20VMs%2C%20assigns%20tasks%20to%20the%20VMs%2C%20runs%20the%20tasks%2C%20and%20monitors%20the%20progress.%20Batch%20can%20automatically%20scale%20up%2Fdown%20the%20VMs%20in%20response%20to%20the%20changing%20workload.%20Batch%20also%20provides%20a%20job-scheduling%20functionality.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId-2034360220%22%20id%3D%22toc-hId-2034360220%22%3EAzure%20CycleCloud%3C%2FH4%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fcyclecloud%2F%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20CycleCloud%3C%2FA%3Eis%20a%20tool%20for%20creating%2C%20managing%2C%20operating%2C%20and%20optimizing%20HPC%20%26amp%3B%20Big%20Compute%20clusters%20in%20Azure.%20With%20Azure%20CycleCloud%2C%20users%20can%20dynamically%20provision%20HPC%20Azure%20clusters%20and%20orchestrate%20data%20and%20jobs%20for%20hybrid%20and%20cloud%20workflows.%20Azure%20CycleCloud%20provides%20the%20simplest%20way%20to%20manage%20HPC%20workloads%2C%20by%20using%20various%20Work%20Load%20Managers%20(like%20Grid%20Engine%2C%20HPC%20Pack%2C%20HTCondor%2C%20LSF%2C%20PBS%20Pro%2C%20Slurm%2C%20or%20Symphony)%20on%20Azure.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH3%20id%3D%22toc-hId-1279154618%22%20id%3D%22toc-hId-1279154618%22%3EStorage%3C%2FH3%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EBelow%20are%20some%20of%20the%20important%20storage%20options%20available%20at%20the%20time%20of%20writing%20this%20blog%20that%20we%20commonly%20see%20being%20used%20in%20Oil%20and%20Gas%20workloads.%20Select%20an%20option%20based%20on%20your%20unique%20IO%20and%20capacity%20requirements.%20You%20can%20find%20a%20complete%20and%20the%20most%20up%20to%20date%20list%20for%20available%20HPC%20storage%20options%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Ftopics%2Fhigh-performance-computing%2F%23storage%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ehere%3C%2FA%3E.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20532px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F128751i19DC2CD725E4FE78%2Fimage-dimensions%2F532x294%3Fv%3D1.0%22%20width%3D%22532%22%20height%3D%22294%22%20alt%3D%22clipboard_image_7.png%22%20title%3D%22clipboard_image_7.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId--1974066921%22%20id%3D%22toc-hId--1974066921%22%3E%26nbsp%3B%3C%2FH1%3E%0A%3CP%3E%3CEM%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%3C%2FEM%3E%3C%2FP%3E%0A%3CP%3E%3CEM%3ENote%3A%20While%20PFS%20can%20scale%20well%20to%20much%20larger%20scale%20than%20mentioned%20here%2C%20at%20scales%20higher%20than%20these%20one%20may%20want%20to%20consider%20management%20and%20cost%20implications%20of%20maintaining%20a%20static%20IaaS%20based%20cluster%20where%20ClusterStor%20may%20be%20a%20good%20choice.%20For%20building%20larger%20elastic%20clusters%20on%20the%20fly%20you%20can%20still%20do%20it%20fairly%20easily%20using%20some%20of%20the%20scripts%20shared%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%2Ftree%2Fmaster%2Fexamples%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3Ehere%3C%2FA%3E.%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%26nbsp%3B%3C%2FEM%3E%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId--231256586%22%20id%3D%22toc-hId--231256586%22%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%3C%2FH1%3E%0A%3CH1%20id%3D%22toc-hId-1511553749%22%20id%3D%22toc-hId-1511553749%22%3E%3CSTRONG%3ESome%20Key%20Oil%20and%20Gas%20Applications%20that%20Our%20Customers%20and%20Partners%20Have%20Run%20on%20Azure%3C%2FSTRONG%3E%3C%2FH1%3E%0A%3CP%3E%3CSTRONG%3E%3CFONT%20size%3D%226%22%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20%23333333%3B%20font-family%3A%20%26amp%3Bquot%3B%20segoeui%26amp%3Bquot%3B%2C%26amp%3Bquot%3Blato%26amp%3Bquot%3B%2C%26amp%3Bquot%3Bhelvetica%20neue%26amp%3Bquot%3B%2Chelvetica%2Carial%2Csans-serif%3B%20font-size%3A%2032px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20300%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3ESome%20Key%20Oil%20and%20Gas%20Applications%20that%20Our%20Customers%20and%20Partners%20Have%20Run%20on%20Azure%3C%2FFONT%3E%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThere%20is%20a%20long%20list%20of%20commercial%20and%20proprietary%20applications%20that%20are%20used%20in%20the%20Oil%20and%20Gas%20workflows%20mentioned%20above.%20They%20run%20well%20on%20Azure%20today%20and%20have%20been%20chosen%20by%20our%20customers%20to%20migrate.%20We%20are%20listing%20a%20handful%20of%20these%20applications%20below%2C%20in%20order%20to%20provide%20some%20perspective.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CTABLE%20width%3D%22551%22%3E%0A%3CTBODY%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3E%3CSTRONG%3EApplication%3C%2FSTRONG%3E%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3E%3CSTRONG%3EWorkflow%3C%2FSTRONG%3E%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EMechdyne%20TGX%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ETechnical%20Desktop%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ECitrix%20Xenapp%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ETechnical%20Desktop%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EHP%20RGS%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ETechnical%20Desktop%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EVMware%20Horizon%20View%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ETechnical%20Desktop%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ECGG%20GeoSoftware%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ESeismic%2C%20Reservoir%2C%20Velocity%2C%20etc.%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EHalliburton%20SeisSpace%20ProMAX%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ESeismic%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EHalliburton%20DecisionSpace%20Geosciences%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EInterpretation%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EHalliburton%20Nexus%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EReservoir%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ERock%20Flow%20Dynamics%20tNavigator%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EReservoir%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ESchlumberger%20ECLIPSE%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EReservoir%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ESchlumberger%20INTERSECT%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EReservoir%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EEmerson%20Paradigm%20Suite%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ESeismic%2C%20Reservoir%2C%20etc.%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ECMG%20STARS%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EReservoir%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EOPM%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EReservoir%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EParaView%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EInterpretation%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%3E%3CP%3EPetrel%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%3E%3CP%3EInterpretation%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EResInsight%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EInterpretation%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EAbaqus%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EFinite%20Element%20Analysis%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EGromacs%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EComputational%20Chemistry%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3ELAMMPS%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EComputational%20Chemistry%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EVASP%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EComputational%20Chemistry%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EQuantum%20ESPRESSO%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22276%22%3E%3CP%3EComputational%20Chemistry%3C%2FP%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3C%2FTBODY%3E%0A%3C%2FTABLE%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId--1040603212%22%20id%3D%22toc-hId--1040603212%22%3ETest%20Drive%3C%2FH1%3E%0A%3CP%3E%3CFONT%20size%3D%226%22%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20%23333333%3B%20font-family%3A%20%26amp%3Bquot%3B%20segoeui%26amp%3Bquot%3B%2C%26amp%3Bquot%3Blato%26amp%3Bquot%3B%2C%26amp%3Bquot%3Bhelvetica%20neue%26amp%3Bquot%3B%2Chelvetica%2Carial%2Csans-serif%3B%20font-size%3A%2032px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20300%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3ETest%20Drive%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20Azure%20CAT%20HPC%20team%20has%20put%20together%20a%20framework%20for%20deploying%20an%20end-to-end%20(e2e)%20Azure%20environment%20and%20for%20running%20your%20workload.%20If%20you%20would%20like%20to%20try%20to%20run%20your%20O%26amp%3BG%20scenarios%2C%20you%20can%20very%20easily%20use%20the%20examples%20here%20to%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ebuild%20an%20environment%20of%20your%20choice%3C%2FA%3Eor%20just%20try%20some%20of%20the%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%2Ftree%2Fmaster%2Ftutorials%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3Etutorials%3C%2FA%3Eprovided%2C%20which%20include%20some%20applications%20like%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%2Ftree%2Fmaster%2Ftutorials%2Foil_and_gas_opm%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EOPM%20(open%20source)%3C%2FA%3Eand%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%2Ftree%2Fmaster%2Ftutorials%2Foil_and_gas_intersect%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EIntersect%20(requires%20license)%3C%2FA%3E.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId--1353481506%22%20id%3D%22toc-hId--1353481506%22%3EAdditional%20References%3C%2FH1%3E%0A%3CP%3E%3CFONT%20size%3D%226%22%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20%23333333%3B%20font-family%3A%20%26amp%3Bquot%3B%20segoeui%26amp%3Bquot%3B%2C%26amp%3Bquot%3Blato%26amp%3Bquot%3B%2C%26amp%3Bquot%3Bhelvetica%20neue%26amp%3Bquot%3B%2Chelvetica%2Carial%2Csans-serif%3B%20font-size%3A%2032px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20300%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3EAdditional%20References%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EISV%20Partnership%20Announcements%3A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fwww.slb.com%2Fnewsroom%2Fpress-release%2F2019%2Fpr-2019-0916-slb-sis-microsoft%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3ESchlumberger%20Selects%20Microsoft%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fazure.microsoft.com%2Fen-us%2Fblog%2Fbig-compute-for-large-engineering-simulations%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EINTERSECT%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22http%3A%2F%2Fwww.landmark.solutions%2FMicrosoft-and-Halliburton-Collaborate%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3EMicrosoft%20and%20Halliburton%20Collaborate%20to%20Digitally%20Transform%20the%20Oil%20and%20Gas%20Industry%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22http%3A%2F%2Fwww.pdgm.com%2Fnews-and-events%2Fpress-releases%2F2017%2Fannouncing-paradigm-17-for-the-cloud%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3EParadigm%20Cloud%2017%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fwww.cgg.com%2Fen%2FWhat-We-Do%2FData-Management%2FDigital-Technology%2FCloud-Services%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3ECGG%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fwww.cgg.com%2Fen%2FInvestors%2FPress-Releases%2F2018%2F6%2FGeoSoftware-Machine-Learning-Cloud-Ready-Applications%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3ECGG%20GeoSoftware%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3CLI%3ECustomer%20Partnership%20Announcements%3A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fwww.chevron.com%2Fstories%2Fchevron-partners-with-microsoft%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3EChevron%20Digital%20Transformation%20and%20Data%20Center%20Migration%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fwww.equinor.com%2Fen%2Fnews%2F20jun2018-microsoft-cloud-services.html%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3EEquinor%20and%20Microsoft%20Digital%20Transformation%20Partnership%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fcustomers.microsoft.com%2Fen-us%2Fstory%2Fexxonmobil-mining-oil-gas-azure%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EExxonMobil%20XTO%20and%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fnews.microsoft.com%2F2018%2F04%2F10%2Fc3-iot-and-microsoft-announce-strategic-partnership-to-accelerate-ai-in-the-enterprise%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EShell%20and%20C3%20IoT%20Partnership%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fnews.microsoft.com%2Fen-gb%2F2017%2F07%2F25%2Fbp-selects-microsoft-azure-company-wide-platform-part-modernisation-programme-2%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EBP%20IT%20Estate%20Modernization%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fnews.microsoft.com%2Feurope%2F2017%2F12%2F18%2Frepsol-signs-alliance-microsoft-part-digitalization-strategy%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3ERepsol%20HPC%20and%20Data%20Platform%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3CLI%3ETechnical%20References%3A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Ftopics%2Fhigh-performance-computing%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EHPC%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzureCAT%2Fbg-p%2FAzureCAT%2Flabel-name%2FHPC%22%20target%3D%22_blank%22%20rel%3D%22noopener%22%3EAzure%20CAT%20Blog%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2Fazurehpc%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20HPC%20Building%20Blocks%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzure-Compute%2FReservoir-Simulation-on-Azure-HPC-for-Oil-amp-Gas%2Fba-p%2F791986%22%20target%3D%22_self%22%3EOPM%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-824926%22%20slang%3D%22en-US%22%3E%3CP%3EThe%20goal%20of%20this%20blog%20is%20to%20share%20our%20experiences%20running%20key%20Oil%20and%20Gas%20workloads%20in%20Azure.%20We%20have%20worked%20with%20multiple%20customers%20running%20these%20workloads%20successfully%20in%20Azure.%20We%20now%20have%20a%20great%20potential%20for%20using%20the%20cloud%20in%20the%20Oil%20and%20Gas%20industry%2C%20to%20optimize%20the%20business%20workflows%20that%20were%20previously%20limited%20by%20capacity%20and%20older%20hardware.%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-824926%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAzure%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3Eazurecat%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EHPC%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EO%26amp%3BG%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EOilandGas%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Microsoft

Co-Author: Hussein Shel

Credits: Ed Price, Azure CAT HPC Team 

 

Goal of this Blog

Goal of this Blog

 

The goal of this blog is to share our experiences running key Oil and Gas workloads in Azure. We have worked with multiple customers running these workloads successfully in Azure. We now have a great potential for using the cloud in the Oil and Gas industry, to optimize the business workflows that were previously limited by capacity and older hardware.

 

Targeted Business Workflows

Targeted Business Workflows

 

There are multiple user scenarios and workflows in Oil and Gas that use high-performance computing (HPC) to solve problems and create simulations that require massive amounts of data. The workflows that we will be focusing on in this blog are Seismic Processing and Interpretation, Reservoir Simulation and Modeling, and Computational Chemistry. We will refer back to these three workflows throughout this article. See the figure below for more information about them: 

 

clipboard_image_0.png

 

Running Your Oil and Gas Workload in Azure

Running Your Oil and Gas Workload in Azure

 

The key advantage that the cloud brings is elasticity of resources and low infrastructure management overhead thus allowing our customers to focus on their primary business. The IEEE article here (Section 1.2) presents these benefits in some more detail.

 

Now you have decided to run your workload in Azure. Just like you would do for planning your on-premises infrastructure, you need to make some key infrastructure choices in the cloud that are based on your workload’s requirements. Azure offers many choices for you, because each business and workload have their unique needs. However, we are laying out the Azure service architectures and offerings that we have commonly used in our projects when working with some key O&G customers.

 

From our experience, both Reservoir and Seismic workflows typically have similar requirements for compute and job scheduling. However, Seismic workloads challenge the infrastructure on storage with its multi-PB storage requirements (a single seismic processing project may start with 500 TB of raw data, which requires a total of several PBs of long-term storage) and throughput requirements (measured in 100's of GB/s). We will share below a few options we have today so you can successfully meet the goals for running your application in Azure.

 

Typical Reference Deployments and Infrastructure Options

 

Below we are demonstrating two of the common deployment architectures we see for the O&G workloads. While it is less complex to have all your resources in the cloud (compute, storage, and visualization), it is not uncommon for our customers to have a hybrid model due to multiple business constraints.

 

Cloud Only

clipboard_image_1.png

 

Hybrid

clipboard_image_2.png

 

A typical HPC setup includes a front-end for submitting jobs, a job scheduler or orchestrator, a compute cluster, and a shared storage. Below we outline the typical infrastructure options that are used in the Oil & Gas workload deployments shown above for each of the key components.

 

A few important things to note:

  • Lustre/BeeGFS is typically used to handle the large throughput requirements of primarily seismic processing (but also reservoir simulation).
  • Azure NetApp Files and local disks are typically used to handle the more latency/IOPS sensitive workloads, like seismic interpretation, model preparation, and visualization.
  • Avere vFXT is also very useful in the hybrid scenario, when there is a requirement to sync data between on premises and the cloud, with a high-read I/O pattern (for example, serving up a software stack).

 

Compute and Visualization Hardware

 

Azure offers a range of VM instances that are optimized for both CPU & GPU intensive workloads (both compute and visualization) that are greatly suitable for running Oil and Gas workloads.

 

Azure is the only cloud platform that offers VM instances with InfiniBand-enabled hardware. This provides a significant performance advantage for running some reservoir simulation and seismic workloads. This improved performance narrows the performance gap and gets to near or better performance than current on-premises infrastructures.

 

Below are some details of the HPC SKUs available at the time of writing this blog that we have seen commonly used in the workloads stated above. You can find a complete and the most up-to-date list of the available HPC SKUs here.

 

CPU-enabled virtual machines

 

clipboard_image_0.png

 

GPU-enabled virtual machines: Compute

 

clipboard_image_4.png

 

GPU-enabled virtual machines: Visualization

 

clipboard_image_0.png

 

HPC SKUs have been built specially for high-performance scenarios. However, Azure also offers other SKUs that may be suitable for certain workloads you are running on your HPC infrastructure, which could be run effectively on less expensive hardware. Some compute SKUs commonly used are the E and F series. Details for the available Azure VM SKUs can be found here.

 

Job Scheduler

 

Azure offers some specialized services that one can use to schedule compute-intensive work to run on a managed pool of virtual machines, and you can automatically scale compute resources to meet the needs of your jobs.

 

clipboard_image_6.png

 

Azure Batch

 

Azure Batch is a managed service for running large-scale HPC applications. Using Azure Batch, you configure a VM pool, and then you upload the applications and data files. Then the Batch service provisions the VMs, assigns tasks to the VMs, runs the tasks, and monitors the progress. Batch can automatically scale up/down the VMs in response to the changing workload. Batch also provides a job-scheduling functionality.

 

Azure CycleCloud

 

Azure CycleCloud is a tool for creating, managing, operating, and optimizing HPC & Big Compute clusters in Azure. With Azure CycleCloud, users can dynamically provision HPC Azure clusters and orchestrate data and jobs for hybrid and cloud workflows. Azure CycleCloud provides the simplest way to manage HPC workloads, by using various Work Load Managers (like Grid Engine, HPC Pack, HTCondor, LSF, PBS Pro, Slurm, or Symphony) on Azure.

 

Storage

 

Below are some of the important storage options available at the time of writing this blog that we commonly see being used in Oil and Gas workloads. Select an option based on your unique IO and capacity requirements. You can find a complete and the most up to date list for available HPC storage options here.

 

clipboard_image_7.png

 

             

Note: While PFS can scale well to much larger scale than mentioned here, at scales higher than these one may want to consider management and cost implications of maintaining a static IaaS based cluster where ClusterStor may be a good choice. For building larger elastic clusters on the fly you can still do it fairly easily using some of the scripts shared here.      

                       

Some Key Oil and Gas Applications that Our Customers and Partners Have Run on Azure

Some Key Oil and Gas Applications that Our Customers and Partners Have Run on Azure

 

There is a long list of commercial and proprietary applications that are used in the Oil and Gas workflows mentioned above. They run well on Azure today and have been chosen by our customers to migrate. We are listing a handful of these applications below, in order to provide some perspective.

 

Application

Workflow

Mechdyne TGX

Technical Desktop

Citrix Xenapp

Technical Desktop

HP RGS

Technical Desktop

VMware Horizon View

Technical Desktop

CGG GeoSoftware

Seismic, Reservoir, Velocity, etc.

Halliburton SeisSpace ProMAX

Seismic

Halliburton DecisionSpace Geosciences

Interpretation

Halliburton Nexus

Reservoir

Rock Flow Dynamics tNavigator

Reservoir

Schlumberger ECLIPSE

Reservoir

Schlumberger INTERSECT

Reservoir

Emerson Paradigm Suite

Seismic, Reservoir, etc.

CMG STARS

Reservoir

OPM

Reservoir

ParaView

Interpretation

Petrel

Interpretation

ResInsight

Interpretation

Abaqus

Finite Element Analysis

Gromacs

Computational Chemistry

LAMMPS

Computational Chemistry

VASP

Computational Chemistry

Quantum ESPRESSO

Computational Chemistry

 

Test Drive

Test Drive

 

The Azure CAT HPC team has put together a framework for deploying an end-to-end (e2e) Azure environment and for running your workload. If you would like to try to run your O&G scenarios, you can very easily use the examples here to build an environment of your choice or just try some of the tutorials provided, which include some applications like OPM (open source) and Intersect (requires license).

 

Additional References

Additional References