Home
%3CLINGO-SUB%20id%3D%22lingo-sub-306678%22%20slang%3D%22en-US%22%3ENEW%20REFERENCE%20ARCHITECTURE%3A%20Batch%20scoring%20of%20Python%20models%20on%20Azure%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-306678%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSTRONG%3EFirst%20published%20on%20MSDN%20on%20Dec%2021%2C%202018%20%3C%2FSTRONG%3E%20%3CBR%20%2F%3EOur%20fifth%20AI%20%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FRefArchs%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Reference%20Architecture%20%3C%2FA%3E%20(on%20the%20%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FArchitecture%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Azure%20Architecture%20Center%20%3C%2FA%3E%20)%20comes%26nbsp%3Bfrom%20AzureCAT%20%3CEM%3E%20%3CSTRONG%3E%20Said%20Bleik%20%3C%2FSTRONG%3E%20%3C%2FEM%3E%20.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fbatch-scoring-python%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Batch%20scoring%20of%20Python%20models%20on%20Azure%20%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CBR%20%2F%3EThis%20reference%20architecture%20shows%20how%20to%20build%20a%20scalable%20solution%20for%20batch%20scoring%20many%20models%20on%20a%20schedule%20in%20parallel%20using%20Azure%20Batch%20AI.%20%3CBR%20%2F%3E%3CBR%20%2F%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fbatch-scoring-python%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20786px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F64188iF2C5695D95BD661F%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20%2F%3E%3C%2FSPAN%3E%20%3C%2FA%3E%3CBR%20%2F%3E%3CBR%20%2F%3EThe%20solution%20monitors%20the%20operation%20of%20a%20large%20number%20of%20devices%20in%20an%20IoT%20setting%20where%20each%20device%20sends%20sensor%20readings%20continuously.%20%3CBR%20%2F%3E%3CBR%20%2F%3EThis%20Reference%20Architecture%20includes%20the%20following%20information%3A%3C%2FP%3E%0A%3COL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fbatch-scoring-python%23architecture%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EArchitecture%20%3C%2FA%3E%20-%26nbsp%3BExplaining%20the%20different%20elements%20of%20the%20architectural%20diagram.%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fbatch-scoring-python%23performance-considerations%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EPerformance%20considerations%20%3C%2FA%3E%20-%20A%20deeper%20look%20at%20parallelizing%20across%20virtual%20machines%2C%20cores%2C%20and%20file%20servers.%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fbatch-scoring-python%23management-considerations%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EManagement%20considerations%20%3C%2FA%3E%20-%20Notes%20on%20monitoring%20Batch%20AI%20jobs%20and%20logging%20in%20Batch%20AI.%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fbatch-scoring-python%23cost-considerations%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3ECost%20considerations%20%3C%2FA%3E%20-%20Examining%20compute%20resources%2C%20Batch%20AI%20cluster%20sizes%2C%20and%20other%20scaling%20factors.%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FAzure%2FBatchAIAnomalyDetection%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EDeploy%20the%20solution%20%3C%2FA%3E%20-%20Our%20GitHub%20repo%20features%20more%20details%2C%20the%20prerequisites%2C%20setup%20steps%2C%20deployment%20instructions%2C%20along%20with%20the%20scripts%20and%20commands.%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3CP%3E%3CBR%20%2F%3EHead%20over%20to%20the%20Azure%20Architecture%20Center%20to%20learn%20more%20about%20this%20reference%20architecture%2C%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fbatch-scoring-python%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Batch%20scoring%20of%20Python%20models%20on%20Azure%20%3C%2FA%3E%20.%20%3CBR%20%2F%3E%26nbsp%3B%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-1701902042%22%20id%3D%22toc-hId-1731459552%22%3ESee%20Also%3C%2FH2%3E%0A%3CP%3E%3CBR%20%2F%3EAdditional%20related%20AI%20Reference%20Architectures%3A%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fbatch-scoring-deep-learning%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Batch%20scoring%20on%20Azure%20for%20deep%20learning%20models%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Frealtime-scoring-python%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Real-time%20scoring%20of%20Python%20Scikit-Learn%20and%20deep%20learning%20models%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Frealtime-scoring-r%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Real-time%20scoring%20of%20R%20machine%20learning%20models%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Freal-time-recommendation%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Build%20a%20real-time%20recommendation%20API%20on%20Azure%20%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CBR%20%2F%3E%3CBR%20%2F%3EFind%20all%20our%20Reference%20Architectures%20%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FRefArchs%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20here%20%3C%2FA%3E%20.%26nbsp%3B%3CBR%20%2F%3E%26nbsp%3B%26nbsp%3B%3CBR%20%2F%3E%3CBR%20%2F%3E%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FCAT%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20194px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F64189i275DE671B2B0B663%2Fimage-dimensions%2F194x194%3Fv%3D1.0%22%20width%3D%22194%22%20height%3D%22194%22%20%2F%3E%3C%2FSPAN%3E%3C%2FA%3E%20%3CBR%20%2F%3E%3CSTRONG%3EAzureCAT%20Guidance%20%3C%2FSTRONG%3E%20%3CBR%20%2F%3E%3CEM%3E%22Hands-on%20solutions%2C%20with%20our%20heads%20in%20the%20Cloud!%22%3C%2FEM%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-306678%22%20slang%3D%22en-US%22%3E%3CP%3EFirst%20published%20on%20MSDN%20on%20Dec%2021%2C%202018%20Our%20fifth%20AI%20Reference%20Architecture%20(on%20the%20Azure%20Architecture%20Center)%20comes%26nbsp%3Bfrom%20AzureCAT%26nbsp%3BSaid%20Bleik.%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-306678%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3Epython%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3Ereference%20architectures%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3Esaid%20bleik%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Microsoft

First published on MSDN on Dec 21, 2018
Our fifth AI Reference Architecture (on the Azure Architecture Center ) comes from AzureCAT Said Bleik .

 


This reference architecture shows how to build a scalable solution for batch scoring many models on a schedule in parallel using Azure Batch AI.



The solution monitors the operation of a large number of devices in an IoT setting where each device sends sensor readings continuously.

This Reference Architecture includes the following information:

  1. Architecture - Explaining the different elements of the architectural diagram.
  2. Performance considerations - A deeper look at parallelizing across virtual machines, cores, and file servers.
  3. Management considerations - Notes on monitoring Batch AI jobs and logging in Batch AI.
  4. Cost considerations - Examining compute resources, Batch AI cluster sizes, and other scaling factors.
  5. Deploy the solution - Our GitHub repo features more details, the prerequisites, setup steps, deployment instructions, along with the scripts and commands.


Head over to the Azure Architecture Center to learn more about this reference architecture, Batch scoring of Python models on Azure .
  

See Also


Additional related AI Reference Architectures: 



Find all our Reference Architectures here
  


AzureCAT Guidance
"Hands-on solutions, with our heads in the Cloud!"