Azure Data Architecture Guide - Blog #2: On-demand big data analytics

Published 12-24-2018 09:11 AM 892 Views
Microsoft

First published on MSDN on Aug 30, 2018

 

In our second blog in this series, we'll continue to explore the Azure Data Architecture Guide ! Find the blog posts in this series here:

The following example is a technology implementation we have seen directly in our customer engagements. The example can help lead you into the ADAG content to make the right technology choices for your business.

 

On-demand big data analytics

Create cloud-scale, enterprise-ready Hadoop clusters in a matter of minutes for batch and real-time data processing. With Azure, you can build your entire big data processing and analytics pipeline from massive data ingest to world-class business intelligence and reporting, using the technology that's right for you.

Highlighted services



Related ADAG articles


Please peruse ADAG to find a clear path for you to architect your data solution on Azure:




AzureCAT_Icon.jpg 
AzureCAT Guidance  
"Hands-on solutions, with our heads in the Cloud!"

%3CLINGO-SUB%20id%3D%22lingo-sub-306505%22%20slang%3D%22en-US%22%3EAzure%20Data%20Architecture%20Guide%20-%20Blog%20%232%3A%20On-demand%20big%20data%20analytics%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-306505%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSTRONG%3E%20First%20published%20on%20MSDN%20on%20Aug%2030%2C%202018%20%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EIn%20our%20second%20blog%20in%20this%20series%2C%20we'll%20continue%20to%20explore%20the%20%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FADAG%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Azure%20Data%20Architecture%20Guide%20%3C%2FA%3E%20!%20Find%20the%20blog%20posts%20in%20this%20series%20here%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzureCAT%2FAzure-Data-Architecture-Guide-Blog-1-Introduction%2Fba-p%2F306477%22%20target%3D%22_blank%22%3EAzure%20Data%20Architecture%20Guide%20%E2%80%93%20Blog%20%231%3A%20Introduction%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzureCAT%2FAzure-Data-Architecture-Guide-Blog-2-On-demand-big-data%2Fba-p%2F306505%22%20target%3D%22_blank%22%3EAzure%20Data%20Architecture%20Guide%20%E2%80%93%20Blog%20%232%3A%20On-demand%20big%20data%20analytics%3C%2FA%3E%20%3CSTRONG%3E(this%20one)%3C%2FSTRONG%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzureCAT%2FAzure-Data-Architecture-Guide-8211-Blog-3-Advanced-analytics-and%2Fba-p%2F306556%22%20target%3D%22_blank%22%3EAzure%20Data%20Architecture%20Guide%20%E2%80%93%20Blog%20%233%3A%20Advanced%20analytics%20and%20deep%20learning%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzureCAT%2FAzure-Data-Architecture-Guide-8211-Blog-4-Hybrid-data%2Fba-p%2F306579%22%20target%3D%22_blank%22%3EAzure%20Data%20Architecture%20Guide%20%E2%80%93%20Blog%20%234%3A%20Hybrid%20data%20architecture%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzureCAT%2FAzure-Data-Architecture-Guide-8211-Blog-5-Clickstream-analysis%2Fba-p%2F306630%22%20target%3D%22_blank%22%3EAzure%20Data%20Architecture%20Guide%20%E2%80%93%20Blog%20%235%3A%20Clickstream%20analysis%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzureCAT%2FAzure-Data-Architecture-Guide-8211-Blog-6-Business-intelligence%2Fba-p%2F306646%22%20target%3D%22_blank%22%3EAzure%20Data%20Architecture%20Guide%20%E2%80%93%20Blog%20%236%3A%20Business%20intelligence%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzureCAT%2FAzure-Data-Architecture-Guide-8211-Blog-7-Intelligent%2Fba-p%2F306656%22%20target%3D%22_blank%22%3EAzure%20Data%20Architecture%20Guide%20%E2%80%93%20Blog%20%237%3A%20Intelligent%20applications%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzureCAT%2FAzure-Data-Architecture-Guide-Blog-8-Data-warehousing%2Fba-p%2F352865%22%20target%3D%22_blank%22%3EAzure%20Data%20Architecture%20Guide%20%E2%80%93%20Blog%20%238%3A%20Data%20warehousing%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzureCAT%2FAzure-Data-Architecture-Guide-Blog-9-Extract-transform-load-ETL%2Fba-p%2F317016%22%20target%3D%22_blank%22%3EAzure%20Data%20Architecture%20Guide%20%E2%80%93%20Blog%20%239%3A%20Extract%2C%20transform%2C%20load%20(ETL)%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3EThe%20following%20example%20is%20a%20technology%20implementation%20we%20have%20seen%20directly%20in%20our%20customer%20engagements.%20The%20example%20can%20help%20lead%20you%20into%20the%20ADAG%20content%20to%20make%20the%20right%20technology%20choices%20for%20your%20business.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-1736964284%22%20id%3D%22toc-hId-1673393857%22%3EOn-demand%20big%20data%20analytics%3C%2FH2%3E%0A%3CP%3ECreate%20cloud-scale%2C%20enterprise-ready%20Hadoop%20clusters%20in%20a%20matter%20of%20minutes%20for%20batch%20and%20real-time%20data%20processing.%20With%20Azure%2C%20you%20can%20build%20your%20entire%20big%20data%20processing%20and%20analytics%20pipeline%20from%20massive%20data%20ingest%20to%20world-class%20business%20intelligence%20and%20reporting%2C%20using%20the%20technology%20that's%20right%20for%20you.%20%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F64060iFC5B0FD936509552%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId--815192677%22%20id%3D%22toc-hId--878763104%22%3EHighlighted%20services%3C%2FH2%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fstorage%2Fblobs%2Fstorage-blobs-introduction%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Azure%20Storage%20blobs%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fhdinsight%2Finteractive-query%2Fapache-interactive-query-get-started%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Interactive%20Query%20(Hive%20LLAP)%20on%20HDInsight%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fpower-bi%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Power%20BI%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fevent-hubs%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Azure%20Event%20Hubs%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fstream-analytics%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Azure%20Stream%20Analytics%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fsql-database%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Azure%20SQL%20Database%20%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CBR%20%2F%3E%3CBR%20%2F%3E%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-927617658%22%20id%3D%22toc-hId-864047231%22%3ERelated%20ADAG%20articles%3C%2FH2%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fdata-guide%2Fbig-data%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Big%20Data%20Architectures%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3EScenarios%3A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fdata-guide%2Fscenarios%2Fsearch%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Free-form%20text%20search%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fdata-guide%2Fscenarios%2Fcsv-and-json%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Working%20with%20CSV%20and%20JSON%20files%20%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3CLI%3ETechnology%20Choices%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fdata-guide%2Ftechnology-choices%2Fanalytical-data-stores%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Analytical%20data%20stores%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fdata-guide%2Ftechnology-choices%2Fanalysis-visualizations-reporting%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Analytics%20and%20reporting%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fdata-guide%2Ftechnology-choices%2Fbatch-processing%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Batch%20processing%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fdata-guide%2Ftechnology-choices%2Fdata-storage%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Data%20storage%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fdata-guide%2Ftechnology-choices%2Freal-time-ingestion%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Real-time%20message%20ingestion%20%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Fdata-guide%2Ftechnology-choices%2Fstream-processing%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%20Stream%20processing%20%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CBR%20%2F%3EPlease%20peruse%20ADAG%20to%20find%20a%20clear%20path%20for%20you%20to%20architect%20your%20data%20solution%20on%20Azure%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FADAG%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3ERead%20the%20Azure%20Data%20Architecture%20Guide%20%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CBR%20%2F%3E%3CBR%20%2F%3E%3CBR%20%2F%3E%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FCAT%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22AzureCAT_Icon.jpg%22%20style%3D%22width%3A%20200px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F86487i0F88F1FC5C4B3A8C%2Fimage-size%2Fsmall%3Fv%3D1.0%26amp%3Bpx%3D200%22%20title%3D%22AzureCAT_Icon.jpg%22%20alt%3D%22AzureCAT_Icon.jpg%22%20%2F%3E%3C%2FSPAN%3E%3C%2FA%3E%26nbsp%3B%3CBR%20%2F%3E%3CSTRONG%3E%20AzureCAT%20Guidance%26nbsp%3B%3C%2FSTRONG%3E%26nbsp%3B%3CBR%20%2F%3E%3CEM%3E%20%22Hands-on%20solutions%2C%20with%20our%20heads%20in%20the%20Cloud!%22%20%3C%2FEM%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-306505%22%20slang%3D%22en-US%22%3E%3CP%3EFirst%20published%20on%20MSDN%20on%20Aug%2030%2C%202018%20In%20our%20second%20blog%20in%20this%20series%2C%20we'll%20continue%20to%20explore%20the%20Azure%20Data%20Architecture%20Guide!%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-306505%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EArticle%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3Eazure%20data%20architecture%20guide%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3Eed%20price%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Version history
Last update:
‎Apr 06 2020 11:42 AM
Updated by: