Forum Discussion
Identifying the best analytics service to use for Azure Sentinel data processing
Hi,
I am replacing an old data processing system, starting from Sentinel and ending in an Azure SQL table.
The old system used to be like below:
I want to put it all into the cloud, like below: (note that the data processing does not need to stay as a Python script, I can rewrite it into any new language / system needed)
What would be the best practice Azure product to do the "?" step in? I first assumed Azure Data Factory, however with the wide range of complex tools available I want to get a better idea of which product is best suited before investing time into creating a solution.
Thanks in advance.
HelloSamsonBark !
Given the details provided, if you want a cloud-native service that provides a combination of data integration, big data analytics, and data warehousing, Azure Synapse Analytics might be the best choice. It allows you to centralize your data, run large-scale analytics, and then directly integrate with visualization tools like Power BI. If the data processing is more linear and workflow-oriented, Azure Data Factory could be the tool to use.
You may also consider Databricks If the data processing and analysis you're doing in Jupyter/Python is intensive or based on large datasets.
Here is a good Cost analysis that may also assist your choice :
------------------
I hope this helps !
Kindly mark the answer as best response in case it helped!
If you need additional clarifications we are here to help !
Regards
1 Reply
HelloSamsonBark !
Given the details provided, if you want a cloud-native service that provides a combination of data integration, big data analytics, and data warehousing, Azure Synapse Analytics might be the best choice. It allows you to centralize your data, run large-scale analytics, and then directly integrate with visualization tools like Power BI. If the data processing is more linear and workflow-oriented, Azure Data Factory could be the tool to use.
You may also consider Databricks If the data processing and analysis you're doing in Jupyter/Python is intensive or based on large datasets.
Here is a good Cost analysis that may also assist your choice :
------------------
I hope this helps !
Kindly mark the answer as best response in case it helped!
If you need additional clarifications we are here to help !
Regards