Unleash the power of predictive analytics in Azure Synapse with machine learning and AI
Published Dec 08 2020 09:00 AM 44.4K Views
Microsoft

We are really excited to introduce the preview of new machine learning experiences in Azure Synapse Analytics, to make it easier for data professionals to enrich data and build predictive analytics solutions.

 

AI and machine learning is an important aspect of any analytics solution. By integrating Azure Synapse Analytics with Azure Machine Learning and Azure Cognitive Services, we are bringing together the best of two worlds, to empower data professionals with the power of predictive analytics and AI.  Data engineers working in Azure Synapse can access models in Azure Machine Learning’s central model registry, created by data scientists. Data engineers can also build models with ease in Azure Synapse, using the code-free automated ML powered by Azure Machine Learning and use these models to enrich data.

 

Linking workspaces to enable collaboration between Data professionals and ML professionals

Linked services can be created to enable seamless collaboration across an Azure Synapse and an Azure Machine Learning workspace. Linked workspaces allow data professionals in Synapse to leverage new machine learning experiences aiming to make it easier to collaborate across Synapse and Azure ML.

 

johnmac_MS_5-1607312207773.png

Create the Azure Machine Linked service in your Synapse workspace

 

Seamlessly access Azure Machine Learning models from Synapse

Data professionals working in Azure Synapse can collaborate seamlessly with ML professionals who create models in Azure Machine Learning. These models can be shared and deployed directly in Azure Synapse for enrichment of data.

 

johnmac_MS_6-1607312207809.png

In the model scoring wizard, enrich with an existing model

 

By supporting the portable ONNX model format, users can bring a variety of models to Synapse for performant batch scoring, right where the data lives. This removes the need for data movement and ensures that the data remains within the security boundaries defined by Azure Synapse. Columns containing predicted values can easily be appended to the original views and tables that are used to populate your Power BI reports.

 

Enrich data with Azure Cognitive Services pre-trained models

Fully integrated data enrichment capabilities powered by Azure Cognitive Services allow Synapse users to enrich data and gain insights by leveraging state of the art pre-trained AI models. The first two models available through the Synapse workspace are Text Analytics (Sentiment Analysis) and Anomaly detector. In the future you’ll see more pre-trained models available for use.

 

johnmac_MS_7-1607312207821.png

Leverage Azure Cognitive Services in Azure Synapse for sentiment analysis

 

johnmac_MS_8-1607312207837.png

Leverage Azure Cognitive Services in Azure Synapse for Anomaly detection

 

Train models in Synapse using Automated ML powered by Azure Machine Learning

Data professionals can also build models with ease in Azure Synapse, using code-free automated ML powered by Azure Machine Learning. These Automated ML runs will be executed on Synapse serverless Apache Spark pools and tracked in the Azure Machine Learning service.

 

johnmac_MS_9-1607312207858.png

Select the task type for your Automated ML run in Azure Synapse

 

All the machine learning experiences in Azure Synapse produce code artifacts such as PySpark Notebooks or SQL scripts, that allow users of all skill levels to easily operationalize their work in data integration pipelines, to support end-to-end analytics flows from a single unified Synapse experience.

 

Get started today

The integration between Azure Synapse Analytics and Azure AI promotes seamless collaboration between data and ML teams to develop predictive analytics solutions. With these new experiences in Synapse Studio, teams of all skill levels can leverage machine learning to analyze and enrich data and deliver greater analytics insights. Join customers already taking advantage of predictive analytics solutions and get started on your journey by using the links provided below.

 

 

 

Resources:

AzureSynapse ML Docs overview: https://aka.ms/synapseMLDocs

Azure Synapse Automated ML tutorial: https://aka.ms/SynapseMLDocs_AutoML_tutorial

Azure Synapse model scoring tutorial: https://aka.ms/SynapseMLDocs_Scoring_Tutorial

Azure Synapse Cognitive Services tutorial: https://aka.ms/SynapseML_Docs_Cognitive_Services

Link Azure Synapse workspace to Azure ML workspace:https://aka.ms/SynapseMLDocs_link_AML

Azure Synapse TechCommunity: Check this blog daily to see a roundup of all the new tutorial blogs that will be posted for the next two weeks.

 

johnmac_MS_0-1607376512541.png

 

 

2 Comments
Version history
Last update:
‎Dec 08 2020 01:21 PM
Updated by: