Seamlessly onboard streaming workloads to Azure Synapse Analytics

Published Jan 06 2020 10:11 AM 4,133 Views
Microsoft

Native streaming capabilities for ingestion and near real-time analytics with Azure Synapse Analytics (formerly SQL Data Warehouse) have been available since the launch at Microsoft Ignite. Onboarding and managing your streaming workloads for SQL analytics has never been easier.

 

Previously setting up and managing streaming workloads was a complex and cumbersome process for Azure Synapse. Users have to setup and configure separate services such as Azure Stream Analytics and Databricks where each service has their own billing and security models including separate provisioning experiences.

 

With the latest streaming capabilities, you can now seamlessly onboard and manage streaming workloads where:

 

  • The COPY command is now leveraged under the covers for high-throughput data ingestion directly to compute nodes
  • Users no longer require CONTROL permissions on their database set up their streaming jobs - only ADMINISTER DATABASE BULK OPERATIONS and INSERT permissions on the specified table is required
  • Provisioning and managing streaming jobs can be done directly in the portal of Azure Synapse without opening multiple portal blades, notebooks, and editors
  • Automatic schema detection on the streaming input source enables a simple and code free set-up process including automatic table creation

Stay tuned for additional streaming capabilities and enhancements to our user experience! Help us by joining our preview and signing up directly in the Azure Synapse portal:

 

clipboard_image_0.png

%3CLINGO-SUB%20id%3D%22lingo-sub-1092676%22%20slang%3D%22en-US%22%3ESeamlessly%20onboard%20streaming%20workloads%20to%20Azure%20Synapse%20Analytics%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1092676%22%20slang%3D%22en-US%22%3E%3CP%3ENative%20streaming%20capabilities%20for%20ingestion%20and%20near%20real-time%20analytics%20with%20Azure%20Synapse%20Analytics%20(formerly%20SQL%20Data%20Warehouse)%20have%20been%20available%20since%20the%20%3CA%20href%3D%22https%3A%2F%2Fazure.microsoft.com%2Fblog%2Fazure-sql-data-warehouse-is-now-azure-synapse-analytics%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3Elaunch%20at%20Microsoft%20Ignite%3C%2FA%3E.%20Onboarding%20and%20managing%20your%20streaming%20workloads%20for%20SQL%20analytics%20has%20never%20been%20easier.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EPreviously%20setting%20up%20and%20managing%20streaming%20workloads%20was%20a%20complex%20and%20cumbersome%20process%20for%20Azure%20Synapse.%20Users%20have%20to%20setup%20and%20configure%20separate%20services%20such%20as%20Azure%20Stream%20Analytics%20and%20Databricks%20where%20each%20service%20has%20their%20own%20billing%20and%20security%20models%20including%20separate%20provisioning%20experiences.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EWith%20the%20latest%20streaming%20capabilities%2C%20you%20can%20now%20seamlessly%20onboard%20and%20manage%20streaming%20workloads%20where%3A%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EThe%20-ERR%3AREF-NOT-FOUND-COPY%20command%20is%20now%20leveraged%20under%20the%20covers%20for%20high-throughput%20data%20ingestion%20directly%20to%20compute%20nodes%3C%2FLI%3E%0A%3CLI%3EUsers%20no%20longer%20require%20CONTROL%20permissions%20on%20their%20database%20set%20up%20their%20streaming%20jobs%20-%20only%20ADMINISTER%20DATABASE%20BULK%20OPERATIONS%20and%20INSERT%20permissions%20on%20the%20specified%20table%20is%20required%3C%2FLI%3E%0A%3CLI%3EProvisioning%20and%20managing%20streaming%20jobs%20can%20be%20done%20directly%20in%20the%20portal%20of%20Azure%20Synapse%20without%20opening%20multiple%20portal%20blades%2C%20notebooks%2C%20and%20editors%3C%2FLI%3E%0A%3CLI%3EAutomatic%20schema%20detection%20on%20the%20streaming%20input%20source%20enables%20a%20simple%20and%20code%20free%20set-up%20process%20including%20automatic%20table%20creation%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3EStay%20tuned%20for%20additional%20streaming%20capabilities%20and%20enhancements%20to%20our%20user%20experience!%20Help%20us%20by%20joining%20our%20preview%20and%20signing%20up%20directly%20in%20the%20Azure%20Synapse%20portal%3A%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-center%22%20image-alt%3D%22clipboard_image_0.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F163914i7822757EFFAA0C99%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20title%3D%22clipboard_image_0.png%22%20alt%3D%22clipboard_image_0.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-1092676%22%20slang%3D%22en-US%22%3E%3CP%3ENative%20streaming%20capabilities%20for%20ingestion%20and%20near%20real-time%20analytics%20with%20Azure%20Synapse%20Analytics.%20Sign%20up%20for%20the%20preview%20today!%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-center%22%20image-alt%3D%22clipboard_image_0.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F163915i48A3F8449F27785B%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20title%3D%22clipboard_image_0.png%22%20alt%3D%22clipboard_image_0.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1092676%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3ESynapse%20SQL%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Version history
Last update:
‎Jun 30 2020 09:19 PM
Updated by: