Automating the Publishing of Workspace Artifacts in Synapse CICD
New features have been recently introduced in Synapse Workspace Deployment task V2 to facilitate CICD automation in Synapse. These features will give users the ability to do one touch deployments. Before introducing these features, users had to manually hit the “Publish” button from the Synapse Studio, to persist their changes in Synapse Service (Live Mode) and generate the ARM templates for deployment in the publish branch. This was a showstopper for a fully automated CICD lifecycle. With the introduction of these new features, users will no longer require the manual intervention from the UI, thus allowing a fully automated CICD in Synapse. Adding to this, these features to validate as well as generate the ARM templates for deployment using any user branch.The Data Lakehouse, the Data Warehouse and a Modern Data platform architecture
There are two contradictory themes about how to build a modern data platform being proposed to data architects today. This article discusses why is there such a big disparity between two approaches, how we make sense of these competing patterns and why the modern data warehouse architecture provides a flexible and pragmatic approach.CICD Automation in Synapse Analytics: taking advantage of custom parameters in Workspace Templates
When using automated CI/CD in Azure Synapse Analytics, users can take advantage of custom parameters to extend the capabilities of the default Workspace template, allowing the exposure and the overriding of any artifact property that is not parameterized by default. This article will walk you through the necessary steps to create and benefit from using custom template parameters in your Synapse CICD processes.
How Azure Synapse Analytics helps you analyze COVID data with Synapse SQL serverless endpoint
In this article you will see how you can Azure Synapse Analytics solution help you to analyze the number of COVID cases using T-SQL language. The data set is placed on Azure storage and formatted as parquet.Create a Data Solution on Azure Synapse Analytics with Snapshot Serengeti - Part 1
This will be the first article in a four-part series on building an end-to-end data analytics and machine learning solution on azure synapse analytics. By the end of this series, you will have learned how to transform and analyze the data, and use it to train a classification machine learning model capable of classifying camera trap images into one of the 48 species in the dataset.Convert plain parquet files to Delta Lake format using Apache Spark in Azure Synapse Analytics
Apache Spark in Azure Synapse Analytics service enables you to easily convert your parquet folders to Delta Lake format that enables you to update and delete the records in the file sets. Here you will see how easily you can use Synapse Studio and Apache Spark to generate Delta Lake format file structure.
