Recent Blog ArticlesNewest TopicsMost LikesTagged:TagTransforming Your Data Lake: Implementing Slow Change Dimension with Synapse In this blog post we will address the following scenario: a customer wants to implement Slow Change Dimension type 2 on top of their data lake. Essential tips for exporting and cleaning data with Spark I am creating this post to assist you in developing your solution on top of the data lake by sharing some useful tips. I will be using pandas for most of the examples, and I hope they will be as help...Securing your Synapse environment Security has many layers and frequently it will determine how you build your process. I start this post by reviewing several important security considerations which you can later apply to your...MSSparkUtils is the Swiss Army knife inside Synapse Spark One of those questions was how to share results between notebooks. Every time a notebook starts a new Spark cluster will also start which means they would be using different sessions makin...Synapse Spark Delta Time Travel Use Travel time to recover a point in time change in the Delta file inside of Synapse. Understand Synapse Spark basic configuration The goal of this post is to enlighten you about the Apache Spark options available inside Synapse and how it works the basic setup. Azure VNET vs Azure IR inside of Pipelines In this blog, Liliam Leme explains why Azure Data Factory inside of the Managed VNET is slower than the one created on Azure IR. Understand Synapse dedicated SQL pool (formerly SQL DW) and Serverless SQL pool What is the difference between Synapse dedicated SQL pool (formerly SQL DW) and Serverless SQL pool? Which one should you choose for your business? This post explains the basic concepts of SQL...How to use CETAS on serverless SQL pool to improve performance and automatically recreate it Serverless SQL pool has a very cool way to handle CREATE EXTERNAL TABLE AS SELECT (CETAS). I mean, you can use a serverless SQL pool to create a CETAS which will materialize the query results. It me...Monitoring Synapse serverless SQL open connections This post has the goal to provide information on how to monitor sessions from any application to serverless SQL.
MicrosoftMicrosoftMicrosoftMicrosoft
