The best practices for organizing Synapse workspaces and lakehouses
While designing the Lakehouse solution, you should carefully organize your databases and tables based on the underlying folder structure. In this article, you will find some best practices and recommendations that can help you to organize your lakehouses if you are using Synapse Analytics workspace to implement them.
Synapse – Data Lake vs. Delta Lake vs. Data Lakehouse
As a data engineer, we often hear terms like Data Lake, Delta Lake, and Data Lakehouse, which we might be confusing at times. In this blog we’ll demystify these terms and talk about the differences of each of the technologies and concepts, along with scenarios of usage for each.
Data mesh: A perspective on using Azure Synapse Analytics to build data products
This is a multi-part blog series, and it discusses various aspects of implementing data mesh architecture on Azure. This part focuses on data as a product principle and presents a perspective on using Azure Synapse Analytics as a data product. We discuss (at a high-level) data product functions & capabilities and apply that lens to Synapse Analytics. We discuss how workspaces can be partitioned to give domains scale and agility to build data products.Optimize database schema in serverless SQL pools using QPI library
Query Performance Insight (QPI) is an open-source library that helps you to discover the potential issues in your database scheme and improvements that can help you improve performance or your queries. In this post, you will see how to use QPI library to find the recommendations that can help you to improve the performance of your queries.The Data Lakehouse, the Data Warehouse and a Modern Data platform architecture
There are two contradictory themes about how to build a modern data platform being proposed to data architects today. This article discusses why is there such a big disparity between two approaches, how we make sense of these competing patterns and why the modern data warehouse architecture provides a flexible and pragmatic approach.Azure Synapse analytics (dedicated SQL pool) data modelling best practices
In this article, I will discuss how to physically model an Azure Synapse Analytics data warehouse while migrating from an existing on-premises MPP (Massive Parallel Processing) data warehouse solution like Teradata and Netezza.
