Blog Post

Azure Synapse Analytics Blog
9 MIN READ

Apache Spark in Azure Synapse - Performance Update

euanga's avatar
euanga
Icon for Microsoft rankMicrosoft
Mar 30, 2021
Recently, Azure Synapse Analytics has made significant investments in the overall performance for Apache Spark workloads. As Azure Synapse brings the worlds of data warehousing, big data, and data in...
Updated Sep 15, 2021
Version 2.0
Synapse Spark
analyticalguy's avatar
analyticalguy
Copper Contributor
Apr 29, 2021

euanga Thanks for sharing a detailed explanation. I was hoping to find Lakehouse's performance evaluation and best practices when using Synapse SQL pools vs Synapse Spark 2.4.x vs Databricks Spark 3.1. The earlier Spark Summit presentations show native Spark binaries are not optimal(hence open for contributions) and with the industry trend/migration towards PaaS, I was hoping to know more about how Azure big data PaaS offerings compare to each other.