Recent Blog ArticlesNewest TopicsMost LikesTagged:TagApache Kafka Cluster - TLS encryption on HDInsight Process of setting up Transport Layer Security (TLS) encryption for Apache Kafka Cluster on Azure HDInsight for Brokers and Zookeepers. HDInsight 5.0 with Spark 3.x – Part 2 Author(s): Arun Sethia is a Program Manager in Azure HDInsight Customer Success Engineering (CSE) team. Introduction This blog is part of Spark 3.x series of blogs; the blog is dedicated towards ...HDInsight 5.0 with Spark 3.x – Part 1 Maximizing business benefits using HDI 5.0 Spark 3, performance, and many more improvements will reduce your TCO and increase your ROI. Azure Synapse Spark Notebook – Unit Testing In this blog post, we will cover how to test and create unit test cases for Spark jobs developed using Synapse Notebook. HDInsight - Iceberg Open-Source Table Format Author(s): Arun Sethia is a Program Manager in Azure HDInsight Customer Success Engineering (CSE) team. Introduction In my previous blog, we talked about leveraging Delta Lake on Azure HDInsi...Delta Lake on HDInsight Introduction Azure HDInsight is a managed, full-spectrum, open-source analytics service in the cloud for enterprises. HDInsight Apache Spark cluster is parallel processing framework that supports i...Synapse - Choosing Between Spark Notebook vs Spark Job Definition This blog post covers multiple developments and deployment methods for Spark applications and considerations for choosing one over the other with Azure Synapse Spark Pool.