Realize Lakehouse using best of breed of Open source using HDInsight
Published Oct 10 2023 09:12 AM 2,429 Views
Microsoft

Author: Reems Thomas Kottackal, Product Manager

 

HDInsight on AKS is a modern, reliable, secure, and fully managed Platform as a Service (PaaS) that runs on Azure Kubernetes Service (AKS). HDInsight on AKS allows an enterprise to deploy popular open-source analytics workloads like Apache Spark, Apache Flink, and Trino without the overhead of managing and monitoring containers.

 

You can build end-to-end, petabyte-scale Big Data applications spanning event storage using HDInsight Kafka, streaming through Apache Flink, data engineering and machine learning using Apache Spark, and Trino's powerful query engine. In combination with Azure analytics services like Azure data factory, Azure event hubs, Power BI, Azure Data Lake Storage.


HDInsight on AKS can connect seamlessly with HDInsight. You can reap the benefits of using needed cluster types in a hybrid model. Interoperate with cluster types of HDInsight using the same storage and meta store across both the offerings.

The following diagram depicts an example of end-end analytics landscape realized through HDInsight workloads.

 

sairamyeturi_0-1696952393320.png

 

 

We are super excited to get you started, lets get to how?

 

Version history
Last update:
‎Nov 26 2023 07:02 PM
Updated by: