Matillion, a leading enterprise cloud data integration platform, announced the general availability of Matillion ETL for Delta Lake on Azure Databricks, a cloud data transformation product that enables data professionals across the business to aggregate and share data in a single environment for improved cross-functional decision-making. Through the powerful, scalable combination of Matillion ETL and Databricks, Azure customers can access insights from large, dynamic datasets in a unified environment, empowering data teams to take full advantage of the end-to-end data platform.
“Enterprises want to give data to every employee but struggle to make it useful for each person in the organization. Matillion ETL for Delta Lake on Databricks makes it easier for enterprises to make their data useful, taking the pain out of manual data ingestion and transformation tasks to enable faster time to insights,” said Matthew Scullion, CEO of Matillion.
Working in conjunction with Azure Data Factory, Matillion ETL for Delta Lake gives Azure Databricks users the ability to easily load data from numerous data sources into Delta Lake without needing to hand code pipelines. Using Matillion ETL’s graphical user interface, data professionals of all technical abilities can then transform data quickly and easily for data science and machine learning, leveraging the power and scalability of Delta Engine, a vectorized query engine to exploit data optimization for modern structured and semi-structured workloads. Because Matillion ETL for Delta Lake has been purpose-built, it seamlessly integrates with the Azure platform. Matillion specifically harnesses the power of the Delta Lake and the Delta Engine via platform-specific pushdown instruction sets, providing maximum pipeline performance.