Azure Data Factory (ADF) is a cloud-based data integration service that allows you to perform a combination of activities on the data. Use ADF to create data-driven workflows for orchestrating and automating data movement and data transformation. The Azure Data Explorer Command activity in Azure Data Factory enables you to run Azure Data Explorer control commands within an ADF workflow. This article teaches you how to create a pipeline with a lookup activity and ForEach activity containing an Azure Data Explorer command activity.
Control commands are requests to Kusto to process and potentially modify data or metadata. For example, the following control command creates a new Kusto table with two columns, Level and Text:
.create table Logs (Level:string, Text:string)
The command activity has the following limits:
- Size limit: 1 MB response size
- Time limit: 20 minutes (default), 1 hour (maximum).
- If needed, you can append a query to the result using AdminThenQuery, to reduce resulting size/time.
For more information regarding how to use ADX command read: Use Azure Data Factory to run Azure Data Explorer Command
Learn more about Azure Data Explorer (Kusto):
- Azure Data Explorer
- Documentation
- Course – Basics of KQL
- Query explorer
- Azure Portal
- User Voice
- Cost Estimator
- ADX End to End Lab
Join us to share questions, thoughts, or ideas about Azure Data Explorer (Kusto) and receive answers from the diverse and knowledgeable Azure Data Explorer community.
Azure Data Explorer product team
“Join the conversation on the Azure Data Explorer community”.