ADX 1-click now supports mapping transformations

Published Nov 18 2020 06:47 AM 1,568 Views

Data format mappings (for example, Parquet, JSON, and Avro) in Azure Data Explorer now support simple and useful ingest-time transformations. In cases where the scenario requires more complex processing at ingest time, use the update policy, which will allow you to define lightweight processing using KQL expression. 

In addition, as part of a 1-click experience, you now have the ability to select data transformation logic from a supported list to add to one or more columns. 

To learn more, read about mapping transformations

1 Comment
Occasional Visitor

Hi @Tzvia Gitlin Troyna,

 

Is it possible to add a substring transformation on W3CLOGFILE in the mapping rather than creating an update policy?

 

Thanks,

Pavan

%3CLINGO-SUB%20id%3D%22lingo-sub-1900950%22%20slang%3D%22en-US%22%3EADX%201-click%20now%20supports%20mapping%20transformations%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1900950%22%20slang%3D%22en-US%22%3E%3CP%3EData%20format%20mappings%20(for%20example%2C%20Parquet%2C%20JSON%2C%20and%20Avro)%20in%20Azure%20Data%20Explorer%20now%20support%20simple%20and%20useful%20ingest-time%20transformations.%20In%20cases%20where%20the%20scenario%20requires%20more%20complex%20processing%20at%20ingest%20time%2C%20use%20the%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fdata-explorer%2Fkusto%2Fmanagement%2Fupdate-policy%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%20data-event%3D%22page-clicked-link%22%20data-bi-id%3D%22page-clicked-link%22%20data-bi-an%3D%22body%22%20data-bi-tn%3D%22undefined%22%3Eupdate%20policy%3C%2FA%3E%2C%20which%20will%20allow%20you%20to%20define%20lightweight%20processing%20using%20KQL%20expression.%26nbsp%3B%3C%2FP%3E%0A%3CP%3EIn%20addition%2C%20as%20part%20of%20a%201-click%20experience%2C%20you%20now%20have%20the%20ability%20to%20select%20data%20transformation%20logic%20from%20a%20supported%20list%20to%20add%20to%20one%20or%20more%20columns.%26nbsp%3B%3C%2FP%3E%0A%3CP%3ETo%20learn%20more%2C%20read%20about%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fdata-explorer%2Fkusto%2Fmanagement%2Fmappings%23mapping-transformations%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%20data-event%3D%22page-clicked-link%22%20data-bi-id%3D%22page-clicked-link%22%20data-bi-an%3D%22body%22%20data-bi-tn%3D%22undefined%22%3Emapping%20transformations%3C%2FA%3E.%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-1900950%22%20slang%3D%22en-US%22%3E%3CH1%20id%3D%22toc-hId-609526992%22%3EAzure%20Data%20Explorer%201-click%20now%20supports%20mapping%20transformations%3C%2FH1%3E%3C%2FLINGO-TEASER%3E
Version history
Last update:
‎Dec 01 2020 12:24 AM
Updated by: