SOLVED

Capturing data transformation

%3CLINGO-SUB%20id%3D%22lingo-sub-2118702%22%20slang%3D%22en-US%22%3ECapturing%20data%20transformation%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2118702%22%20slang%3D%22en-US%22%3E%3CP%3EAre%20there%20plans%20to%20capture%20data%20transformation%20in%20addition%20to%20lineage%3F%20i.e.%20not%20just%20movement%20of%20data%20but%20what%20transformation%20has%20been%20applied%20such%20as%20aggregation%20or%20truncation%3F%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2121238%22%20slang%3D%22en-US%22%3ERE%3A%20Capturing%20data%20transformation%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2121238%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F869147%22%20target%3D%22_blank%22%3E%40ChandruS%3C%2FA%3E%26nbsp%3B%20yes%20-%20all%20dataflow%20transformation%2C%20stored%20procedures%20and%20databricks%20(Scala%2C%20R%2C%20SQL).%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2119337%22%20slang%3D%22en-US%22%3ERE%3A%20Capturing%20data%20transformation%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2119337%22%20slang%3D%22en-US%22%3EYes%2C%20it%20is%20in%20the%20roadmap.%20Is%20there%20a%20particular%20data%20service%20you%20are%20looking%20to%20provide%20data%20transformation%3F%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2125514%22%20slang%3D%22en-US%22%3ERE%3A%20Capturing%20data%20transformation%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2125514%22%20slang%3D%22en-US%22%3EAll%20of%20the%20above%20are%20in%20the%20roadmap.%20We%20are%20currently%20working%20on%20ADF%20dataflow%20and%20stored%20proc.%20Others%20to%20follow%20subsequently.%3C%2FLINGO-BODY%3E
Contributor

Are there plans to capture data transformation in addition to lineage? i.e. not just movement of data but what transformation has been applied such as aggregation or truncation?

3 Replies
Yes, it is in the roadmap. Is there a particular data service you are looking to provide data transformation?

@ChandruS  yes - all dataflow transformation, stored procedures and databricks (Scala, R, SQL).

Best Response confirmed by DebbieH (Contributor)
Solution
All of the above are in the roadmap. We are currently working on ADF dataflow and stored proc. Others to follow subsequently.