Azure Data Factory and Azure Synapse Analytics Mapping Data Flows provides powerful, easy-to-use, data transformation at cloud scale. We've recently introduced 3 new data transformation functions to our rich data flow expression language: collectUnique(), substringIndex(), and topN().
- collectUnique()
- Create a new collection of values into an array. ADF will automatically dedupe elements in the array for you.
- substringIndex()
- Extracts the substring before n ccurrences of the delimiter.
- topN()
- ADF will sort your data based on the column or expression that you provide and then return the top n results.
Find the documentation for all ADF data flow transformation functions at this link here.
