3 New Data Transformation Functions in ADF

Azure Data Factory and Azure Synapse Analytics Mapping Data Flows provides powerful, easy-to-use, data transformation at cloud scale. We've recently introduced 3 new data transformation functions to our rich data flow expression language: collectUnique(), substringIndex(), and topN().

• collectUnique()
  • Create a new collection of values into an array. ADF will automatically dedupe elements in the array for you.
• substringIndex()
  • Extracts the substring before n ccurrences of the delimiter.
• topN()
  • ADF will sort your data based on the column or expression that you provide and then return the top n results.

Find the documentation for all ADF data flow transformation functions at this link here.