3 New Data Transformation Functions in ADF

Published Jul 26 2022 10:18 AM 1,539 Views
Microsoft

Azure Data Factory and Azure Synapse Analytics Mapping Data Flows provides powerful, easy-to-use, data transformation at cloud scale. We've recently introduced 3 new data transformation functions to our rich data flow expression language: collectUnique(), substringIndex(), and topN().

 

  • collectUnique()
    • Create a new collection of values into an array. ADF will automatically dedupe elements in the array for you.
  • substringIndex()
    • Extracts the substring before n ccurrences of the delimiter.
  • topN()
    • ADF will sort your data based on the column or expression that you provide and then return the top n results.

Find the documentation for all ADF data flow transformation functions at this link here.

Co-Authors
Version history
Last update:
‎Jul 26 2022 10:26 AM
Updated by: