Blog Post

Azure Data Factory Blog
1 MIN READ

ADF Adds Avro and CosmosDB Data Flow Connectors

Mark Kromer's avatar
Mark Kromer
Icon for Microsoft rankMicrosoft
Nov 01, 2019

 

CosmosDB and Avro formats are now available natively in Data Factory's Data Flows. Use Mapping Data Flows with your hierarchies, arrays, and other complex data types to generate and execute data transformation at scale. Full transformation capabilities are supported: aggregations, pivots, joins, calculate columns, etc.

 

Dynamically scale your ETL process with throughput read and write options.

 

CosmosDB also includes dynamic throughput scale-up during ETL processes. Avro, JSON, and CosmosDB support hierarchies and complex data types that you can build from the ADF Data Flow browser UI.

 

Then, you can mash that data up with other lake and database sources in Data Flows in ADF that leverage joins, aggregations, window analytics, and other transformations. Full support for upserts & deletes in CosmosDB is also supported.

Updated Nov 01, 2019
Version 1.0
  • Sarju's avatar
    Sarju
    Copper Contributor

    Hi Mark, can you please provide some example of building dynamic query for cosmos read in data flow expression builder. I have a need where timestamp value comes from run time and need to build cosmos query to filter records.

     

     

    Thanks,

     

    Sarju