Home
%3CLINGO-SUB%20id%3D%22lingo-sub-974679%22%20slang%3D%22en-US%22%3EADF%20Adds%20Avro%20and%20CosmosDB%20Data%20Flow%20Connectors%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-974679%22%20slang%3D%22en-US%22%3E%3CP%3E%3C%2FP%3E%3CDIV%20class%3D%22video-embed-center%20video-embed%22%3E%3CIFRAME%20class%3D%22embedly-embed%22%20src%3D%22https%3A%2F%2Fcdn.embedly.com%2Fwidgets%2Fmedia.html%3Furl%3Dhttps%253A%252F%252Fwww.youtube.com%252Fwatch%253Fv%253Dplp1etT2ftY%26amp%3Bsrc%3Dhttps%253A%252F%252Fwww.youtube.com%252Fembed%252Fplp1etT2ftY%253Ffeature%253Doembed%26amp%3Btype%3Dtext%252Fhtml%26amp%3Bkey%3Db0d40caa4f094c68be7c29880b16f56e%26amp%3Bschema%3Dyoutube%22%20width%3D%22373%22%20height%3D%22210%22%20scrolling%3D%22no%22%20frameborder%3D%220%22%20allow%3D%22autoplay%3B%20fullscreen%22%20allowfullscreen%3D%22true%22%20title%3D%22Video%22%3E%3C%2FIFRAME%3E%3C%2FDIV%3E%3CP%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20506px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F153872i6714ED9551DCCF18%2Fimage-dimensions%2F506x187%3Fv%3D1.0%22%20width%3D%22506%22%20height%3D%22187%22%20alt%3D%22cosmos1.png%22%20title%3D%22cosmos1.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3ECosmosDB%20and%20Avro%20formats%20are%20now%20available%20natively%20in%20Data%20Factory's%20Data%20Flows.%20Use%20Mapping%20Data%20Flows%20with%20your%20hierarchies%2C%20arrays%2C%20and%20other%20complex%20data%20types%20to%20generate%20and%20execute%20data%20transformation%20at%20scale.%20Full%20transformation%20capabilities%20are%20supported%3A%20aggregations%2C%20pivots%2C%20joins%2C%20calculate%20columns%2C%20etc.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20748px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F153914iF826737E5577856B%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20alt%3D%22cosmos3.png%22%20title%3D%22cosmos3.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3EDynamically%20scale%20your%20ETL%20process%20with%20throughput%20read%20and%20write%20options.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20647px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F153915iAD6DB540828628E1%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20alt%3D%22cosmos2.png%22%20title%3D%22cosmos2.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%20CosmosDB%20also%20includes%20dynamic%20throughput%20scale-up%20during%20ETL%20processes.%20Avro%2C%20JSON%2C%20and%20CosmosDB%20support%26nbsp%3B%3C%2FSPAN%3Ehierarchies%20and%20complex%20data%20types%20that%20you%20can%20build%20from%20the%20ADF%20Data%20Flow%20browser%20UI.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThen%2C%20you%20can%20mash%20that%20data%20up%20with%20other%20lake%20and%20database%20sources%20in%20Data%20Flows%20in%20ADF%20that%20leverage%20joins%2C%20aggregations%2C%20window%20analytics%2C%20and%20other%20transformations.%20Full%20support%20for%20upserts%20%26amp%3B%20deletes%20in%20CosmosDB%20is%20also%20supported.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-974679%22%20slang%3D%22en-US%22%3E%3CP%3EAzure%20Data%20Factory%20now%20supports%20Avro%20format%20and%20CosmosDB%20natively%20in%20Mapping%20Data%20Flows%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-974679%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAzure%20Data%20Factory%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EMapping%20Data%20Flows%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Microsoft

 

cosmos1.png

CosmosDB and Avro formats are now available natively in Data Factory's Data Flows. Use Mapping Data Flows with your hierarchies, arrays, and other complex data types to generate and execute data transformation at scale. Full transformation capabilities are supported: aggregations, pivots, joins, calculate columns, etc.

 

cosmos3.png

Dynamically scale your ETL process with throughput read and write options.

 

cosmos2.png

CosmosDB also includes dynamic throughput scale-up during ETL processes. Avro, JSON, and CosmosDB support hierarchies and complex data types that you can build from the ADF Data Flow browser UI.

 

Then, you can mash that data up with other lake and database sources in Data Flows in ADF that leverage joins, aggregations, window analytics, and other transformations. Full support for upserts & deletes in CosmosDB is also supported.