REST source and sink now available for data flows
Published Jul 30 2021 01:31 PM 13.3K Views
Microsoft

Data flows in Azure Data Factory and Azure Synapse Analytics now support REST endpoints as both a source and sink with full support for both JSON and XML payloads.

 

You can now connect to REST endpoints natively in ADF & Synapse data flows as a way to transform and process data inline with the code-free design experience. 

 

rest1.png

 

You can use the built-in ETL feature of ADF, Synapse pipelines, and data flows to perform CRUD operations on your REST sink via the Alter Row transformation for inserts, updates, upserts, and deletes.

 

rest2.png

 

https://docs.microsoft.com/en-us/azure/data-factory/connector-rest 

4 Comments
Copper Contributor

I'm trying to use the REST connector as a Source in some Data Flows with no success. All attempts to import a schema never complete within our Synapse Workspace - we just get an indefinite spinner.  The endpoints we're using are the same endpoints we've had success with when using the HTTP connector from within the same workspace.  Is this a known issue? Any suggestions?

Copper Contributor

Is there an example with Pagination, Im only able to retrieve first page, pagination rules not working.

Copper Contributor

Is there a video or blog on how to pass connection credentials to connect the Rest API as data source from ADF?

Copper Contributor

Is there any way to get the response of post API while using at sink in dataflow? Also pass the same to main pipeline activities?

Co-Authors
Version history
Last update:
‎Jul 30 2021 01:31 PM
Updated by: