Blog Post

Azure Data Factory Blog
1 MIN READ

REST source and sink now available for data flows

Mark Kromer's avatar
Mark Kromer
Icon for Microsoft rankMicrosoft
Jul 30, 2021

Data flows in Azure Data Factory and Azure Synapse Analytics now support REST endpoints as both a source and sink with full support for both JSON and XML payloads.

 

You can now connect to REST endpoints natively in ADF & Synapse data flows as a way to transform and process data inline with the code-free design experience. 

 

 

You can use the built-in ETL feature of ADF, Synapse pipelines, and data flows to perform CRUD operations on your REST sink via the Alter Row transformation for inserts, updates, upserts, and deletes.

 

 

https://docs.microsoft.com/en-us/azure/data-factory/connector-rest 

Updated Jul 30, 2021
Version 1.0

4 Comments

  • ArjunRajendran's avatar
    ArjunRajendran
    Copper Contributor

    Is there any way to get the response of post API while using at sink in dataflow? Also pass the same to main pipeline activities?

  • Karthikshanth's avatar
    Karthikshanth
    Copper Contributor

    Is there a video or blog on how to pass connection credentials to connect the Rest API as data source from ADF?

  • IvanCl's avatar
    IvanCl
    Copper Contributor

    Is there an example with Pagination, Im only able to retrieve first page, pagination rules not working.

  • BobbyRich's avatar
    BobbyRich
    Copper Contributor

    I'm trying to use the REST connector as a Source in some Data Flows with no success. All attempts to import a schema never complete within our Synapse Workspace - we just get an indefinite spinner.  The endpoints we're using are the same endpoints we've had success with when using the HTTP connector from within the same workspace.  Is this a known issue? Any suggestions?