Forum Discussion
REST API and Pagination
So, I'm having some issues getting all the data from a Rest API into Azure Data Factory. Currently I have everything setup correctly the mapping the source etc. The REST API returns only 100 result...
Use an "Until" activity and a "Lookup", the "Copy" activity & "Set Variable" within it to achieve your goal.
The variable will be initially defined as @{string('')} and the output of the "endCursor" response should to set to it in each iteration of the Until activity, till no records fetched. Hope it helps.
The variable will be initially defined as @{string('')} and the output of the "endCursor" response should to set to it in each iteration of the Until activity, till no records fetched. Hope it helps.