How to use values from Data Source as parameter to other Data Source

%3CLINGO-SUB%20id%3D%22lingo-sub-822435%22%20slang%3D%22en-US%22%3EHow%20to%20use%20values%20from%20Data%20Source%20as%20parameter%20to%20other%20Data%20Source%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-822435%22%20slang%3D%22en-US%22%3E%3CP%3EI%20have%20two%20linked%20services%3A%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E1.%20A%20SQL%20database%3C%2FP%3E%3CP%3E2.%20A%20Rest%20API.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI'm%20retrieving%20data%20from%20SQL%20to%20my%20Staging%20area%20incrementally.%20This%20is%20no%20problem.%20However%2C%20for%20retrieving%20information%20from%20the%20Rest%20API%20I%20need%20values%20from%20the%20records%20I%20just%20moved%20to%20the%20staging%20area.%26nbsp%3B%20So%20let's%20say%20I%20get%20product%20data%20from%20SQL%20and%20the%20Rest%20API%20gives%20me%20additional%20info%20for%20these%20products%20from%20an%20external%20system.%20So%20I%20need%20to%20call%20the%20Rest%20API%20multiple%20times%20with%20as%20parameter%20each%20of%20the%20product%20ID's%20I've%20just%20imported.%3C%2FP%3E%3CP%3EWhat%20is%20the%20most%20efficient%20way%20to%20this%20in%20ADF%3F.%20So%20in%20the%20way%20ADF%20was%20intended%20to%20be%20used.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThanks%20for%20any%20tips.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-822435%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAzure%20Data%20Factory%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EData%20Warehouse%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Highlighted
New Contributor

I have two linked services:

 

1. A SQL database

2. A Rest API.

 

I'm retrieving data from SQL to my Staging area incrementally. This is no problem. However, for retrieving information from the Rest API I need values from the records I just moved to the staging area.  So let's say I get product data from SQL and the Rest API gives me additional info for these products from an external system. So I need to call the Rest API multiple times with as parameter each of the product ID's I've just imported.

What is the most efficient way to this in ADF?. So in the way ADF was intended to be used.

 

Thanks for any tips.

0 Replies