Azure Data Factory - Translation via config in Data Flow

%3CLINGO-SUB%20id%3D%22lingo-sub-1775905%22%20slang%3D%22en-US%22%3EAzure%20Data%20Factory%20-%20Translation%20via%20config%20in%20Data%20Flow%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1775905%22%20slang%3D%22en-US%22%3E%3CP%3EAzure%20Data%20Factory%20-%20Is%20there%20a%20way%20to%20pass%20in%20an%20expression%20via%20parameter%20to%20a%20Data%20Flow%20such%20that%20it%20could%20be%20used%20in%20a%20Derive%20activity%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThe%20purpose%20would%20to%20leverage%20a%20Lookup%20activity%20to%20pull%20the%20expression%20from%20a%20config%20file%20or%20database%20so%20you%20could%20more%20easily%20customize%20the%20output%20without%20requiring%20a%20custom%20Data%20Flow%20for%20each%20of%20the%20desired%20custom%20outputs.%20We%20have%20a%20standard%20set%20of%20%22flows%22%20which%20output%20a%20canonical%20structure.%20However%2C%20we%20are%20intending%20to%20offer%20the%20ability%20to%20include%20a%20custom%20set%20of%20data%20for%20each%20source.%20Instead%20of%20maintaining%20%22n%22%20number%20of%20Data%20Flow%20instances%20per%20source%2C%20I%20would%20like%20to%20use%20the%20standard%20Data%20Flow%20and%20pass%20in%20the%20custom%20expression.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1775905%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EData%20Factory%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Occasional Contributor

Azure Data Factory - Is there a way to pass in an expression via parameter to a Data Flow such that it could be used in a Derive activity?

 

The purpose would to leverage a Lookup activity to pull the expression from a config file or database so you could more easily customize the output without requiring a custom Data Flow for each of the desired custom outputs. We have a standard set of "flows" which output a canonical structure. However, we are intending to offer the ability to include a custom set of data for each source. Instead of maintaining "n" number of Data Flow instances per source, I would like to use the standard Data Flow and pass in the custom expression.

0 Replies