Forum Discussion
ADF Pipeline Data flow issue
I've created a data flow where the source is ADLS and the sink is an ADLS delta file. I attempted to run the data flow, but I encountered the following issue
Job failed due to reason: com.microsoft.dataflow.Issues: DF-EXPR-200 - Function 'outputs' applies to only sink transformation with right saveOrder - [418 464 564 737],[207 319 418 464 564 737],EXE-0001,
surrogateKey1 derive(
) ~> derivedColumn1,Dataflow cannot be analyzed as a graph,[62 207 319 418 464 564 737]
DF-EXPR-200 - Function 'outputs' applies to only sink transformation with right saveOrder - [418 464 564 737],EXE-0001,
surrogateKey1 derive(
) ~> derivedColumn1,Dataflow cannot be analyzed as a graph,[209 319 418 464 564 737]
1 Reply
Probably related to sink transformation and saveOrder setting, try to locate and fix at the following:
- Verify Sink Transformation Settings
- Ensure that the sink transformation is correctly configured with the appropriate saveOrder setting.
- If you're using a Delta file, check that the sink supports the required ordering.
- Check Derived Column Dependencies
- The error suggests that the derived column transformation might be causing issues with the data flow graph.
- Try simplifying the derived column expressions or reordering transformations.
- Validate Data Flow Graph Structure
- The error message indicates that the data flow cannot be analyzed as a graph.
- Ensure that all transformations are properly linked and that there are no circular dependencies.