Forum Discussion

Sheeraz27's avatar
Sheeraz27
Copper Contributor
Apr 18, 2024

ADF Pipeline Data flow issue

I've created a data flow where the source is ADLS and the sink is an ADLS delta file. I attempted to run the data flow, but I encountered the following issue

 

Job failed due to reason: com.microsoft.dataflow.Issues: DF-EXPR-200 - Function 'outputs' applies to only sink transformation with right saveOrder - [418 464 564 737],[207 319 418 464 564 737],EXE-0001,
surrogateKey1 derive(
) ~> derivedColumn1,Dataflow cannot be analyzed as a graph,[62 207 319 418 464 564 737]
DF-EXPR-200 - Function 'outputs' applies to only sink transformation with right saveOrder - [418 464 564 737],EXE-0001,
surrogateKey1 derive(
) ~> derivedColumn1,Dataflow cannot be analyzed as a graph,[209 319 418 464 564 737]

1 Reply

  • Probably related to sink transformation and saveOrder setting, try to locate and fix at the following:

     

    1. Verify Sink Transformation Settings
      • Ensure that the sink transformation is correctly configured with the appropriate saveOrder setting.
      • If you're using a Delta file, check that the sink supports the required ordering.
    2. Check Derived Column Dependencies
      • The error suggests that the derived column transformation might be causing issues with the data flow graph.
      • Try simplifying the derived column expressions or reordering transformations.
    3. Validate Data Flow Graph Structure
      • The error message indicates that the data flow cannot be analyzed as a graph.
      • Ensure that all transformations are properly linked and that there are no circular dependencies.

Resources