Forum Discussion

SushantBindra's avatar
SushantBindra
Copper Contributor
Dec 14, 2020
Solved

Data Lineage Not Showing despite creating ADF connection

Hi! I've been experimenting with the recently launched Azure Purview service. I followed the steps mentioned in the https://docs.microsoft.com/en-gb/azure/purview/how-to-link-azure-data-factory for ...
  • DanielPerlovsky's avatar
    DanielPerlovsky
    Dec 14, 2020

    SushantBindra When you register a Data Factory instance, you will only see the lineage of pipelines that run after the connection occurs. Also ensure that your catalog has registered the source/sink as scans.

     

    What ADF activity are you not able to see and what are the sources/sinks?

     

DanielPerlovsky's avatar
DanielPerlovsky
Iron Contributor
Dec 14, 2020

SushantBindra When you register a Data Factory instance, you will only see the lineage of pipelines that run after the connection occurs. Also ensure that your catalog has registered the source/sink as scans.

 

What ADF activity are you not able to see and what are the sources/sinks?

 

  • SushantBindra's avatar
    SushantBindra
    Copper Contributor
    Dec 15, 2020

    Hey DanielPerlovsky!

    Thanks a lot! The data lineage for the datasets became visible after I ran the ADF pipeline. ADF also showed up in the assets section.

    To summarize (for future help-seekers on the same issue): After creating the ADF connection in the Management Center, re-run that ADF pipeline. Until you re-run the ADF pipelines, data lineage will not be visible.

    Once again, thanks DanielPerlovsky for the quick response!

    • BalajiL's avatar
      BalajiL
      Copper Contributor
      Oct 28, 2023
      Still I am encountering the issue. The pipeline executed successfully but did not see the lineage.
      I can see lineage only for few pipelines and not all.

Resources