Forum Discussion

Polonez1's avatar
Polonez1
Copper Contributor
Jun 03, 2024

I can't delete the source in dataflow

After adding a new datasource to dataflow, I couldn't delete it later. Nothing happened after trying to delete. After I published, I saw that my data flow had disconnected in the "incoming stream". I found it via 'search' and linked back, but I still couldn't delete the new source, although I could delete other sources.

Source is the same like a lots of other sources. If I select "Prieview data" in the dataset, I see the data and everything is OK. In dataflow, I see columns from new source that I can combine and make a select, but I cannot delete new source. Every time I publish after making other changes, my dataflow "breaks" and in the end it allowed me to publish but did not save any transform stages. only source and sink remained.

Theoretically, Azur will not allow you to publish dataflow if there is no source and sink connected, but it did.

 

Where and how should I look for the problem? Has anyone encountered such a bug?

As you can see, the flow is already published (i.e. saved as you can see, which is impossible for Azure to allow you to publish without a connection)

Yellow Color - There is no indication that it is being edited, so it is Published.

Green color - Source which I cannot delete
Blue color - Sink that is not connected to anything.

Between them all the steps were gone.



 

 

  • Polonez1 Kindly It's refresh your session and re-run the flow to ensure the successful completion of all processes and to maintain the integrity of your data.


    Then, consider using a delete activity to remove old files based on their last modified step.
    You can also delete the rows based on specific conditions by setting up the appropriate rule in the "Alter Row" transformation.

     

    See ShaikMaheer-MSFT  solution on deleting Mapping Data Flows.
    and the Troubleshoot mapping data flows in Azure Data Factory (ADF)

     

    Let me know if this works for you. @ me in replies, or I'll lose your thread!!!  
    Note:
    If this post is helpful, please mark it as the solution to help others find it easily. Also, if my answers contribute to a solution, show your appreciation by giving it a thumbs up
    • Polonez1's avatar
      Polonez1
      Copper Contributor

      BabatundeDallas 

      There is nothing to refresh because there are no more stages left, only source and sink. I'm wondering how Azure can allow such a thing to be published when the source and sink are not connected? More precisely, publish was with all steps and correct validation, but nothing remained after opening because there was a source that could not be deleted, although no error was when publishing dataflow. 

Resources