List Activities and Connections used in Azure Data Factory Pipelines

%3CLINGO-SUB%20id%3D%22lingo-sub-1228384%22%20slang%3D%22en-US%22%3EList%20Activities%20and%20Connections%20used%20in%20Azure%20Data%20Factory%20Pipelines%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1228384%22%20slang%3D%22en-US%22%3E%3CP%3EHello%20experts%2C%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3ECan%20someone%20please%20assist%20in%20listing%26nbsp%3BActivities%20and%20Connections%20used%20in%20Azure%20Data%20Factory%20Pipelines.%3C%2FP%3E%3CP%3EIts%20more%20of%20a%20lineage%20graph%20I%20am%20looking%20for%2C%20like%20if%20I%20check%20a%20connection%20I%20should%20be%20able%20to%20find%20out%20which%20pipelines%20are%20using%20this%20connection.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EAny%20links%20to%20metadata%20information%20which%20can%20be%20read%20in%20someway%20using%20Powershell%20if%20not%20out%20of%20the%20box%20solution%20would%20be%20of%20great%20help.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThanks%3C%2FP%3E%3CP%3ESid%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1304193%22%20slang%3D%22en-US%22%3ERe%3A%20List%20Activities%20and%20Connections%20used%20in%20Azure%20Data%20Factory%20Pipelines%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1304193%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F386653%22%20target%3D%22_blank%22%3E%40SidzOne9%3C%2FA%3E%26nbsp%3BYou%20can%20use%20the%20search%20box%20at%20the%20top%20of%20the%20Azure%20Data%20Factory%20(ADF)%20designer%20to%20search%20for%20the%20linked%20service%20name%2C%20and%20it%20will%20show%20you%20all%20of%20the%20objects%20that%20reference%20that%20linked%20service.%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20also%20use%20the%20Git%20repo%20integration%20in%20my%20Dev%20data%20factory%2C%20and%20clone%20that%20Git%20repo%20to%20my%20local%20PC%20file%20system.%20Then%20you%20can%20use%20the%20file%20search%20tool%20of%20your%20search%20to%20find%20in%20the%20contents%20of%20file.%26nbsp%3B%20My%20favorite%20search%20tool%20is%20FileLocator%20Pro%20(%3CA%20href%3D%22https%3A%2F%2Fwww.mythicsoft.com%2F%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fwww.mythicsoft.com%2F%3C%2FA%3E).%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EYou%20can%20also%20use%20the%20following%20PowerShell%20commands%20in%20the%20Az%20PowerShell%20module%20to%20retrieve%20the%20pipelines%20(Get-AzDataFactoryPipeline)%20and%20datasets%20(Get-AzDataFactoryDataset)%20from%20your%20ADF%20resource%20in%20Azure%2C%20but%20I%20think%20that%20might%20be%20overkill%20for%20what%20you're%20trying%20to%20do.%20Try%20searching%20with%20the%20search%20box%20and%20go%20from%20there.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EPowerShell%20Az.DataFactory%20-%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fpowershell%2Fmodule%2FAz.DataFactory%2F%3Fview%3Dazps-3.7.0%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3Ehttps%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fpowershell%2Fmodule%2FAz.DataFactory%2F%3Fview%3Dazps-3.7.0%3C%2FA%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E
Occasional Contributor

Hello experts,

 

Can someone please assist in listing Activities and Connections used in Azure Data Factory Pipelines.

Its more of a lineage graph I am looking for, like if I check a connection I should be able to find out which pipelines are using this connection.

 

Any links to metadata information which can be read in someway using Powershell if not out of the box solution would be of great help.

 

Thanks

Sid

1 Reply

@SidzOne9 You can use the search box at the top of the Azure Data Factory (ADF) designer to search for the linked service name, and it will show you all of the objects that reference that linked service. 

 

I also use the Git repo integration in my Dev data factory, and clone that Git repo to my local PC file system. Then you can use the file search tool of your search to find in the contents of file.  My favorite search tool is FileLocator Pro (https://www.mythicsoft.com/). 

 

You can also use the following PowerShell commands in the Az PowerShell module to retrieve the pipelines (Get-AzDataFactoryPipeline) and datasets (Get-AzDataFactoryDataset) from your ADF resource in Azure, but I think that might be overkill for what you're trying to do. Try searching with the search box and go from there.

 

PowerShell Az.DataFactory - https://docs.microsoft.com/en-us/powershell/module/Az.DataFactory/?view=azps-3.7.0