Azure Data Factory CICD, Removing deleted data pipeline and handling of rename of data pipeline

%3CLINGO-SUB%20id%3D%22lingo-sub-2037540%22%20slang%3D%22en-US%22%3EAzure%20Data%20Factory%20CICD%2C%20Removing%20deleted%20data%20pipeline%20and%20handling%20of%20rename%20of%20data%20pipeline%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2037540%22%20slang%3D%22en-US%22%3E%3CP%3EHi%2C%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20have%20implemented%20CICD%20in%20Azure%20Data%20Factory%20using%20Azure%20DevOps.%3C%2FP%3E%3CP%3EI%20am%20using%20incremental%20mode%20for%20deploying%20to%20higher%20environment.%20When%20I%20use%20this%20setting%20then%20whenever%20I%20delete%20a%20pipeline%2Frename%20a%20pipeline%20the%20changes%20are%20not%20reflected%20in%20the%20higher%20environment.%26nbsp%3B%3C%2FP%3E%3CP%3EI%20do%20not%20know%20what%20will%20be%20the%20impact%20if%20I%20change%20the%20mode%20to%20complete%20deployment%20as%20my%20scope%20in%20cicd%20setting%20is%20resources%20group%20level.%20Will%20it%20delete%20other%20resources%20like%20keyvault%20or%20storage%20account%20if%20I%20use%20complete%20deployment%20mode%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EDo%20any%20one%20has%20any%20solution%20of%20how%20can%20we%20automate%20this%3F%20I%20have%20also%20resource%20lock%20on%20the%20higher%20environment%20on%20data%20factory.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2037540%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAzure%20Data%20Factory%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Visitor

Hi,

 

I have implemented CICD in Azure Data Factory using Azure DevOps.

I am using incremental mode for deploying to higher environment. When I use this setting then whenever I delete a pipeline/rename a pipeline the changes are not reflected in the higher environment. 

I do not know what will be the impact if I change the mode to complete deployment as my scope in cicd setting is resources group level. Will it delete other resources like keyvault or storage account if I use complete deployment mode?

 

Do any one has any solution of how can we automate this? I have also resource lock on the higher environment on data factory.

1 Reply

@Harsh_Soni - Not sure if you got the answer to your question, but I've implemented the same using Craig Porteous's excellent instructions. CI/CD For Azure Data Factory With Azure DevOps - Craig Porteous

It works perfectly for what you're looking for if you have one development ADF for all projects/pipelines.