Continuous integration and deployment using Data Factory

https://azure.microsoft.com/en-us/services/data-factory/ (ADF) visual tools public preview was https://azure.microsoft.com/en-us/blog/adf-v2-visual-tools-enabled-in-public-preview/ on Jan 16, 2018. With visual tools, you can iteratively build, debug, deploy, operationalize and monitor your big data pipelines. Now, you can follow industry leading best practices to do continuous integration and deployment for your ETL/ELT (extract, transform/load, load/transform) workflows to multiple environments (Dev, Test, PROD etc.). Essentially, you can incorporate the practice of testing for your codebase changes and push the tested changes to a Test or Prod environment automatically.

 

ADF visual interface now allows you to export any data factory as an https://docs.microsoft.com/en-us/azure/azure-resource-manager/resource-group-authoring-templates (Azure Resource Manager) template. You can click the ‘Export ARM template’ to export the template corresponding to a factory.

 

 

Read more about it in the https://azure.microsoft.com/en-us/blog/continuous-integration-and-deployment-using-data-factory/.