Forum Discussion
Integrate Jenkins with Azure Databricks & GitHub into VSCode
Greetings of the Day!!!
Hope you have a great day ahead!!!
We have installed extension of Azure Databricks, GitHub & Jenkins in VSCode.
Now the configuration parts come into the picture, so we have configured Azure Databricks & Logged in GitHub in VSCode. Now Turn comes of Jenkins.
We want to know that how can we configure Jenkins with GitHub. All Notebooks from Azure Databricks will be version controlled in GitHub for doing that we want to use Jenkins. There is no documentation to do so. Can you guide us how to do it.
Reference Link :- https://learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/ci-cd-jenkins
Thank You in advance for any Support or Suggestion : )
Looking forward for your valuable input.
Regards,
Niral Dave.
1 Reply
Yes, you can integrate Jenkins with Azure Databricks and GitHub in VSCode by using the Databricks CLI and Jenkins Pipelines to automate build, test, and deployment of notebooks stored in GitHub.
Configure Git integration for Git folders - Azure Databricks | Azure Docs
Example on Groovy snippet
pipeline { agent any stages { stage('Checkout') { steps { git 'https://github.com/your-org/databricks-notebooks.git' } } stage('Build') { steps { sh 'pip install --upgrade wheel' sh 'python setup.py bdist_wheel' } } stage('Deploy') { steps { sh 'databricks workspace import_dir notebooks /Shared/notebooks' } } stage('Test') { steps { sh 'pytest tests/' } } } }