Forum Discussion

N-SPEC's avatar
N-SPEC
Copper Contributor
Aug 07, 2023

Integrate Jenkins with Azure Databricks & GitHub into VSCode

Hello Team,

Greetings of the Day!!!

 

Hope you have a great day ahead!!!
We have installed extension of Azure Databricks, GitHub & Jenkins in VSCode.
Now the configuration parts come into the picture, so we have configured Azure Databricks & Logged in GitHub in VSCode. Now Turn comes of Jenkins.

 

We want to know that how can we configure Jenkins with GitHub. All Notebooks from Azure Databricks will be version controlled in GitHub for doing that we want to use Jenkins. There is no documentation to do so. Can you guide us how to do it.

Reference Link :- https://learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/ci-cd-jenkins

 

Thank You in advance for any Support or Suggestion : )

Looking forward for your valuable input.

 

Regards,
Niral Dave.

1 Reply

  • Yes, you can integrate Jenkins with Azure Databricks and GitHub in VSCode by using the Databricks CLI and Jenkins Pipelines to automate build, test, and deployment of notebooks stored in GitHub. 

     

    Configure Git integration for Git folders - Azure Databricks | Azure Docs

     

    Example on Groovy snippet

    pipeline {
      agent any
      stages {
        stage('Checkout') {
          steps {
            git 'https://github.com/your-org/databricks-notebooks.git'
          }
        }
        stage('Build') {
          steps {
            sh 'pip install --upgrade wheel'
            sh 'python setup.py bdist_wheel'
          }
        }
        stage('Deploy') {
          steps {
            sh 'databricks workspace import_dir notebooks /Shared/notebooks'
          }
        }
        stage('Test') {
          steps {
            sh 'pytest tests/'
          }
        }
      }
    }