Connecting with Azure DataBricks Directly by DataSet

%3CLINGO-SUB%20id%3D%22lingo-sub-1341103%22%20slang%3D%22en-US%22%3EConnecting%20with%20Azure%20DataBricks%20Directly%20by%20DataSet%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1341103%22%20slang%3D%22en-US%22%3E%3CP%3EIt's%20quite%20familiar%20to%20connect%20from%20azure%20data%20factory%20to%20azure%20databricks%20by%20creating%20databricks%20linked%20service.%3C%2FP%3E%3CP%3EBut%20to%20fetch%20any%20data%20from%20any%20databricks%20table%20its%20needed%20to%20call%20some%20script%20and%20get%20data%20indirectly%20into%20data%20factory.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EBut%20instead%20of%20that%20We%20can%20Create%20Spark%20link%20Service%2C%20and%20create%20a%20Data%20Factory%20dataset%20which%20can%20be%20used%20within%20data%20flow%20and%20pipeline%20too.%3C%2FP%3E%3CP%3EBelow%20is%20the%20screen%20shot%20how%20to%20get%20databricks%20connectivity%20details.%3C%2FP%3E%3CP%3ECluster-%26gt%3Bconfig-%26gt%3Badvanced-%26gt%3Bjdbc%2Fodbc%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22the_coder_krish_0-1588007439229.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F186917i65256E585B2705FA%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20title%3D%22the_coder_krish_0-1588007439229.png%22%20alt%3D%22the_coder_krish_0-1588007439229.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3ENow%20above%20details%20will%20be%20useful%20to%20create%20spark%20link%20service%20in%20data%20factory.%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22the_coder_krish_1-1588007624154.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F186918iCC6719013888501F%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20title%3D%22the_coder_krish_1-1588007624154.png%22%20alt%3D%22the_coder_krish_1-1588007624154.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3EBelow%20document%20is%20the%20simba%20jdbc%2Fodbc%20driver%20connection%20string%20details.%3C%2FP%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fwww.simba.com%2Fproducts%2FSpark%2Fdoc%2FJDBC_InstallGuide%2Fcontent%2Fjdbc%2Fsp%2Fusing%2Fconnectionurl.htm%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fwww.simba.com%2Fproducts%2FSpark%2Fdoc%2FJDBC_InstallGuide%2Fcontent%2Fjdbc%2Fsp%2Fusing%2Fconnectionurl.htm%3C%2FA%3E%3C%2FP%3E%3CP%3Ethis%20will%20help%20to%20understand%20things%20in%20details.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EHope%20this%20helps.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Occasional Visitor

It's quite familiar to connect from azure data factory to azure databricks by creating databricks linked service.

But to fetch any data from any databricks table its needed to call some script and get data indirectly into data factory.

 

But instead of that We can Create Spark link Service, and create a Data Factory dataset which can be used within data flow and pipeline too.

Below is the screen shot how to get databricks connectivity details.

Cluster->config->advanced->jdbc/odbc

 

the_coder_krish_0-1588007439229.png

 

Now above details will be useful to create spark link service in data factory.

the_coder_krish_1-1588007624154.png

Below document is the simba jdbc/odbc driver connection string details.

https://www.simba.com/products/Spark/doc/JDBC_InstallGuide/content/jdbc/sp/using/connectionurl.htm

this will help to understand things in details.

 

Hope this helps.

 

 

 

 

 

 

 

 

 

0 Replies