Forum Discussion
Does Azure Log Analytics has provision to load data from Azure Data Bricks
yuraje Azure log analytics can import data using a custom field format. If you've stored logs within DataBricks, you first need to export them to .txt files and then ingest them with Log Analytics.
Export your data from DataBricks as .txt files. First do a sample locally, then to Azure storage.
Then follow the steps in this article to import the logs. https://docs.microsoft.com/en-us/azure/azure-monitor/platform/data-sources-custom-logs#defining-a-custom-log
cberon & ibnmbodji - Thank you for your response.
My goal is to push the data from Azure DataBricks (basically its a application data on which I want to perform some analysis to identify anomaly or threat) into LogAnalytics.
I achieved it using below method.
I have created a dataframe in ADB with the required dataset and converted into JSON format using inbuild py function. Using POST API method I'm able to push this dataframe into LogAnalytics. Previously I have created a signature with Workspace ID and Key for authentication.