Forum Discussion
mikhailf
Jul 25, 2024Iron Contributor
Export data from Log Analytics Workspace to Storage Account
Hello community, Could you please recommend a solution to migrate data from Log Analytics Workspace (1 table) to Storage Account? There are about 70 million rows that should be exported. The cont...
Matthias-Braun
Jul 26, 2024Brass Contributor
Hi mikhailf,
Have you ever thought about exporting with Azure Data Factory (ADF)?
Azure Data Factory is designed for large-scale data movement and transformation. It's well-suited for extracting data from Log Analytics and loading it into a Storage Account.
Step-by-Step Example with Azure Data Factory
Create Azure Data Factory:
- Go to the Azure portal and create a new Data Factory instance.
Create Linked Services:
- For Log Analytics Workspace:
- In the Data Factory, go to Manage -> Linked Services -> New.
- Choose Azure Log Analytics and provide the necessary credentials.
- For Storage Account:
- Again, create a new linked service for the Azure Storage Account.
- For Log Analytics Workspace:
Create a Pipeline:
- Go to Author -> Pipelines -> New pipeline.
- Add a Copy Data activity.
- In the Source, select the Log Analytics linked service and configure the query to select the desired table.
- In the Sink, select the Storage Account linked service and configure the target dataset (e.g., CSV or Parquet).
Run the Pipeline:
- Trigger the pipeline manually or schedule it to run at a convenient time.
- Monitor the pipeline execution to ensure all data is transferred.
Please give me feedback or if you need help.
Regards
Matthias