Is it a good practice to execute data export command in scheduled data pipeline job?

[28928]

Hi, 

Noticed Kusto supports data exporting to blob storage, as below document describes:

Data export - Azure Data Explorer | Microsoft Docs

I tried to setup a scheduled Lens job to export data to a blob storage every 10 minutes. The job runs pretty well and stable, we're considering to make this job as part of our regular data pipeline.

I'm not sure if the export command is supposed to be used in automatic jobs like this, or if there is a good practice to execute this command in a product data pipeline. May want to check with Kusto experts here.

Thank you!

[#2]

Hi Dave (@28928),

Did you check out the continuous export functionality? 

Looks like it does what you are looking for. If not, it would be great to understand what is missing. 

Thanks

Uri