Forum Discussion
Bremanand
Dec 18, 2023Copper Contributor
Expensive Query execution need for Customer report
Hello - We are using Azure sql and cloud services. I have the use case where customer should extract the report where yearly data will be included. This is to be dealt with a couple of sql tables whe...
- Dec 20, 2023Hello
if you don't want to have an impact on users. Have you consider creating a SSRS subscription to create the report at night when less or no users are hitting the Azure SQL DB ?
Another possibility is to use Data Virtualization in Azure SQL DB (which is currently in Private Preview https://www.youtube.com/watch?v=oYXCknUvdLA ) with this you can export your table/query to ADSL2 in csv or parquet format
Data Virtualization is Available in SQL Server 2022 and Azure SQL Managed Instance
Regards
Javier
Dec 20, 2023
Hello
if you don't want to have an impact on users. Have you consider creating a SSRS subscription to create the report at night when less or no users are hitting the Azure SQL DB ?
Another possibility is to use Data Virtualization in Azure SQL DB (which is currently in Private Preview https://www.youtube.com/watch?v=oYXCknUvdLA ) with this you can export your table/query to ADSL2 in csv or parquet format
Data Virtualization is Available in SQL Server 2022 and Azure SQL Managed Instance
Regards
Javier
if you don't want to have an impact on users. Have you consider creating a SSRS subscription to create the report at night when less or no users are hitting the Azure SQL DB ?
Another possibility is to use Data Virtualization in Azure SQL DB (which is currently in Private Preview https://www.youtube.com/watch?v=oYXCknUvdLA ) with this you can export your table/query to ADSL2 in csv or parquet format
Data Virtualization is Available in SQL Server 2022 and Azure SQL Managed Instance
Regards
Javier
Bremanand
Dec 20, 2023Copper Contributor
Hi - I do have this mind on running such expensive queries during off business hours. Thanks for the suggestion.
I will explore more on sql data virtualization concept. Hope, it will help to answer my below queries when I learn this more.
1. How virtaul table on external data store can be set up? like azure datalake or storage accounts.
2. How it maintains the concurrency of real data which needs to be reflected in external storage account ?
3. Will it add any performance problem when DML operation happens on real sql tables as it got extra job to sync to external storage accounts.
I will explore more on sql data virtualization concept. Hope, it will help to answer my below queries when I learn this more.
1. How virtaul table on external data store can be set up? like azure datalake or storage accounts.
2. How it maintains the concurrency of real data which needs to be reflected in external storage account ?
3. Will it add any performance problem when DML operation happens on real sql tables as it got extra job to sync to external storage accounts.