Jul 31 2021
05:56 AM
- last edited on
Apr 08 2022
10:52 AM
by
TechCommunityAP
Jul 31 2021
05:56 AM
- last edited on
Apr 08 2022
10:52 AM
by
TechCommunityAP
Good morning people.
I'm using the concept of Cross Workspace query to query in more than one space because it's an MSSP environment.
The point is that the "union" command consumes a lot of processing, since it joins all the data from the tables that are in the union and then apply the filters.
Do you know any way or resource/method that I can make Cross Workspace queries that don't consume as much processing?
Thank you!
Aug 26 2021 07:49 AM
Aug 26 2021 02:38 PM
Aug 26 2021 04:13 PM
Hi,
Have you noticed that workspace("<WorkspaceID>").TableName can be used in many commands, for example, JOIN too. But maybe you don't have a key to do the JOIN on. Else JOIN rather than UNIONS is recommended. Also to filter the data as much as possible prior to JOIN and project-away any unnecessary columns. Also, have the data in as few regions as possible.
Have you read about FIND at this page union operator - Azure Data Explorer | Microsoft Docs
I did a couple of small tests in my lab and I can see an improvement using FIND instead of UNION.