Forum Discussion
mergene
Aug 08, 2020Brass Contributor
Cross Workspace Analytic Rule Performance
Hi, I have several workspaces containing SecurityEvent table having data. When I perform a union on the workspaces and then do the filtering, calculation, etc., the query consumes too much resour...
- Aug 09, 2020
first, search should not be more performant than union, so the difference may be elsewhere.
As to your question: I can't think of a way to avoid repeating the query, however, I can make it simpler:
let Filter = (T:(EventID:int))
{
T | where EventID == 4624
};
union (workspace("a").SecurityEvent | invoke Filter()),(workspace("b").SecurityEvent | invoke Filter())While for a single condition it might not be much shorter, it is still more elegant, and will become much shorter if you have more conditions.
Ofer_Shezaf
Microsoft
Aug 09, 2020
first, search should not be more performant than union, so the difference may be elsewhere.
As to your question: I can't think of a way to avoid repeating the query, however, I can make it simpler:
let Filter = (T:(EventID:int))
{
T | where EventID == 4624
};
union (workspace("a").SecurityEvent | invoke Filter()),(workspace("b").SecurityEvent | invoke Filter())
While for a single condition it might not be much shorter, it is still more elegant, and will become much shorter if you have more conditions.
mergene
Aug 09, 2020Brass Contributor
Ofer_Shezaf I've asked the difference between "search in" and "union" in one of the MTP webinar and I was told that "search in" was more efficient (not the "search" itself).
Thanks for the suggestion. Is it possible to create complex filters having where, extend, summarize, and other operators with the method you suggested? Where can I find documentation about this?
- Ofer_ShezafAug 09, 2020
Microsoft
"search in" vs. "union": if you search in a small subset of tables and do "union *", then you might be faster. In general, search (and search in) is much slower: it usually implies "contains" across all fields which is the most expensive query. With union you can use any operator and more directly limit to fields.
Well, you can do search in (SecurityAlert, SecurityEvent) _ResourceId:"127.0.0.1", but then it would be exactly like a simlar union.
As to my example: do whatever you like in the function. Just remember to declare any field from the source table you will reference.
- mergeneAug 09, 2020Brass ContributorThanks Ofer! Creating a function and doint an iteration looks very useful.