What's New: Improved Analytics Preview Graph in Public Preview !

Published Jan 05 2021 11:15 PM 4,707 Views
Microsoft

RT banner.png

Rule tuning for SIEM solutions is a delicate and continuous process of balancing between detecting threats and reducing alert noise. The more accurate and less noisy the rules are, the better the detections will be. To support this goal within Azure Sentinel, we are delighted to announce improvements to the “Preview Graph” feature now in public preview.

The Preview Graph runs a simulation against the last 50 evaluations of a scheduled analytic rule and outputs a graph indicating the average number of alerts that the rule generated based on the raw event data evaluated. This data can then help you tune your Azure Sentinel scheduled rules by predicting the average number of alerts the rule is expected to generate.

How to use the feature

To try out this feature, navigate to the Analytics blade in the Azure Sentinel Overview page and select an existing analytic rule.

Once you define the KQL query behind your rule you are now ready to get a preview of the results. To do so, click on the arrow next to “Test with current data”.

analytic rule wizard.png

 

Upon evaluation of the last 50 runs of the analytic rule a graph similar to the one below will appear, giving you an indication of the level of alerts to expect if you were to use the evaluated configuration of the rule. On the Y-axis you have the number of events generated while on the X-axis you have the period of time within which the last 50 evaluations of the rule occurred. The “Threshold” value is obtained from the “Set rule logic” section of Analytic rule wizard and it is used to specify the number of query results needed to trigger an alert while the “Alerts per day” denotes the average number of alerts generated across the time period indicated on the x-axis for the last 50 evaluations of the rule.

 

test with curr data.png

To visualize the raw events at a specific point in time on the graph, hover over a particular data point and the graph will adjust to show you what the number of events was at that particular point in time and upon clicking on the point the Log Analytics query window will open and show you the actual events at that specific point :

 

test with curr data2.png

 

 

 

Get started today!

We encourage you to use the new Preview Graph to improve the accuracy of your analytic rules and reduce alert noise.

 

Try it out, and let us know what you think!

 

You can also contribute new connectors, workbooks, analytics and more in Azure Sentinel. Get started now by joining the Azure Sentinel Threat Hunters GitHub community.

 

@Jeremy Tan  @Ron Marsiano thanks for your input and review comments

 

 

1 Comment
%3CLINGO-SUB%20id%3D%22lingo-sub-2035130%22%20slang%3D%22en-US%22%3EWhat's%20New%3A%20Improved%20Analytics%20Preview%20Graph%20in%20Public%20Preview%20!%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2035130%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22RT%20banner.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F244687i426BE79BFE099849%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22RT%20banner.png%22%20alt%3D%22RT%20banner.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3ERule%20tuning%20for%20SIEM%20solutions%20is%20a%20delicate%20and%20continuous%20process%20of%20balancing%20between%20detecting%20threats%20and%20reducing%20alert%20noise.%20The%20more%20accurate%20and%20less%20noisy%20the%20rules%20are%2C%20the%20better%20the%20detections%20will%20be.%20To%20support%20this%20goal%20within%20Azure%20Sentinel%2C%20we%20are%20delighted%20to%20announce%20improvements%20to%20the%20%E2%80%9CPreview%20Graph%E2%80%9D%20feature%20now%20in%20public%20preview.%3C%2FP%3E%0A%3CP%3EThe%20Preview%20Graph%20runs%20a%20simulation%20against%20the%20last%2050%20evaluations%20of%20a%20scheduled%20analytic%20rule%20and%20outputs%20a%20graph%20indicating%20the%20average%20number%20of%20alerts%20that%20the%20rule%20generated%20based%20on%20the%20raw%20event%20data%20evaluated.%20This%20data%20can%20then%20help%20you%20tune%20your%20Azure%20Sentinel%20scheduled%20rules%20by%20predicting%20the%20average%20number%20of%20alerts%20the%20rule%20is%20expected%20to%20generate.%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3EHow%20to%20use%20the%20feature%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3ETo%20try%20out%20this%20feature%2C%20navigate%20to%20the%20Analytics%20blade%20in%20the%20Azure%20Sentinel%20Overview%20page%20and%20select%20an%20existing%20analytic%20rule.%3C%2FP%3E%0A%3CP%3EOnce%20you%20define%20the%20KQL%20query%20behind%20your%20rule%20you%20are%20now%20ready%20to%20get%20a%20preview%20of%20the%20results.%20To%20do%20so%2C%20click%20on%20the%20arrow%20next%20to%20%E2%80%9C%3CSTRONG%3ETest%20with%20current%20data%3C%2FSTRONG%3E%E2%80%9D.%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22analytic%20rule%20wizard.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F244463i133427DF95420848%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22analytic%20rule%20wizard.png%22%20alt%3D%22analytic%20rule%20wizard.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CDIV%20id%3D%22tinyMceEditorInnocent%20Wafula_0%22%20class%3D%22mceNonEditable%20lia-copypaste-placeholder%22%3E%26nbsp%3B%3C%2FDIV%3E%0A%3CP%3EUpon%20evaluation%20of%20the%20last%2050%20runs%20of%20the%20analytic%20rule%20a%20graph%20similar%20to%20the%20one%20below%20will%20appear%2C%20giving%20you%20an%20indication%20of%20the%20level%20of%20alerts%20to%20expect%20if%20you%20were%20to%20use%20the%20evaluated%20configuration%20of%20the%20rule.%20On%20the%20Y-axis%20you%20have%20the%20number%20of%20events%20generated%20while%20on%20the%20X-axis%20you%20have%20the%20period%20of%20time%20within%20which%20the%20last%2050%20evaluations%20of%20the%20rule%20occurred.%20The%20%E2%80%9C%3CSTRONG%3EThreshold%3C%2FSTRONG%3E%E2%80%9D%20value%20is%20obtained%20from%20the%20%E2%80%9C%3CSTRONG%3ESet%20rule%20logic%3C%2FSTRONG%3E%E2%80%9D%20section%20of%20Analytic%20rule%20wizard%20and%20it%20is%20used%20to%20specify%20the%20number%20of%20query%20results%20needed%20to%20trigger%20an%20alert%20while%20the%20%E2%80%9C%3CSTRONG%3EAlerts%20per%20day%3C%2FSTRONG%3E%E2%80%9D%20denotes%20the%20average%20number%20of%20alerts%20generated%20across%20the%20time%20period%20indicated%20on%20the%20x-axis%20for%20the%20last%2050%20evaluations%20of%20the%20rule.%3C%2FP%3E%0A%3CDIV%20id%3D%22tinyMceEditorInnocent%20Wafula_1%22%20class%3D%22mceNonEditable%20lia-copypaste-placeholder%22%3E%26nbsp%3B%3C%2FDIV%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22test%20with%20curr%20data.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F244484i4BF7B53A53A03569%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22test%20with%20curr%20data.png%22%20alt%3D%22test%20with%20curr%20data.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3ETo%20visualize%20the%20raw%20events%20at%20a%20specific%20point%20in%20time%20on%20the%20graph%2C%20hover%20over%20a%20particular%20data%20point%20and%20the%20graph%20will%20adjust%20to%20show%20you%20what%20the%20number%20of%20events%20was%20at%20that%20particular%20point%20in%20time%20and%20upon%20clicking%20on%20the%20point%20the%20Log%20Analytics%20query%20window%20will%20open%20and%20show%20you%20the%20actual%20events%20at%20that%20specific%20point%20%3A%3C%2FP%3E%0A%3CDIV%20id%3D%22tinyMceEditorInnocent%20Wafula_2%22%20class%3D%22mceNonEditable%20lia-copypaste-placeholder%22%3E%26nbsp%3B%3C%2FDIV%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-left%22%20image-alt%3D%22test%20with%20curr%20data2.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F244483i32C8A28CA7739290%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22test%20with%20curr%20data2.png%22%20alt%3D%22test%20with%20curr%20data2.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3EGet%20started%20today!%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3EWe%20encourage%20you%20to%20use%20the%20new%20Preview%20Graph%20to%20improve%20the%20accuracy%20of%20your%20analytic%20rules%20and%20reduce%20alert%20noise.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3ETry%20it%20out%2C%20and%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fazure-sentinel%2Fbd-p%2FAzureSentinel%22%20target%3D%22_blank%22%3E%26nbsp%3Blet%20us%20know%3C%2FA%3E%26nbsp%3Bwhat%20you%20think!%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EYou%20can%20also%20contribute%20new%20connectors%2C%20workbooks%2C%20analytics%20and%20more%20in%20Azure%20Sentinel.%20Get%20started%20now%20by%20joining%20the%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Faka.ms%2Fthreathunters%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EAzure%20Sentinel%20Threat%20Hunters%20GitHub%20community%3C%2FA%3E.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F215052%22%20target%3D%22_blank%22%3E%40Jeremy%20Tan%3C%2FA%3E%26nbsp%3B%26nbsp%3B%40Ron%20Marsiano%20thanks%20for%20your%20input%20and%20review%20comments%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-2035130%22%20slang%3D%22en-US%22%3E%3CP%3ERule%20tuning%20for%20SIEM%20solutions%20is%20a%20delicate%20and%20continuous%20process%20of%20balancing%20between%20detecting%20threats%20and%20reducing%20alert%20noise.%20The%20more%20accurate%20and%20less%20noisy%20the%20rules%20are%2C%20the%20better%20the%20detections.%20To%20support%20this%20goal%2C%20we%20are%20delighted%20to%20announce%20improvements%20to%20the%20%E2%80%9CPreview%20Graph%E2%80%9D%20feature%20now%20in%20public%20preview.%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22RT%20banner.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F244689i66A2603D49149D8A%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22RT%20banner.png%22%20alt%3D%22RT%20banner.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2035130%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EWhat's%20new%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2100178%22%20slang%3D%22en-US%22%3ERe%3A%20What's%20New%3A%20Improved%20Analytics%20Preview%20Graph%20in%20Public%20Preview%20!%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2100178%22%20slang%3D%22en-US%22%3E%3CP%3EVery%20helpful%20the%20new%20feature.%3C%2FP%3E%3C%2FLINGO-BODY%3E
Version history
Last update:
‎Jan 16 2021 11:11 AM
Updated by: