What's new: Azure Sentinel Information Model DNS Schema and normalized content now public

Published Jun 15 2021 11:51 AM 5,704 Views
Microsoft

I’m excited to announce the second step in our normalization journey. Following our networking schema, we now extend our Azure Sentinel Information Model (ASIM) guidance and release our DNS schema. We expect to follow suit with additional schemas in the coming weeks.

 

Special thanks to Yaron Fruchtmann and Batami Gold, who made all this possible.

 

This release includes additional artifacts to ensure easier use of ASIM:

 

 

  • All the normalizing parsers can be deployed in a click using an ARM template. The initial release contains normalizing parsers for Infoblox, Cisco Umbrella, and Microsoft DNS server.

 

  • We have migrated analytic rules that worked on a single DNS source to use the normalized template. Those are available in GitHub and will be available in the in product gallery in the coming days. You can find the list at the end of this post.

 

 

With a single click deployment and support for normalized content in analytic rules, we believe we will see an accelerated adaption of the Azure Sentinel Information Model.

 

Join us to learn more about Azure Sentinel information model in two webinars:

  • The Information Model: Understanding Normalization in Azure Sentinel
  • Deep Dive into Azure Sentinel Normalizing Parsers and Normalized Content

 

Why normalization, and what is the Azure Sentinel Information Model?


Working with various data types and tables together presents a challenge. You must become familiar with many different data types and schemas, write and use a unique set of analytics rules, workbooks, and hunting queries for each, even for those that share commonalities (for example, DNS servers). Correlation between the different data types necessary for investigation and hunting is also tricky.


The Azure Sentinel Information Model (ASIM) provides a seamless experience for handling various sources in uniform, normalized views. ASIM aligns with the Open-Source Security Events Metadata (OSSEM) common information model, promoting vendor agnostic, industry-wide normalization. ASIM:

 

  • Allows source agnostic content and solutions
  • Simplifies analyst use of the data in sentinel workspaces

 

The current implementation is based on query time normalization using KQL functions. And includes the following:

 

  • Normalized schemas cover standard sets of predictable event types that are easy to work with and build unified capabilities. The schema defines which fields should represent an event, a normalized column naming convention, and a standard format for the field values.
  • Parsers map existing data to the normalized schemas. Parsers are implemented using KQL functions.
  • Content for each normalized schema includes analytics rules, workbooks, hunting queries, and additional content. This content works on any normalized data without the need to create source-specific content.

POWERPNT_kovE7KHr8z.png

 

Why normalize DNS data?

 

ASIM is especially useful for DNS. Different DNS servers and DNS security solutions such as Infoblox, Cisco Umbrella & Microsoft DNS server provide highly non-standard logs, representing similar information, namely the DNS protocol. Using normalization, standard, source agnostic content can apply to all DNS servers without customizing it to each DNS server. In addition, an analyst investigating an incident can query the DNS data in the system without specific knowledge of the source providing it.

 

Analytic Rules added or updated to work with ASim DNS

  • Added:
    • Excessive NXDOMAIN DNS Queries (Normalized DNS)
    • DNS events related to mining pools (Normalized DNS)
    • DNS events related to ToR proxies (Normalized DNS)
  • Updated to include normalized DNS:
    • Known Barium domains
    • Known Barium IP addresses
    • Exchange Server Vulnerabilities Disclosed March 2021 IoC Match
    • Known GALLIUM domains and hashes
    • Known IRIDIUM IP
    • NOBELIUM - Domain and IP IOCs - March 2021
    • Known Phosphorus group domains/IP
    • Known STRONTIUM group domains - July 2019
    • Solorigate Network Beacon
    • THALLIUM domains included in DCU takedown
    • Known ZINC Comebacker and Klackring malware hashes
%3CLINGO-SUB%20id%3D%22lingo-sub-2429926%22%20slang%3D%22en-US%22%3EWhat's%20new%3A%20Azure%20Sentinel%20Information%20Model%20DNS%20Schema%20and%20normalized%20content%20now%20public%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2429926%22%20slang%3D%22en-US%22%3E%3CP%3EI%E2%80%99m%20excited%20to%20announce%20the%20second%20step%20in%20our%20normalization%20journey.%20Following%20our%20networking%20schema%2C%20we%20now%20extend%20our%20%3CA%20href%3D%22https%3A%2F%2Faka.ms%2FAzSentinelNormalization%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%22%3EAzure%20Sentinel%20Information%20Model%20(ASIM)%20guidance%3C%2FA%3E%20and%20release%20our%20%3CA%20href%3D%22https%3A%2F%2Faka.ms%2FAzSentinelDnsDoc%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%22%3EDNS%20schema%3C%2FA%3E.%20We%20expect%20to%20follow%20suit%20with%20additional%20schemas%20in%20the%20coming%20weeks.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3ESpecial%20thanks%20to%20%3CSTRONG%3EYaron%20Fruchtmann%3C%2FSTRONG%3E%20and%20%3CSTRONG%3EBatami%20Gold%3C%2FSTRONG%3E%2C%20who%20made%20all%20this%20possible.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThis%20release%20includes%20additional%20artifacts%20to%20ensure%20easier%20use%20of%20ASIM%3A%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3ENew%20extensive%20%3CA%20href%3D%22https%3A%2F%2Faka.ms%2FAzSentinelNormalization%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%22%3Eoverview%20of%20the%20Azure%20Sentinel%20Information%20Model%20(ASIM)%3C%2FA%3E%2C%20including%20schema%20guidelines%20and%20a%20parser%20writing%20guide.%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EAll%20the%20normalizing%20parsers%20can%20be%20deployed%20in%20a%20click%20using%20an%20%3CA%20href%3D%22https%3A%2F%2Faka.ms%2FAzSentinelDns%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%22%3EARM%20template%3C%2FA%3E.%20The%20initial%20release%20contains%20normalizing%20parsers%20for%20Infoblox%2C%20Cisco%20Umbrella%2C%20and%20Microsoft%20DNS%20server.%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EWe%20have%20migrated%20analytic%20rules%20that%20worked%20on%20a%20single%20DNS%20source%20to%20use%20the%20normalized%20template.%20Those%20are%20available%20in%20GitHub%20and%20will%20be%20available%20in%20the%20in%20product%20gallery%20in%20the%20coming%20days.%20You%20can%20find%20the%20list%20at%20the%20end%20of%20this%20post.%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EAnd%20of%20course%2C%20the%20%3CA%20href%3D%22https%3A%2F%2Faka.ms%2FAzSentinelDnsDoc%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%22%3Eschema%20documentation%3C%2FA%3E%20is%20available%20on%20docs.microsoft.com.%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EWith%20a%20single%20click%20deployment%20and%20support%20for%20normalized%20content%20in%20analytic%20rules%2C%20we%20believe%20we%20will%20see%20an%20accelerated%20adaption%20of%20the%20Azure%20Sentinel%20Information%20Model.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EJoin%20us%20to%20learn%20more%20about%20Azure%20Sentinel%20information%20model%20in%20%3CA%20href%3D%22https%3A%2F%2Fforms.office.com%2FPages%2FResponsePage.aspx%3Fid%3Dv4j5cvGGr0GRqy180BHbR_0A4IaJRDNBnp8pjCkWnwhUQVdTOFVQN1JNMFZaR0FLQkFLVENXQVNDMS4u%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%22%3Etwo%20webinars%3C%2FA%3E%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CSTRONG%3EThe%20Information%20Model%3A%20Understanding%20Normalization%20in%20Azure%20Sentinel%3C%2FSTRONG%3E%3C%2FLI%3E%0A%3CLI%3E%3CSTRONG%3EDeep%20Dive%20into%20Azure%20Sentinel%20Normalizing%20Parsers%20and%20Normalized%20Content%3C%2FSTRONG%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId--438453792%22%20id%3D%22toc-hId--440951372%22%3EWhy%20normalization%2C%20and%20what%20is%20the%20Azure%20Sentinel%20Information%20Model%3F%3C%2FH2%3E%0A%3CP%3E%3CBR%20%2F%3EWorking%20with%20various%20data%20types%20and%20tables%20together%20presents%20a%20challenge.%20You%20must%20become%20familiar%20with%20many%20different%20data%20types%20and%20schemas%2C%20write%20and%20use%20a%20unique%20set%20of%20analytics%20rules%2C%20workbooks%2C%20and%20hunting%20queries%20for%20each%2C%20even%20for%20those%20that%20share%20commonalities%20(for%20example%2C%20DNS%20servers).%20Correlation%20between%20the%20different%20data%20types%20necessary%20for%20investigation%20and%20hunting%20is%20also%20tricky.%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3EThe%20Azure%20Sentinel%20Information%20Model%20(ASIM)%20provides%20a%20seamless%20experience%20for%20handling%20various%20sources%20in%20uniform%2C%20normalized%20views.%20ASIM%20aligns%20with%20the%20Open-Source%20Security%20Events%20Metadata%20(OSSEM)%20common%20information%20model%2C%20promoting%20vendor%20agnostic%2C%20industry-wide%20normalization.%20ASIM%3A%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EAllows%20source%20agnostic%20content%20and%20solutions%3C%2FLI%3E%0A%3CLI%3ESimplifies%20analyst%20use%20of%20the%20data%20in%20sentinel%20workspaces%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20current%20implementation%20is%20based%20on%20query%20time%20normalization%20using%20KQL%20functions.%20And%20includes%20the%20following%3A%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3ENormalized%20schemas%20cover%20standard%20sets%20of%20predictable%20event%20types%20that%20are%20easy%20to%20work%20with%20and%20build%20unified%20capabilities.%20The%20schema%20defines%20which%20fields%20should%20represent%20an%20event%2C%20a%20normalized%20column%20naming%20convention%2C%20and%20a%20standard%20format%20for%20the%20field%20values.%3C%2FLI%3E%0A%3CLI%3EParsers%20map%20existing%20data%20to%20the%20normalized%20schemas.%20Parsers%20are%20implemented%20using%20KQL%20functions.%3C%2FLI%3E%0A%3CLI%3EContent%20for%20each%20normalized%20schema%20includes%20analytics%20rules%2C%20workbooks%2C%20hunting%20queries%2C%20and%20additional%20content.%20This%20content%20works%20on%20any%20normalized%20data%20without%20the%20need%20to%20create%20source-specific%20content.%3CBR%20%2F%3E%3CBR%20%2F%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22POWERPNT_kovE7KHr8z.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F287436i766C13090426B7A7%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22POWERPNT_kovE7KHr8z.png%22%20alt%3D%22POWERPNT_kovE7KHr8z.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-2049059041%22%20id%3D%22toc-hId-2046561461%22%3EWhy%20normalize%20DNS%20data%3F%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EASIM%20is%20especially%20useful%20for%20DNS.%20Different%20DNS%20servers%20and%20DNS%20security%20solutions%20such%20as%20Infoblox%2C%20Cisco%20Umbrella%20%26amp%3B%20Microsoft%20DNS%20server%20provide%20highly%20non-standard%20logs%2C%20representing%20similar%20information%2C%20namely%20the%20DNS%20protocol.%20Using%20normalization%2C%20standard%2C%20source%20agnostic%20content%20can%20apply%20to%20all%20DNS%20servers%20without%20customizing%20it%20to%20each%20DNS%20server.%20In%20addition%2C%20an%20analyst%20investigating%20an%20incident%20can%20query%20the%20DNS%20data%20in%20the%20system%20without%20specific%20knowledge%20of%20the%20source%20providing%20it.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-241604578%22%20id%3D%22toc-hId-239106998%22%3EAnalytic%20Rules%20added%20or%20updated%20to%20work%20with%20ASim%20DNS%3C%2FH2%3E%0A%3CUL%3E%0A%3CLI%3EAdded%3A%3CUL%3E%0A%3CLI%3EExcessive%20NXDOMAIN%20DNS%20Queries%20(Normalized%20DNS)%3C%2FLI%3E%0A%3CLI%3EDNS%20events%20related%20to%20mining%20pools%20(Normalized%20DNS)%3C%2FLI%3E%0A%3CLI%3EDNS%20events%20related%20to%20ToR%20proxies%20(Normalized%20DNS)%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3CLI%3EUpdated%20to%20include%20normalized%20DNS%3A%3CUL%3E%0A%3CLI%3EKnown%20Barium%20domains%3C%2FLI%3E%0A%3CLI%3EKnown%20Barium%20IP%20addresses%3C%2FLI%3E%0A%3CLI%3EExchange%20Server%20Vulnerabilities%20Disclosed%20March%202021%20IoC%20Match%3C%2FLI%3E%0A%3CLI%3EKnown%20GALLIUM%20domains%20and%20hashes%3C%2FLI%3E%0A%3CLI%3EKnown%20IRIDIUM%20IP%3C%2FLI%3E%0A%3CLI%3ENOBELIUM%20-%20Domain%20and%20IP%20IOCs%20-%20March%202021%3C%2FLI%3E%0A%3CLI%3EKnown%20Phosphorus%20group%20domains%2FIP%3C%2FLI%3E%0A%3CLI%3EKnown%20STRONTIUM%20group%20domains%20-%20July%202019%3C%2FLI%3E%0A%3CLI%3ESolorigate%20Network%20Beacon%3C%2FLI%3E%0A%3CLI%3ETHALLIUM%20domains%20included%20in%20DCU%20takedown%3C%2FLI%3E%0A%3CLI%3EKnown%20ZINC%20Comebacker%20and%20Klackring%20malware%20hashes%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3C%2FUL%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-2429926%22%20slang%3D%22en-US%22%3E%3CP%3ELearn%20more%20about%20ASIM%2C%20and%20how%20to%20get%20Azure%20Sentinel's%20value%20over%20all%20of%20your%20DNS%20sources%2C%20built-in%20or%20custom.%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2429926%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EWhat's%20new%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Co-Authors
Version history
Last update:
‎Jun 15 2021 11:55 AM
Updated by: