Home

Orb - A tool to run Live Site using Azure Data Explorer

%3CLINGO-SUB%20id%3D%22lingo-sub-757581%22%20slang%3D%22en-US%22%3EOrb%20-%20A%20tool%20to%20run%20Live%20Site%20using%20Azure%20Data%20Explorer%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-757581%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSPAN%3EOrb%20(Object-based%20Resource%20Browser)%20is%20a%20tool%20used%20by%20several%20internal%20Azure%20engineering%20and%20support%20teams%20to%20run%20Live%20Site%20for%20their%20services%20%E2%80%93%20I%E2%80%99m%20happy%20to%20announce%20that%20this%20tool%20is%20now%20available%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%20data-contrast%3D%22auto%22%3Eon%26nbsp%3B%3C%2FSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fmicrosoft%2FOrb%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%3CSPAN%3EGitHub%3C%2FSPAN%3E%3C%2FA%3E%3CSPAN%3E.%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EOrb%20enables%20you%20to%20reduce%20the%20time%20to%20investigate%20Live%20Site%20issues%20in%20your%20services%20by%20providing%20the%20ability%20to%20rapidly%20browse%20through%20information%2C%20based%20on%20an%20object%20hierarchy.%20%3C%2FSPAN%3E%3CSPAN%3EObject%20hierarchies%20are%20user-defined%20and%20backed%20by%20Azure%20Data%20Explorer%20(ADX)%20queries%20-%20ADX%20integration%20allows%20rapidly%20searching%20for%20objects%20and%20discovering%20hierarchies%20dynamically%20based%20on%20event%20logs%20from%20your%20services.%20Internal%20Azure%20services%20use%20Orb%20to%20map%20the%20layout%20of%20Azure%20data%20centers%26nbsp%3Band%20cross-service%20interactions.%20For%20example%2C%20a%20user%20Virtual%20Machine%20(VM)%20is%20mapped%20to%20a%20host%20server.%20A%20host%20server%20is%20further%20mapped%20to%20a%20rack%2C%20network%20switch%20and%20so%20forth.%20%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2FAzure-Data-Explorer%2FObject-Modeling-in-Azure-Data-Explorer%2Fm-p%2F740546%22%20target%3D%22_blank%22%20rel%3D%22noopener%22%3EThis%20post%3C%2FA%3Eprovides%20more%20information%20on%20how%20our%20internal%20services%20emit%20these%20event%20logs.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%20style%3D%22text-align%3A%20center%3B%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20520px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F123430i30A9EFFC6ABF9342%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20alt%3D%22orbAssociations.gif%22%20title%3D%22orbAssociations.gif%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EOrb%20also%20allows%20streamlined%20access%20and%20discovery%20of%20common%20resources%20like%20queries%2C%20dashboards%2C%20web%20links%20and%20scripts%20across%20different%20teams.%20Within%20a%20large%20organization%2C%20it%E2%80%99s%20easy%20for%20these%20resources%20to%20get%20fragmented%20on%20different%20team%20specific%20wiki%20pages%20and%20notebooks.%20With%20Orb%2C%20the%20entire%20organization%20can%20have%20a%20shared%20and%20consistent%20view%20of%20these%20resources.%20The%20resources%20are%20organized%20by%20Object%20%E2%80%93%20think%20of%20Objects%20as%20directories%20and%20resources%20as%20files%20in%20a%20directory.%20In%20a%20file%20system%2C%20you%E2%80%99d%20have%20directories%20linked%20together%20by%20metadata%20stored%20on%20disk%20%E2%80%93%20in%20Orb%2C%20directories%20or%20Objects%20are%20linked%20together%20dynamically%20based%20on%20ADX%20queries%20(or%20PowerShell%20scripts).%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EWhen%20a%20resource%20under%20an%20object%20is%20clicked%2C%20all%20necessary%20context%20about%20the%20object%20is%20injected%20into%20the%20resource.%20For%20example%2C%20if%20you%20click%20a%20saved%20web%20link%20for%20a%20VM%20object%20and%20the%20URL%20contains%20a%20VM%20Id%2C%20the%20VM%20Id%20is%20automatically%20injected%20into%20the%20query.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-center%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F123426iCE6E64548A6E9220%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20alt%3D%22orbRapidExploration.gif%22%20title%3D%22orbRapidExploration.gif%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EIf%20there%20were%20more%20object%20properties%20in%20the%20URL%20that%20needed%20to%20be%20populated%20(say%2C%20VM%20region)%2C%20those%20would%20also%20be%20added%20in%20by%20Orb.%20In%20addition%20to%20web%20URLs%2C%20this%20parameter%20injection%20works%20across%20different%20resource%20types%20like%20saved%20ADX%20queries%2C%20PowerShell%20scripts%2Fterminals%20and%20more.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EThe%20combination%20of%20the%20object%20hierarchy%20and%20shared%20resources%20is%20what%20enables%20the%20rapid%20information%20exploration.%20When%20a%20Live%20Site%20incident%20is%20raised%20to%20our%20team%20in%20Azure%20Compute%2C%20we%20use%20Orb%20to%20quickly%20navigate%20from%20a%20VM%20object%20to%20the%20host%20server.%20From%20there%2C%20we%20can%20look%20at%20all%20the%20various%20host%20resources%20and%20dashboards%20that%20determine%20the%20host%20server%20health.%20Since%20Azure%20Networking%20has%20also%20modeled%20their%20objects%20in%20Orb%2C%20my%20team%20can%20jump%20to%20the%20network%20switch%20object%20the%20host%20is%20running%20under%20and%20then%20look%20at%20all%20the%20shared%20dashboards%20that%20determine%20network%20switch%20health.%20Without%20this%20shared%20resource%20model%2C%20we%20might%20have%20previously%20engaged%20another%20engineer%20on%20the%20Networking%20team%20to%20get%20access%20to%20the%20same%20information.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EUnder%20the%20covers%2C%20Orb%20uses%20a%20git%20repository%20to%20store%20the%20shared%20resources%20and%20object%20hierarchy%20definitions.%20This%20allows%20organizations%20to%20control%20who%20was%20read%2Fwrite%20permissions%20on%20the%20shared%20view%2C%20as%20well%20as%20audit%20and%20rollback%20capabilities.%20Users%20can%20update%20the%20shared%20view%20and%20submit%20pull%20requests%20from%20within%20Orb.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EOrb%20is%20available%20to%20download%20and%20use%20for%20free%20on%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fmicrosoft%2FOrb%2Freleases%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EGitHub%3C%2FA%3E.%20Windows%20is%20the%20only%20supported%20Operating%20System%20at%20this%20point.%20Orb%20ships%20with%20a%20sample%20ADX%20cluster%20and%20object%20definitions%20-%20to%20use%20Orb%20with%20your%20real%20service%20data%2C%20take%20a%20look%20at%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fmicrosoft%2FOrb%2Fblob%2Fmaster%2Fdist%2Fresources%2Fapp%2Fdocumentation%2Fonboarding.md%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ethis%20guide.%3C%2FA%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-757581%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAnnouncements%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EAzure%20Data%20Explorer%20(Kusto)%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
gauravjag
Microsoft

Orb (Object-based Resource Browser) is a tool used by several internal Azure engineering and support teams to run Live Site for their services – I’m happy to announce that this tool is now available on GitHub 

 

Orb enables you to reduce the time to investigate Live Site issues in your services by providing the ability to rapidly browse through information, based on an object hierarchy. Object hierarchies are user-defined and backed by Azure Data Explorer (ADX) queries - ADX integration allows rapidly searching for objects and discovering hierarchies dynamically based on event logs from your services. Internal Azure services use Orb to map the layout of Azure data centers and cross-service interactions. For example, a user Virtual Machine (VM) is mapped to a host server. A host server is further mapped to a rack, network switch and so forth. This post provides more information on how our internal services emit these event logs.

 

orbAssociations.gif

 

Orb also allows streamlined access and discovery of common resources like queries, dashboards, web links and scripts across different teams. Within a large organization, it’s easy for these resources to get fragmented on different team specific wiki pages and notebooks. With Orb, the entire organization can have a shared and consistent view of these resources. The resources are organized by Object – think of Objects as directories and resources as files in a directory. In a file system, you’d have directories linked together by metadata stored on disk – in Orb, directories or Objects are linked together dynamically based on ADX queries (or PowerShell scripts).

 

When a resource under an object is clicked, all necessary context about the object is injected into the resource. For example, if you click a saved web link for a VM object and the URL contains a VM Id, the VM Id is automatically injected into the query.

 

orbRapidExploration.gif

 

If there were more object properties in the URL that needed to be populated (say, VM region), those would also be added in by Orb. In addition to web URLs, this parameter injection works across different resource types like saved ADX queries, PowerShell scripts/terminals and more.

 

The combination of the object hierarchy and shared resources is what enables the rapid information exploration. When a Live Site incident is raised to our team in Azure Compute, we use Orb to quickly navigate from a VM object to the host server. From there, we can look at all the various host resources and dashboards that determine the host server health. Since Azure Networking has also modeled their objects in Orb, my team can jump to the network switch object the host is running under and then look at all the shared dashboards that determine network switch health. Without this shared resource model, we might have previously engaged another engineer on the Networking team to get access to the same information.

 

Under the covers, Orb uses a git repository to store the shared resources and object hierarchy definitions. This allows organizations to control who was read/write permissions on the shared view, as well as audit and rollback capabilities. Users can update the shared view and submit pull requests from within Orb.

 

Orb is available to download and use for free on GitHub. Windows is the only supported Operating System at this point. Orb ships with a sample ADX cluster and object definitions - to use Orb with your real service data, take a look at this guide.