The woes of siloed monitoring and how to leave them behind in minutes via Azure Marketplace

Published Oct 04 2021 09:04 AM 683 Views
Microsoft

In this guest blog post, Karl Kalash, Product Marketing Manager at Datadog, examines the problems that can arise from traditional siloed monitoring, how Datadog’s approach unifies information, and how the Microsoft Azure Marketplace simplifies purchasing and invoicing for customers of the software-as-a-service (SaaS) solution:


Modern applications are built with a multi-tier, service-oriented architecture. Problems that affect end users can occur at any level in the tech stack, and they need to be caught before issues cascade and become critical. Traditional siloed monitoring, in which each team uses its own monitoring tool and users are constantly chasing the red or tracking the yellow, is no longer sufficient. All teams do not have a single source of truth and are often blindsided at critical moments. Context switching and finger-pointing are often the end result. This impacts every reason that led you to the cloud in the first place: It negatively impacts your scalability, reduces agility, increases costs, affects cloud migration and platform modernization projects, and limits application optimization.


The problems are magnified by thousands of instances distributed over the cloud and on-premises environments. Siloed monitoring tools limit your team’s ability to respond to challenges at the cloud scale or adopt new technologies. Such tool and agent sprawl is expensive, both in terms of costs and computing resource consumption; it's also highly inefficient because of agent and data redundancy. Metrics indicate something is wrong, but they lack details. Traces can point to the general area, but aren’t specific. Logs have high volume and varying value, with cost and visibility tradeoffs. Everything must be manually queried and correlated.


This leads to reactive teams, excessive alerts, and constant firefighting. Poor quality of life for your operations teams could impact not just performance, but also hiring and growth. And most importantly, you lack the business context of what matters to your end users or customers.

 

By contrast, Datadog collects data from all servers, containers, applications, and cloud-based services with a single unified agent. The same agent that collects metrics also collects traces and logs. All that data is sent to Datadog’s SaaS platform, which enables numerous levels of monitoring:


● Infrastructure monitoring for back-end servers and cloud-based instances
● Serverless monitoring for functions and serverless applications
● Application performance monitoring on the application server side, which gives you insights aggregated across all requests
● Log management for all front-end and back-end logs, allowing you to analyze the details of issues
● Synthetics for proactive testing of application programming interface (API) endpoints and websites to detect issues before they impact customers
● Real user monitoring for your browsers and mobile devices
● Network performance to manage and optimize traffic flow across the entire stack

 

With everything enabled in one platform, teams gain a single source of truth with zero context switching. Datadog's machine learning and automated correlations enable insights and actionable information, from tracking service level objectives to real-time root-cause analysis and integrations with collaboration and workflow tools.


Customers can go from shopping for a Datadog plan in the Azure Marketplace to visualizing real-time Azure metrics in their Datadog account in minutes. They can streamline the purchase, configuration, and management of Datadog as a first-class service in the Azure portal.

 

Image 1.jpg

 

Datadog’s listing in the Azure Marketplace simplifies the purchasing and invoicing for new customers by having their usage appear directly on their Azure invoice, consolidating their Datadog and Azure costs. Once customers have purchased a Datadog plan through the Azure Marketplace, they’ll immediately start receiving standard Azure Monitor metrics in their new Datadog account. To further simplify the setup process, customers can enable single sign-on with Azure Active Directory during Datadog account creation.


Customers can see all their Azure data in the same place as data from across the rest of their stack in other clouds or on premises, thereby streamlining their migration process to Azure.

 

Image 2.jpg

 

Datadog’s Azure integration pulls in every metric users see in Azure and allows them to monitor new Azure services in real time automatically. The log-forwarding process from Azure to Datadog has also been completely automated: Rather than building out a log-forwarding pipeline with Diagnostic Settings, Event Hubs, and Functions, customers can configure everything with just a few clicks.


This makes it easier than ever to leverage Datadog’s powerful observability, compliance, and security capabilities for a successful cloud journey in Azure. The Datadog App Service Extension can also be added, managed, and deployed to our customer’s Azure Web Apps through the Datadog resource blade, simplifying the APM setup process.

 

image 3.jpg

 

 

%3CLINGO-SUB%20id%3D%22lingo-sub-2601064%22%20slang%3D%22en-US%22%3EThe%20woes%20of%20siloed%20monitoring%20and%20how%20to%20leave%20them%20behind%20in%20minutes%20via%20Azure%20Marketplace%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2601064%22%20slang%3D%22en-US%22%3E%3CP%3E%3CEM%3EIn%20this%20guest%20blog%20post%2C%20Karl%20Kalash%2C%20Product%20Marketing%20Manager%20at%20Datadog%2C%20examines%20the%20problems%20that%20can%20arise%20from%20traditional%20siloed%20monitoring%2C%20how%20Datadog%E2%80%99s%20approach%20unifies%20information%2C%20and%20how%20the%20Microsoft%20Azure%20Marketplace%20simplifies%20purchasing%20and%20invoicing%20for%20customers%20of%20the%20software-as-a-service%20(SaaS)%20solution%3A%3C%2FEM%3E%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3EModern%20applications%20are%20built%20with%20a%20multi-tier%2C%20service-oriented%20architecture.%20Problems%20that%20affect%20end%20users%20can%20occur%20at%20any%20level%20in%20the%20tech%20stack%2C%20and%20they%20need%20to%20be%20caught%20before%20issues%20cascade%20and%20become%20critical.%20Traditional%20siloed%20monitoring%2C%20in%20which%20each%20team%20uses%20its%20own%20monitoring%20tool%20and%20users%20are%20constantly%20chasing%20the%20red%20or%20tracking%20the%20yellow%2C%20is%20no%20longer%20sufficient.%20All%20teams%20do%20not%20have%20a%20single%20source%20of%20truth%20and%20are%20often%20blindsided%20at%20critical%20moments.%20Context%20switching%20and%20finger-pointing%20are%20often%20the%20end%20result.%20This%20impacts%20every%20reason%20that%20led%20you%20to%20the%20cloud%20in%20the%20first%20place%3A%20It%20negatively%20impacts%20your%20scalability%2C%20reduces%20agility%2C%20increases%20costs%2C%20affects%20cloud%20migration%20and%20platform%20modernization%20projects%2C%20and%20limits%20application%20optimization.%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3EThe%20problems%20are%20magnified%20by%20thousands%20of%20instances%20distributed%20over%20the%20cloud%20and%20on-premises%20environments.%20Siloed%20monitoring%20tools%20limit%20your%20team%E2%80%99s%20ability%20to%20respond%20to%20challenges%20at%20the%20cloud%20scale%20or%20adopt%20new%20technologies.%20Such%20tool%20and%20agent%20sprawl%20is%20expensive%2C%20both%20in%20terms%20of%20costs%20and%20computing%20resource%20consumption%3B%20it's%20also%20highly%20inefficient%20because%20of%20agent%20and%20data%20redundancy.%20Metrics%20indicate%20something%20is%20wrong%2C%20but%20they%20lack%20details.%20Traces%20can%20point%20to%20the%20general%20area%2C%20but%20aren%E2%80%99t%20specific.%20Logs%20have%20high%20volume%20and%20varying%20value%2C%20with%20cost%20and%20visibility%20tradeoffs.%20Everything%20must%20be%20manually%20queried%20and%20correlated.%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3EThis%20leads%20to%20reactive%20teams%2C%20excessive%20alerts%2C%20and%20constant%20firefighting.%20Poor%20quality%20of%20life%20for%20your%20operations%20teams%20could%20impact%20not%20just%20performance%2C%20but%20also%20hiring%20and%20growth.%20And%20most%20importantly%2C%20you%20lack%20the%20business%20context%20of%20what%20matters%20to%20your%20end%20users%20or%20customers.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EBy%20contrast%2C%20Datadog%20collects%20data%20from%20all%20servers%2C%20containers%2C%20applications%2C%20and%20cloud-based%20services%20with%20a%20single%20unified%20agent.%20The%20same%20agent%20that%20collects%20metrics%20also%20collects%20traces%20and%20logs.%20All%20that%20data%20is%20sent%20to%20Datadog%E2%80%99s%20SaaS%20platform%2C%20which%20enables%20numerous%20levels%20of%20monitoring%3A%3C%2FP%3E%0A%3CP%20class%3D%22lia-indent-padding-left-30px%22%3E%3CBR%20%2F%3E%E2%97%8F%20Infrastructure%20monitoring%20for%20back-end%20servers%20and%20cloud-based%20instances%3CBR%20%2F%3E%E2%97%8F%20Serverless%20monitoring%20for%20functions%20and%20serverless%20applications%3CBR%20%2F%3E%E2%97%8F%20Application%20performance%20monitoring%20on%20the%20application%20server%20side%2C%20which%20gives%20you%20insights%20aggregated%20across%20all%20requests%3CBR%20%2F%3E%E2%97%8F%20Log%20management%20for%20all%20front-end%20and%20back-end%20logs%2C%20allowing%20you%20to%20analyze%20the%20details%20of%20issues%20%3CBR%20%2F%3E%E2%97%8F%20Synthetics%20for%20proactive%20testing%20of%20application%20programming%20interface%20(API)%20endpoints%20and%20websites%20to%20detect%20issues%20before%20they%20impact%20customers%3CBR%20%2F%3E%E2%97%8F%20Real%20user%20monitoring%20for%20your%20browsers%20and%20mobile%20devices%3CBR%20%2F%3E%E2%97%8F%20Network%20performance%20to%20manage%20and%20optimize%20traffic%20flow%20across%20the%20entire%20stack%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EWith%20everything%20enabled%20in%20one%20platform%2C%20teams%20gain%20a%20single%20source%20of%20truth%20with%20zero%20context%20switching.%20Datadog's%20machine%20learning%20and%20automated%20correlations%20enable%20insights%20and%20actionable%20information%2C%20from%20tracking%20service%20level%20objectives%20to%20real-time%20root-cause%20analysis%20and%20integrations%20with%20collaboration%20and%20workflow%20tools.%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3ECustomers%20can%20go%20from%20shopping%20for%20a%20Datadog%20plan%20in%20the%20Azure%20Marketplace%20to%20visualizing%20real-time%20Azure%20metrics%20in%20their%20Datadog%20account%20in%20minutes.%20They%20can%20streamline%20the%20purchase%2C%20configuration%2C%20and%20management%20of%20Datadog%20as%20a%20first-class%20service%20in%20the%20Azure%20portal.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-left%22%20image-alt%3D%22Image%201.jpg%22%20style%3D%22width%3A%20318px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F310123i41150BE68ED38EF0%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22Image%201.jpg%22%20alt%3D%22Image%201.jpg%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EDatadog%E2%80%99s%20%3CA%20href%3D%22https%3A%2F%2Fazuremarketplace.microsoft.com%2Fen-us%2Fmarketplace%2Fapps%2Fdatadog1591740804488.dd_liftr_v2%3Focid%3DGTMRewards_Blog_dd_liftr_v2_be2b%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3Elisting%20in%20the%20Azure%20Marketplace%3C%2FA%3E%20simplifies%20the%20purchasing%20and%20invoicing%20for%20new%20customers%20by%20having%20their%20usage%20appear%20directly%20on%20their%20Azure%20invoice%2C%20consolidating%20their%20Datadog%20and%20Azure%20costs.%20Once%20customers%20have%20purchased%20a%20Datadog%20plan%20through%20the%20Azure%20Marketplace%2C%20they%E2%80%99ll%20immediately%20start%20receiving%20standard%20Azure%20Monitor%20metrics%20in%20their%20new%20Datadog%20account.%20To%20further%20simplify%20the%20setup%20process%2C%20customers%20can%20enable%20single%20sign-on%20with%20Azure%20Active%20Directory%20during%20Datadog%20account%20creation.%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3ECustomers%20can%20see%20all%20their%20Azure%20data%20in%20the%20same%20place%20as%20data%20from%20across%20the%20rest%20of%20their%20stack%20in%20other%20clouds%20or%20on%20premises%2C%20thereby%20%3CA%20href%3D%22https%3A%2F%2Fwww.datadoghq.com%2Fsolutions%2Fcloud-migration%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3Estreamlining%20their%20migration%20process%20to%20Azure%3C%2FA%3E.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-left%22%20image-alt%3D%22Image%202.jpg%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F310120i9ABC7686819D5F24%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22Image%202.jpg%22%20alt%3D%22Image%202.jpg%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EDatadog%E2%80%99s%20Azure%20integration%20pulls%20in%20every%20metric%20users%20see%20in%20Azure%20and%20allows%20them%20to%20monitor%20new%20Azure%20services%20in%20real%20time%20automatically.%20The%20log-forwarding%20process%20from%20Azure%20to%20Datadog%20has%20also%20been%20completely%20automated%3A%20Rather%20than%20building%20out%20a%20log-forwarding%20pipeline%20with%20Diagnostic%20Settings%2C%20Event%20Hubs%2C%20and%20Functions%2C%20customers%20can%20configure%20everything%20with%20just%20a%20few%20clicks.%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3EThis%20makes%20it%20easier%20than%20ever%20to%20leverage%20Datadog%E2%80%99s%20powerful%20observability%2C%20compliance%2C%20and%20security%20capabilities%20for%20a%20successful%20cloud%20journey%20in%20Azure.%20The%20Datadog%20App%20Service%20Extension%20can%20also%20be%20added%2C%20managed%2C%20and%20deployed%20to%20our%20customer%E2%80%99s%20Azure%20Web%20Apps%20through%20the%20Datadog%20resource%20blade%2C%20simplifying%20the%20APM%20setup%20process.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-left%22%20image-alt%3D%22image%203.jpg%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F310118i49728D19160A63DF%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22image%203.jpg%22%20alt%3D%22image%203.jpg%22%20%2F%3E%3C%2FSPAN%3E%3CBR%20%2F%3E%3CBR%20%2F%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-2601064%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-left%22%20image-alt%3D%22%5BTeaser%201%5D.jpg%22%20style%3D%22width%3A%20978px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F310143i31728D8E171A9533%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22%5BTeaser%201%5D.jpg%22%20alt%3D%22%5BTeaser%201%5D.jpg%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3EThis%20guest%20blog%20post%20from%20Karl%20Kalash%2C%20Product%20Marketing%20Manager%20at%20Datadog%2C%20compares%20traditional%20siloed%20monitoring%20to%20Datadog%E2%80%99s%20approach%20and%20shows%20how%20the%20Microsoft%20Azure%20Marketplace%20simplifies%20purchasing%20and%20invoicing.%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2601064%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAzure%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EIT%20Professionals%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EPartner%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Co-Authors
Version history
Last update:
‎Oct 04 2021 11:51 AM
Updated by: