Automation in Azure Backup for management-at-scale

Published 05-25-2021 08:00 AM 2,944 Views

As you manage your operations in Azure, your backup estate might expand by including new diverse set of workloads or scale-up in volume.  At small-scale, actions such as identifying the right machines to be backed up, configuring backup, monitoring their status, extracting data etc. could be manual or performed with ease. But at large-scale, we understand that such actions could be difficult, complex and could be prone to error. Hence, Azure Backup aims to assist you by providing few automation options for management-at-scale. The 3 key areas that can benefit with such automation options which we heard from our customers are:

  • Configuring backup when infrastructure gets created or provisioned.

  • Exporting backup operational and audit data to your own monitoring systems/dashboard for your end-customers

  • Automating actions/triggers to identify failures and correct them so that backup is ‘healthy’.

Configuring backups

A backup admin must deal with new infrastructure getting added periodically and making sure that they are protected as per agreed requirements. The usual approach is to have an automation client, such as PS/CLI, to get all the VMs and then check the backup status of each of them and take appropriate action for un-protected VMs. Now, this also must be performant at-scale and should be scheduled periodically, and each run should be monitored as well. To ease such pains in automation, Azure Backup leverages Azure Policy and provides built-in backup specific Azure policies to govern the backup estate. Essentially, once you assign an Azure policy to a scope, all VMs which meet your criteria will be backed up automatically and newer VMs will be scanned and protected periodically by Azure Policy itself. You can also view a compliance report which will alert you for non-compliant resources as well.

 

The below video elaborates on how Azure policy works for backup.

 

 

In summary, Azure Backup and Azure policy makes sure that you are at peace knowing that you have protected your most critical resources and data.

 

Exporting backup operational data

Azure Backup users, especially partners, have always looked for options to extract backup operational data for their entire estate and periodically pump it to their monitoring systems/dashboards. At large scales, the data should be retrieved fast, even when querying thousands of records. You should be able to query across resources, subscriptions, and tenants. You should also be able to query from any client (Portal/PS/CLI/Any SDK/REST API) and there should be flexibility in output formatting (table vs Array) as well. Azure Resource Graph (ARG) is built to meet such requirements and query at-scale. Azure Backup leverages ARG as an optimized way to fetch all related data with minimal queries (1 single query for 1 scenario). For example, a single query can fetch you all failed jobs across all vaults in all subscriptions and all tenants. Few ARG sample queries are documented here. Apart from the flexibility of calling the query from any client, the queries are RBAC compliant as well.

 

Now, you can export relevant backup data in a secure and performant way to your own monitoring systems and dashboards, even for large-scale.

 

Automating responses or actions

Automatic troubleshooting is one of the most key asks from our customers. If the recommended actions for failures can be automated, the time taken to recover from failure is minimized. You could automate a specific/targeted recommended action such as setting up the right permissions or to just re-trigger failures for outage scenarios/transient errors. You can achieve this by retrieving relevant backup data via ARG and combine it with corrective PS/CLI steps.

 

As an example, in the below video, we talk about how to re-trigger backup for all failed jobs (across vaults, subscriptions, tenants) using ARG and Powershell.

 

 

While transient errors can be corrected, some persistent errors might require in-depth analysis. You may have your own monitoring/ticketing mechanisms to make sure such failures are properly tracked and fixed. Azure Backup now integrates first-class with Azure Monitor which means critical alerts could automatically be integrated with ITSM solutions such as Service Now.

 

In the below video, we talk about how to leverage Azure Monitor to configure various notification mechanisms for critical alerts.

 

 

With automation in place, you can automatically correct few errors across large estates and could leverage relevant notification mechanisms to track and fix others, thereby making sure that your backup estate is always healthy.

 

Summary

Azure Backup offers various automation at-scale options such as Integration with Azure Policy, Azure Resource Graph and Azure Monitor to govern and monitor large backup estates across subscriptions and tenants.

 

Resources

Come chat with us to provide feedback on Azure Backup! We’re hosting a Product Roundtable during Build on Wednesday, May 26, 6:30-7:30 AM PT. Azure Backup: automation and security considerations for databases and storage.

 

 

%3CLINGO-SUB%20id%3D%22lingo-sub-2374823%22%20slang%3D%22en-US%22%3EAutomation%20in%20Azure%20Backup%20for%20management-at-scale%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2374823%22%20slang%3D%22en-US%22%3E%3CP%3EAs%20you%20manage%20your%20operations%20in%20Azure%2C%20your%20backup%20estate%20might%20expand%20by%20including%20new%20diverse%20set%20of%20workloads%20or%20scale-up%20in%20volume.%20%26nbsp%3BAt%20small-scale%2C%20actions%20such%20as%20identifying%20the%20right%20machines%20to%20be%20backed%20up%2C%20configuring%20backup%2C%20monitoring%20their%20status%2C%20extracting%20data%20etc.%20could%20be%20manual%20or%20performed%20with%20ease.%20But%20at%20large-scale%2C%20we%20understand%20that%20such%20actions%20could%20be%20difficult%2C%20complex%20and%20could%20be%20prone%20to%20error.%20Hence%2C%20Azure%20Backup%20aims%20to%20assist%20you%20by%20providing%20few%20automation%20options%20for%20management-at-scale.%20The%203%20key%20areas%20that%20can%20benefit%20with%20such%20automation%20options%20which%20we%20heard%20from%20our%20customers%20are%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CP%3EConfiguring%20backup%20when%20infrastructure%20gets%20created%20or%20provisioned.%3C%2FP%3E%0A%3C%2FLI%3E%0A%3CLI%3E%3CP%3EExporting%20backup%20operational%20and%20audit%20data%20to%20your%20own%20monitoring%20systems%2Fdashboard%20for%20your%20end-customers%3C%2FP%3E%0A%3C%2FLI%3E%0A%3CLI%3E%3CP%3EAutomating%20actions%2Ftriggers%20to%20identify%20failures%20and%20correct%20them%20so%20that%20backup%20is%20%E2%80%98healthy%E2%80%99.%3C%2FP%3E%0A%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CH1%20id%3D%22toc-hId-1332665202%22%20id%3D%22toc-hId-1331838522%22%3EConfiguring%20backups%3C%2FH1%3E%0A%3CP%3EA%20backup%20admin%20must%20deal%20with%20new%20infrastructure%20getting%20added%20periodically%20and%20making%20sure%20that%20they%20are%20protected%20as%20per%20agreed%20requirements.%20The%20usual%20approach%20is%20to%20have%20an%20automation%20client%2C%20such%20as%20PS%2FCLI%2C%20to%20get%20all%20the%20VMs%20and%20then%20check%20the%20backup%20status%20of%20each%20of%20them%20and%20take%20appropriate%20action%20for%20un-protected%20VMs.%20Now%2C%20this%20also%20must%20be%20performant%20at-scale%20and%20should%20be%20scheduled%20periodically%2C%20and%20each%20run%20should%20be%20monitored%20as%20well.%20To%20ease%20such%20pains%20in%20automation%2C%20Azure%20Backup%20leverages%20Azure%20Policy%20and%20provides%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fazure%2Fbackup%2Fbackup-center-govern-environment%23azure-policies-for-backup%3FWT.mc_id%3Dmodinfra-29115-thmaure%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3Ebuilt-in%20backup%20specific%20Azure%20policies%3C%2FA%3E%20to%20govern%20the%20backup%20estate.%20Essentially%2C%20once%20you%20assign%20an%20Azure%20policy%20to%20a%20scope%2C%20all%20VMs%20which%20meet%20your%20criteria%20will%20be%20backed%20up%20automatically%20and%20newer%20VMs%20will%20be%20scanned%20and%20protected%20periodically%20by%20Azure%20Policy%20itself.%20You%20can%20also%20view%20a%20compliance%20report%20which%20will%20alert%20you%20for%20non-compliant%20resources%20as%20well.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20below%20video%20elaborates%20on%20how%20Azure%20policy%20works%20for%20backup.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CIFRAME%20src%3D%22https%3A%2F%2Fchannel9.msdn.com%2FShows%2FIT-Ops-Talk%2FConfigure-backups-at-scale-using-Azure-Policy%2Fplayer%3FWT.mc_id%3Dmodinfra-29117-thmaure%22%20width%3D%22960%22%20height%3D%22540%22%20frameborder%3D%220%22%20allowfullscreen%3D%22allowfullscreen%22%20title%3D%22Configure%20backups%20at%20scale%20using%20Azure%20Policy%20-%20Microsoft%20Channel%209%20Video%22%3E%3C%2FIFRAME%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EIn%20summary%2C%20Azure%20Backup%20and%20Azure%20policy%20makes%20sure%20that%20you%20are%20at%20peace%20knowing%20that%20you%20have%20protected%20your%20most%20critical%20resources%20and%20data.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId--474789261%22%20id%3D%22toc-hId--475615941%22%3EExporting%20backup%20operational%20data%3C%2FH1%3E%0A%3CP%3EAzure%20Backup%20users%2C%20especially%20partners%2C%20have%20always%20looked%20for%20options%20to%20extract%20backup%20operational%20data%20for%20their%20entire%20estate%20and%20periodically%20pump%20it%20to%20their%20monitoring%20systems%2Fdashboards.%20At%20large%20scales%2C%20the%20data%20should%20be%20retrieved%20fast%2C%20even%20when%20querying%20thousands%20of%20records.%20You%20should%20be%20able%20to%20query%20across%20resources%2C%20subscriptions%2C%20and%20tenants.%20You%20should%20also%20be%20able%20to%20query%20from%20any%20client%20(Portal%2FPS%2FCLI%2FAny%20SDK%2FREST%20API)%20and%20there%20should%20be%20flexibility%20in%20output%20formatting%20(table%20vs%20Array)%20as%20well.%20Azure%20Resource%20Graph%20(ARG)%20is%20built%20to%20meet%20such%20requirements%20and%20query%20at-scale.%20Azure%20Backup%20leverages%20ARG%20as%20an%20optimized%20way%20to%20fetch%20all%20related%20data%20with%20minimal%20queries%20(1%20single%20query%20for%201%20scenario).%20For%20example%2C%20a%20single%20query%20can%20fetch%20you%20all%20failed%20jobs%20across%20all%20vaults%20in%20all%20subscriptions%20and%20all%20tenants.%20Few%20ARG%20sample%20queries%20are%20documented%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fazure%2Fbackup%2Fquery-backups-using-azure-resource-graph%3FWT.mc_id%3Dmodinfra-29115-thmaure%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%22%3Ehere%3C%2FA%3E.%20Apart%20from%20the%20flexibility%20of%20calling%20the%20query%20from%20any%20client%2C%20the%20queries%20are%20RBAC%20compliant%20as%20well.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3ENow%2C%20you%20can%20export%20relevant%20backup%20data%20in%20a%20secure%20and%20performant%20way%20to%20your%20own%20monitoring%20systems%20and%20dashboards%2C%20even%20for%20large-scale.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId-2012723572%22%20id%3D%22toc-hId-2011896892%22%3EAutomating%20responses%20or%20actions%3C%2FH1%3E%0A%3CP%3EAutomatic%20troubleshooting%20is%20one%20of%20the%20most%20key%20asks%20from%20our%20customers.%20If%20the%20recommended%20actions%20for%20failures%20can%20be%20automated%2C%20the%20time%20taken%20to%20recover%20from%20failure%20is%20minimized.%20You%20could%20automate%20a%20specific%2Ftargeted%20recommended%20action%20such%20as%20setting%20up%20the%20right%20permissions%20or%20to%20just%20re-trigger%20failures%20for%20outage%20scenarios%2Ftransient%20errors.%20You%20can%20achieve%20this%20by%20retrieving%20relevant%20backup%20data%20via%20ARG%20and%20combine%20it%20with%20corrective%20PS%2FCLI%20steps.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EAs%20an%20example%2C%20in%20the%20below%20video%2C%20we%20talk%20about%20how%20to%20re-trigger%20backup%20for%20all%20failed%20jobs%20(across%20vaults%2C%20subscriptions%2C%20tenants)%20using%20ARG%20and%20Powershell.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CIFRAME%20src%3D%22https%3A%2F%2Fchannel9.msdn.com%2FShows%2FIT-Ops-Talk%2FAutomatically-retry-failed-backup-jobs-using-Azure-Resource-Graph-and-Azure-Automation-Runbooks%2Fplayer%3FWT.mc_id%3Dmodinfra-29116-thmaure%22%20width%3D%22960%22%20height%3D%22540%22%20frameborder%3D%220%22%20allowfullscreen%3D%22allowfullscreen%22%20title%3D%22Automatically%20retry%20failed%20backup%20jobs%20using%20Azure%20Resource%20Graph%20and%20Azure%20Automation%20Runbooks%20-%20Microsoft%20Channel%209%20Video%22%3E%3C%2FIFRAME%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EWhile%20transient%20errors%20can%20be%20corrected%2C%20some%20persistent%20errors%20might%20require%20in-depth%20analysis.%20You%20may%20have%20your%20own%20monitoring%2Fticketing%20mechanisms%20to%20make%20sure%20such%20failures%20are%20properly%20tracked%20and%20fixed.%20Azure%20Backup%20now%20integrates%20first-class%20with%20Azure%20Monitor%20which%20means%20critical%20alerts%20could%20automatically%20be%20integrated%20with%20ITSM%20solutions%20such%20as%20Service%20Now.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EIn%20the%20below%20video%2C%20we%20talk%20about%20how%20to%20leverage%20Azure%20Monitor%20to%20configure%20various%20notification%20mechanisms%20for%20critical%20alerts.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CIFRAME%20src%3D%22https%3A%2F%2Fchannel9.msdn.com%2FShows%2FIT-Ops-Talk%2FRespond-to-backup-alerts-using-Azure-Monitor%2Fplayer%3FWT.mc_id%3Dmodinfra-29115-thmaure%22%20width%3D%22960%22%20height%3D%22540%22%20frameborder%3D%220%22%20allowfullscreen%3D%22allowfullscreen%22%20title%3D%22Respond%20to%20backup%20alerts%20using%20Azure%20Monitor%20-%20Microsoft%20Channel%209%20Video%22%3E%3C%2FIFRAME%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EWith%20automation%20in%20place%2C%20you%20can%20automatically%20correct%20few%20errors%20across%20large%20estates%20and%20could%20leverage%20relevant%20notification%20mechanisms%20to%20track%20and%20fix%20others%2C%20thereby%20making%20sure%20that%20your%20backup%20estate%20is%20always%20healthy.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId-205269109%22%20id%3D%22toc-hId-204442429%22%3ESummary%3C%2FH1%3E%0A%3CP%3EAzure%20Backup%20offers%20various%20automation%20at-scale%20options%20such%20as%20Integration%20with%20Azure%20Policy%2C%20Azure%20Resource%20Graph%20and%20Azure%20Monitor%20to%20govern%20and%20monitor%20large%20backup%20estates%20across%20subscriptions%20and%20tenants.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId--1602185354%22%20id%3D%22toc-hId--1603012034%22%3EResources%3C%2FH1%3E%0A%3CUL%3E%0A%3CLI%3ELearn%20more%20about%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fazure%2Fbackup%2Fcreate-manage-azure-services-using-azure-command-line-interface%3FWT.mc_id%3Dmodinfra-29115-thmaure%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EAutomation%3C%2FA%3E%20in%20Azure%20Backup.%3C%2FLI%3E%0A%3CLI%3ELearn%20more%20about%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fazure%2Fbackup%2Fbackup-overview%3FWT.mc_id%3Dmodinfra-29115-thmaure%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EAzure%20Backup%3C%2FA%3E.%3C%2FLI%3E%0A%3CLI%3EFollow%20us%20on%20twitter%20%3CA%20href%3D%22https%3A%2F%2Ftwitter.com%2Fazurebackup%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3E%40AzureBackup%3C%2FA%3E%20for%20more%20updates.%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3ECome%20chat%20with%20us%20to%20provide%20feedback%20on%20Azure%20Backup!%20We%E2%80%99re%20hosting%20a%20Product%20Roundtable%20during%20Build%20on%20Wednesday%2C%20May%2026%2C%20%3CSPAN%3E6%3A30-7%3A30%20AM%20PT%3C%2FSPAN%3E.%20%3CA%20href%3D%22https%3A%2F%2Fsessions.mybuild.microsoft.com%2Fsessions%2Fdetails%2Fbfab9821-8d54-47db-91a1-cce30507c204%3FWT.mc_id%3Dmodinfra-29115-thmaure%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EAzure%20Backup%3A%20automation%20and%20security%20considerations%20for%20databases%20and%20storage%3C%2FA%3E.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-2374823%22%20slang%3D%22en-US%22%3E%3CP%3EBackup%20management%20operations%20at-scale%20will%20become%20more%20complex%20and%20prone%20to%20human%20error.%20Use%20Automation%20to%20efficiently%20manage%20and%20govern%20your%20backup%20estate%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-center%22%20image-alt%3D%22Azure%20Backup%20Management%20at%20Scale.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F283433i8ACFCB04C93603FB%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22Azure%20Backup%20Management%20at%20Scale.png%22%20alt%3D%22Azure%20Backup%20Automation%22%20%2F%3E%3CSPAN%20class%3D%22lia-inline-image-caption%22%20onclick%3D%22event.preventDefault()%3B%22%3EAzure%20Backup%20Automation%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-TEASER%3E
Version history
Last update:
‎May 25 2021 08:29 AM
Updated by: