Blog Post

Azure Monitor Status Archive
2 MIN READ

Experiencing Service Management issue in Azure Portal for Many Data Types - 06/16 - Resolved

Azure-Monitor-Team's avatar
Azure-Monitor-Team
Former Employee
Jun 16, 2022
Final Update: Saturday, 18 June 2022 00:38 UTC

We've confirmed that all systems are back to normal with no customer impact as of 6/17, 23:53 UTC. Our logs show the incident started on 6/8, 10:17 UTC and that during this period some customers may have experienced issues with your subscriptions that don't have any existing Application Insights resources, creating a new Application Insights resource via Terraform may have failed with error. For customers using portal "Usage and estimated costs" page of the Application Insights resource may not have shown the daily cap information.
 
  • Root Cause: The failure was due to a recent change that caused a backend service to go out of sync. We deployed a hotfix to mitigate this issue.
  • Incident Timeline: 9 days 13 Hours & 36 minutes - 6/8, 10:17 UTC through 6/17, 23:53 UTC
We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Robin Paul

Update: Friday, 17 June 2022 18:56 UTC

We have begun another hotfix deployment as an attempt to mitigate this issue. The first stage of the deployment has been completed and are currently working on next stages for the deployment. The next update will be provided in 6 hours, or as events warrant.

  • Next Update: Before 06/18 01:00 UTC
-Robin Paul

Update: Friday, 17 June 2022 06:55 UTC

We continue to investigate issues within Application Insights. Hotfix deployment for mitigation didn't work. We continue to work on fix. We currently have no estimate for resolution. The next update will be provided in 9 hours or as events warrant.
  • Work Around: None. 
  • Next Update: Before 06/17 19:00 UTC
-Madhuri

Update: Friday, 17 June 2022 01:55 UTC

We have identified a recent change in the dependent backend service as the underlying cause and are currently rolling out a hotfix to mitigate the issue. The next update will be provided in 4 hours or as events warrant.

  • Work Around: Creating a sub-resource (e.g., web test) in the impacted Application Insights component might fix the issue for the whole subscription. If the issue persists, try refreshing the page or opening the impacted blade in a new browser. That sub-resource (e.g., web test) could be deleted immediately once the issue goes away.
  • Next Update: Before 06/17 06:00 UTC
-Robin Paul

Initial Update: Thursday, 16 June 2022 23:30 UTC

We are aware of issues within Application Insights and are actively investigating. Some customers when using subscriptions that don't have any existing Application Insights resources will see failures when creating a new Application Insights resource via Terraform. For customers using Azure portal, the "Usage and estimated costs" page of the Application Insights resource may not show the daily cap information.

  • Next Update: Before 06/17 03:30 UTC
We are working hard to resolve this issue and apologize for any inconvenience.
-Robin Paul

Updated Jun 17, 2022
Version 5.0
No CommentsBe the first to comment