Experiencing Alerting failure issue in Azure Portal for Many Data Types - 10/04 - Resolved

[Azure-Monitor-Team]

First published on MSDN on Oct 04, 2018

Final Update: Thursday, 04 October 2018 21:52 UTC

We confirm that all systems are back to normal and customers should experience no errors with Availability tests in Application Insights from 10/04 20:00 UTC. Our logs show the incident started on 10/04 08:00 UTC and that during the 12 hours that it took to resolve the issue customers would have experienced no availabilty results from East Japan, SouthBrazil and SouthUk regions. From all other GSM regions, customer may have noticed some webtest failures as well.

• Root Cause: The failure was due to one of our dependent services failures, which took time to resolve since the  mitigation was applied region by region by guaging the impact carefully.
• Incident Timeline: ~12hrs - 10/04 08:00 UTC through 10/04 20:00 UTC

We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Vishal Suram

Update: Thursday, 04 October 2018 18:37 UTC

All availability tests in East Japan, Brazil South and South UK regions would have been impacted. Customers may have also noticed some missing web test results from other all GSM regions.

Mitigation is in progress region by region as we notice the issues in them. As of now, the issue is completely resolved for East Japan, Brazil South and South UK regions and customers should no longer experience errors in these regions, however customers may still notice some missing webtest results other regions, but mostly all of the other regions should be back as well. We are continuing to monitor other GSM regions to completely mitigate this issue for our customers.

We estimate another 2 hours to get this completely addressed.

• Work Around: NA
• Next Update: Before 10/04 20:45 UTC

-Vishal Suram

Intial Update: Thursday, 04 October 2018 16:45 UTC

We are aware of issues within Application Insights and are actively investigating. Some customers in

1) Japan East

2) North Central US

3) Southeast Asia

4) Brazil South

5) Central US

6) East Asia

regions may experience availability test issues in Azure Portal.

• Work Around: None
• Next Update: Before 10/04 18:45 UTC

We are working hard to resolve this issue and apologize for any inconvenience.

-Vishal Suram