Final Update: Tuesday, 27 April 2021 00:04 UTC
We've confirmed that all systems are back to normal with no customer impact as of 04/26, 23:20 UTC. Our logs show the incident started on 04/26, 20:20 UTC and that during the 3 hours that it took to resolve the issue some customers using Application Insights in West US 2 Region may have experienced intermittent metric data gaps and incorrect alert activation. Customers using Log Analytics Workspace-based Application Insights resources may experience log data gaps and incorrect alert activation. Additionally, customers using Custom Metrics (Preview) may experience data gaps and incorrect alert activation.
-Jayadev
We've confirmed that all systems are back to normal with no customer impact as of 04/26, 23:20 UTC. Our logs show the incident started on 04/26, 20:20 UTC and that during the 3 hours that it took to resolve the issue some customers using Application Insights in West US 2 Region may have experienced intermittent metric data gaps and incorrect alert activation. Customers using Log Analytics Workspace-based Application Insights resources may experience log data gaps and incorrect alert activation. Additionally, customers using Custom Metrics (Preview) may experience data gaps and incorrect alert activation.
- Root Cause: The failure was due to issues with one of the backend services.
- Incident Timeline: 3 Hours - 04/26, 20:20 UTC through 04/26, 23:20 UTC
-Jayadev
Update: Monday, 26 April 2021 22:42 UTC
Root cause has been isolated to data loss for metric data in Application Insights. We found a root cause where the dependent service responsible for processing this data had a storage account which became unhealthy and unavailable to process any data. We are recreating this storage account, and once it is validated, this issue should be mitigated.
Root cause has been isolated to data loss for metric data in Application Insights. We found a root cause where the dependent service responsible for processing this data had a storage account which became unhealthy and unavailable to process any data. We are recreating this storage account, and once it is validated, this issue should be mitigated.
- Work Around: none
- Next Update: Before 04/27 01:00 UTC
Initial Update: Monday, 26 April 2021 20:56 UTC
We are aware of issues within Application Insights and are actively investigating. Some customers in West US 2 may experience data loss for metric data. This may cause failed or misfired alerts.
-Ian
We are aware of issues within Application Insights and are actively investigating. Some customers in West US 2 may experience data loss for metric data. This may cause failed or misfired alerts.
- Work Around: none
- Next Update: Before 04/26 23:00 UTC
-Ian
Updated Apr 27, 2021
Version 4.0