Final Update: Thursday, 18 November 2021 00:02 UTC
We've confirmed that all systems are back to normal with no customer impact as of 11/17, 19:20 UTC. Our logs show that the incident started on 11/16, 18:00 UTC and that during the 25 hours and 20 minutes that it took to resolve the issue some of the customers experienced delayed or missed Log Search Alerts and issues accessing data in West Central US region.
-Saika
We've confirmed that all systems are back to normal with no customer impact as of 11/17, 19:20 UTC. Our logs show that the incident started on 11/16, 18:00 UTC and that during the 25 hours and 20 minutes that it took to resolve the issue some of the customers experienced delayed or missed Log Search Alerts and issues accessing data in West Central US region.
- Root Cause: The failure was due to an issue in one of our dependent services.
- Incident Timeline: 25 Hours & 20 minutes - 11/16, 18:00 UTC through 11/17, 19:20 UTC
-Saika
Update: Wednesday, 17 November 2021 20:54 UTC
Root cause has been isolated to recent change in one of our backend services which was impacting Azure Log Analytics. To address this issue we are rolling back the change. Some customers may still experience delayed or missed Log Search Alerts and issues accessing data in West Central US region and we estimate ~2 hours before all the issues are addressed.
Root cause has been isolated to recent change in one of our backend services which was impacting Azure Log Analytics. To address this issue we are rolling back the change. Some customers may still experience delayed or missed Log Search Alerts and issues accessing data in West Central US region and we estimate ~2 hours before all the issues are addressed.
- Work Around: None
- Next Update: Before 11/18 00:00 UTC
Initial Update: Wednesday, 17 November 2021 18:10 UTC
We are aware of issues within Log Analytics and are actively investigating. Some customers may experience delayed or missed Log Search Alerts and issues accessing data in West Central US.
-Saika
We are aware of issues within Log Analytics and are actively investigating. Some customers may experience delayed or missed Log Search Alerts and issues accessing data in West Central US.
- Work Around: None
- Next Update: Before 11/17 21:30 UTC
-Saika
Updated Nov 18, 2021
Version 3.0