Experiencing Data Latency Issue in Azure portal for Log Analytics - 06/03 - Resolved

[Azure-Monitor-Team]

Final Update: Thursday, 03 June 2021 09:22 UTC

We've confirmed that all systems are back to normal with no customer impact as of 06/03, 9:15 UTC. Our logs show the incident started on 06/02, 23:53 UTC and that during the 9 hours 22 minutes that it took to resolve the issue, some customers may have experienced issues ingesting telemetry in Log Analytics Workspace and also may have experienced intermittent data latency and incorrect alert activation in US Gov Virginia 

• Root Cause: The failure was due to an issue with our dependent service.
• Incident Timeline: 9 Hours & 22 minutes - 06/02, 23:53 UTC through 06/03, 09:15 UTC.

We understand that customers rely on Azure Log Analytics as a critical service and apologize for any impact this incident caused.

-Mohini

---

Update: Thursday, 03 June 2021 08:43 UTC

Root cause has been isolated to storage issue which was impacting the Ingestion telemetry in the Log Analytics Workspace in US Gov Virginia region. Some customers may continue to experience issues ingesting telemetry in Log Analytics Workspace in US Gov Virginia and also may continue to experience intermittent data latency and incorrect alert activation and we estimate ~1 hour before all issues around telemetry are addressed.

• Work Around: None
• Next Update: Before 06/03 11:00 UTC

-Mohini

---

Final Update: Thursday, 03 June 2021 07:21 UTC

We've confirmed that all systems are back to normal with no customer impact as of 06/03, 6:15 UTC. Our logs show the incident started on 06/02, 23:53 UTC and that during the 6 hours 22 minutes that it took to resolve the issue, some customers may have experienced issues ingesting telemetry in their Log Analytics Workspace in US Gov Virginia and also may have experienced intermittent data latency and incorrect alert activation.

• Root Cause: The failure was due to an issue with our dependent service.
• Incident Timeline: 6 Hours & 22 minutes - 06/02, 23:53 UTC through 06/03, 06:15 UTC.
  

We understand that customers rely on Azure Log Analytics as a critical service and apologize for any impact this incident caused.

-Srikanth

---

Update: Thursday, 03 June 2021 04:56 UTC

We are aware of issues within Azure Log Analytics,  and are actively investigating. Some customers may experience intermittent data latency, data gaps and incorrect alert activation in US Gov Virginia region.

• Work Around: None.
• Next Update: Before 06/03 07:00 UTC.
  

-Srikanth