Experiencing Data Latency issue in Application Insights - 06/10 - Resolved

[Azure-Monitor-Team]

Final Update: Tuesday, 14 June 2022 17:36 UTC

We've confirmed that all systems are back to normal with no customer impact as of 6/14, 04:00 UTC. Our logs show the incident started on 5/24, 13:33 UTC and customers using Application Insights who have configured their own Storage accounts to be used by the Application Insights Profiler and Snapshot Debugger (Bring Your Own Storage - BYOS) may have experienced data gaps and incorrect alert activation.

• Root Cause: The failure was due to code defect in our earlier deployment and a hotfix was rolled out to mitigate this issue
• Incident Timeline: 20 days, 14 Hours & 27 minutes - 5/24, 13:33 UTC through 6/14, 04:00 UTC
  

We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Robin Paul

---

Update: Saturday, 11 June 2022 00:14 UTC

A hotfix rollout deployment is in progress to mitigate and expected to complete by Tuesday June14th, 2022. At this time some customers may see signs of recovery. 

The next update will be provided on 14 Jun 2022, or as events warrant.

• Next Update: On 06/14/2022

- Yukti Sharma

______________________________________________________________

Initial Update: Friday, 10 June 2022 01:33 UTC

Customers with Application Insights components who have configured their own Storage accounts to be used by Application Insights Profiler and Snapshot Debugger (Bring Your Own Storage - BYOS), may have experienced intermittent data gaps and incorrect alert activation.

• Impact Start time: 5/24/2022 13:33 UTC

• Impacted Region: Global

• Root cause: We have identified a code defect in our earlier deployment which caused the issue.

• Work Around: We’re rolling out a hotfix deployment to mitigate and expect that this will take at least 48 hours to complete. The next update will be provided in 24 hours, or as events warrant.

• Next Update: Before 06/11 00:00 UTC

We are working hard to resolve this issue and apologize for any inconvenience.
-Vignesh

---