Home
%3CLINGO-SUB%20id%3D%22lingo-sub-870850%22%20slang%3D%22en-US%22%3EExperiencing%20Alerting%20failure%20issue%20in%20Azure%20Portal%20for%20Moon%20Cake%20Environment%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-870850%22%20slang%3D%22en-US%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EInitial%20Update%3C%2FU%3E%3A%20Monday%2C%2023%20September%202019%2018%3A24%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3EWe%20are%20aware%20of%20issues%20within%20Azure%20Monitoring%20and%20are%20actively%20investigating.%20Some%20customers%20may%20experience%20notifications%20not%20being%20delivered%20for%20Azure%20Metric%20Alerts.%20As%20per%20initial%20findings%20the%20issue%20was%20estimated%20to%20start%20on%209%2F11%2014%3A11%20UTC.%3CUL%3E%3CLI%3E%3CU%3ENext%20Update%3C%2FU%3E%3A%20Before%2009%2F23%2022%3A30%20UTC%3C%2FLI%3E%3C%2FUL%3EWe%20are%20working%20hard%20to%20resolve%20this%20issue%20and%20apologize%20for%20any%20inconvenience.%3CBR%20%2F%3E-Jayadev%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-870850%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EApplication%20Insights%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EAzure%20Log%20Analytics%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Final Update: Tuesday, 24 September 2019 02:55 UTC

We've confirmed that all systems are back to normal with all customers mitigated as of 09/24, 02:36 UTC. Our logs show the incident started on 09/11, 14:11 UTC and that during the time that it took to resolve the issue some customers experienced issue with notifications not being delivered for metric alerts in Azure China Region.
  • Root Cause: The failure was due to configuration issue in one of the dependent services.
  • Incident Timeline: 12 Days,12 Hours & 25 minutes - 09/11, 14:11 UTC through 09/24, 02:36 UTC
We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Jayadev

Update: Monday, 23 September 2019 21:50 UTC

Root cause has been isolated to be a configuration issue in one of our dependent services which was impacting notifications not being delivered for Azure Metric Alerts. To address this issue we are deploying a hotfix. Some customers may still be experiencing issue with alert notifications not being delivered and we estimate ~ 6 hours before this issue is fully resolved.
  • Next Update: Before 09/24 04:00 UTC
-Jayadev

Initial Update: Monday, 23 September 2019 18:24 UTC

We are aware of issues within Azure Monitoring and are actively investigating. Some customers may experience notifications not being delivered for Azure Metric Alerts. As per initial findings the issue was estimated to start on 9/11 14:11 UTC.
  • Next Update: Before 09/23 22:30 UTC
We are working hard to resolve this issue and apologize for any inconvenience.
-Jayadev