Experiencing Data Latency Issue in Azure portal for Log Analytics - Resolved

Published Sep 30 2020 06:55 PM 1,139 Views
Final Update: Thursday, 01 October 2020 02:06 UTC

We've confirmed that all systems are back to normal with no customer impact as of 10/01, 02:09 UTC. Our logs show the incident started on 09/30,19:50 UTC and that during the 6 hours and 19 minutes that it took to resolve the issue some of the customers in West Central US, Australia South East regions may have experienced issues with Data Latency in AzureDiagnostics and AzureMetrics which may cause misfiring of alerts.
  • Root Cause: The failure was due to an issue with the recent deployment.
  • Incident Timeline: 6 Hours & 19 minutes - 09/30, 19:50 UTC through 10/01, 02:09 UTC
We understand that customers rely on Azure Log Analytics as a critical service and apologize for any impact this incident caused.

-Jayadev

Initial Update: Thursday, 01 October 2020 01:47 UTC

We are aware of issues within Log Analytics and are actively investigating. Some customers in West Central US, Australia south East regions may experience issues with Data Latency in AzureDiagnostics and AzureMetrics which may cause misfiring of alerts. 
  • Work Around: none
  • Next Update: Before 10/01 04:00 UTC
We are working hard to resolve this issue and apologize for any inconvenience.
-Vincent

%3CLINGO-SUB%20id%3D%22lingo-sub-1732989%22%20slang%3D%22en-US%22%3EExperiencing%20Data%20Latency%20Issue%20in%20Azure%20portal%20for%20Log%20Analytics%20-%20Resolved%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1732989%22%20slang%3D%22en-US%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EFinal%20Update%3C%2FU%3E%3A%20Thursday%2C%2001%20October%202020%2002%3A06%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3EWe've%20confirmed%20that%20all%20systems%20are%20back%20to%20normal%20with%20no%20customer%20impact%20as%20of%2010%2F01%2C%2002%3A09%20UTC.%20Our%20logs%20show%20the%20incident%20started%20on%2009%2F30%2C19%3A50%20UTC%20and%20that%20during%20the%206%20hours%20and%2019%20minutes%20that%20it%20took%20to%20resolve%20the%20issue%20some%20of%20the%20customers%20in%20West%20Central%20US%2C%20Australia%20South%20East%20regions%20may%20have%20experienced%20issues%20with%20Data%20Latency%20in%20AzureDiagnostics%20and%20AzureMetrics%20which%20may%20cause%20misfiring%20of%20alerts.%3CBR%20%2F%3E%3CUL%3E%3CLI%3E%3CU%3ERoot%20Cause%3C%2FU%3E%3A%20The%20failure%20was%20due%20to%20an%20issue%20with%20the%20recent%20deployment.%3C%2FLI%3E%3CLI%3E%3CU%3EIncident%20Timeline%3C%2FU%3E%3A%206%20Hours%20%26amp%3B%2019%20minutes%20-%2009%2F30%2C%2019%3A50%20UTC%20through%2010%2F01%2C%2002%3A09%20UTC%3C%2FLI%3E%3C%2FUL%3EWe%20understand%20that%20customers%20rely%20on%20Azure%20Log%20Analytics%20as%20a%20critical%20service%20and%20apologize%20for%20any%20impact%20this%20incident%20caused.%3CBR%20%2F%3E%3CBR%20%2F%3E-Jayadev%3CBR%20%2F%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EInitial%20Update%3C%2FU%3E%3A%20Thursday%2C%2001%20October%202020%2001%3A47%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3EWe%20are%20aware%20of%20issues%20within%20Log%20Analytics%20and%20are%20actively%20investigating.%20Some%20customers%20in%20West%20Central%20US%2C%20Australia%20south%20East%20regions%20may%20experience%20issues%20with%20Data%20Latency%20in%20AzureDiagnostics%20and%20AzureMetrics%26nbsp%3B%3CSPAN%20style%3D%22font-family%3A%20Helvetica%3B%22%3Ewhich%20may%20cause%20misfiring%20of%20alerts.%26nbsp%3B%3C%2FSPAN%3E%3CBR%20%2F%3E%3CUL%3E%3CLI%3E%3CU%3EWork%20Around%3C%2FU%3E%3A%20none%3C%2FLI%3E%3CLI%3E%3CU%3ENext%20Update%3C%2FU%3E%3A%20Before%2010%2F01%2004%3A00%20UTC%3C%2FLI%3E%3C%2FUL%3EWe%20are%20working%20hard%20to%20resolve%20this%20issue%20and%20apologize%20for%20any%20inconvenience.%3CBR%20%2F%3E-Vincent%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1732989%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAzure%20Log%20Analytics%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Version history
Last update:
‎Sep 30 2020 08:49 PM
Updated by: