%3CLINGO-SUB%20id%3D%22lingo-sub-1421551%22%20slang%3D%22en-US%22%3EExperiencing%20issues%20in%20Log%20Search%20Alerts%20and%20Service%20Map%2FVM%20Insights-%2005%2F27%20-%20Resolved%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1421551%22%20slang%3D%22en-US%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EFinal%20Update%3C%2FU%3E%3A%20Wednesday%2C%2027%20May%202020%2018%3A59%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3EWe've%20confirmed%20that%20all%20systems%20are%20back%20to%20normal%20in%20West%20US%2C%20West%20US2%2C%20North%20Central%20US%2C%20Central%20US%20and%20South%20Central%20US%20regions%20as%20of%2005%2F27%2C%2018%3A59%20UTC.%20Our%20logs%20show%20the%20incident%20started%20on%2005%2F27%2C%2007%3A45%20UTC%20and%20that%20during%20the%2010%20hours%2030%20minutes%20that%20it%20took%20to%20resolve%20the%20issue%20some%20Log%20Search%20Alerts%20customers%20may%20have%20experienced%20missed%20or%20delayed%20Log%20Search%20alerts%20or%20experienced%20difficulties%20accessing%20data%20for%20resources%20hosted%20in%20the%20impacted%20regions.%20Very%20small%20number%20of%20users%20of%20VMInsights%2FServiceMap%20may%20experience%20slow%20presentation%20or%20intermittent%20failures%20of%20Dependency%20Maps.%3C%2FDIV%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CUL%3E%0A%20%3CLI%3E%3CU%3E%3CSPAN%20style%3D%22font-size%3A%2010.5pt%3B%20font-family%3A%20Helvetica%2C%20sans-serif%3B%22%3ERoot%20Cause%3C%2FSPAN%3E%3C%2FU%3E%3CSPAN%20style%3D%22font-size%3A%2010.5pt%3B%20font-family%3A%20Helvetica%2C%20sans-serif%3B%22%3E%3A%20The%20failure%20was%20due%20to%20issue%20in%20one%20of%20our%20dependent%20services.%3C%2FSPAN%3E%3C%2FLI%3E%0A%20%3CLI%3E%3CU%3EIncident%20Timeline%3C%2FU%3E%3A%2010%20Hours%20%26amp%3B%2030%20minutes%20-%2005%2F27%2C%2007%3A45%20UTC%26nbsp%3Bthrough%2005%2F27%2C%2018%3A15%20UTC%3C%2FLI%3E%0A%3C%2FUL%3EWe%20understand%20that%20customers%20rely%20on%20Log%20Search%20Alerts%20as%20a%20critical%20service%20and%20apologize%20for%20any%20impact%20this%20incident%20caused.%3CBR%20%2F%3E%3CBR%20%2F%3E-Sindhu%3CBR%20%2F%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%3E%3CBR%20%2F%3E%3C%2FDIV%3E%3CDIV%3EInitial%20Update%3A%20Wednesday%2C%2027%20May%202020%2017%3A31%20UTC%3C%2FDIV%3E%3CDIV%3E%3CBR%20%2F%3E%3C%2FDIV%3E%3CDIV%3EWe%20are%20aware%20of%20issues%20within%20Log%20Search%20Alerts%20and%20Service%20Map%20in%20regions%20West%20US%2C%20West%20US2%2C%20North%20Central%20US%2C%20Central%20US%20and%20South%20Central%20US%20and%20are%20actively%20investigating.%20Some%20Log%20Search%20Alerts%20customers%20may%20experience%20missed%20or%20delayed%20Log%20Search%20alerts%20or%20experienced%20difficulties%20accessing%20data%20for%20resources%20hosted%20in%20the%20impacted%20regions.%20Some%20users%20of%20VMInsights%2FServiceMap%20may%20experience%20slow%20presentation%20or%20intermittent%20failures%20of%20Dependency%20Maps.%3C%2FDIV%3E%3CDIV%3EWork%20Around%3A%20None%3C%2FDIV%3E%3CDIV%3ENext%20Update%3A%20Before%2005%2F27%2022%3A00%20UTC%3C%2FDIV%3E%3CDIV%3EWe%20are%20working%20hard%20to%20resolve%20this%20issue%20and%20apologize%20for%20any%20inconvenience.%3C%2FDIV%3E%3CDIV%3E-Sindhu%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1421551%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3ELog%20Search%20Alerts%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EService%20Map%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Final Update: Wednesday, 27 May 2020 18:59 UTC

We've confirmed that all systems are back to normal in West US, West US2, North Central US, Central US and South Central US regions as of 05/27, 18:59 UTC. Our logs show the incident started on 05/27, 07:45 UTC and that during the 10 hours 30 minutes that it took to resolve the issue some Log Search Alerts customers may have experienced missed or delayed Log Search alerts or experienced difficulties accessing data for resources hosted in the impacted regions. Very small number of users of VMInsights/ServiceMap may experience slow presentation or intermittent failures of Dependency Maps.
  • Root Cause: The failure was due to issue in one of our dependent services.
  • Incident Timeline: 10 Hours & 30 minutes - 05/27, 07:45 UTC through 05/27, 18:15 UTC
We understand that customers rely on Log Search Alerts as a critical service and apologize for any impact this incident caused.

-Sindhu


Initial Update: Wednesday, 27 May 2020 17:31 UTC

We are aware of issues within Log Search Alerts and Service Map in regions West US, West US2, North Central US, Central US and South Central US and are actively investigating. Some Log Search Alerts customers may experience missed or delayed Log Search alerts or experienced difficulties accessing data for resources hosted in the impacted regions. Some users of VMInsights/ServiceMap may experience slow presentation or intermittent failures of Dependency Maps.
Work Around: None
Next Update: Before 05/27 22:00 UTC
We are working hard to resolve this issue and apologize for any inconvenience.
-Sindhu