Home
%3CLINGO-SUB%20id%3D%22lingo-sub-1088337%22%20slang%3D%22en-US%22%3EExperiencing%20Alerting%20failure%20for%20Log%20Search%20Alerts%20in%20East%20US%20-%2001%2F04%20-%20Resolved%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1088337%22%20slang%3D%22en-US%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20rgb(0%2C%200%2C%200)%3B%20font-family%3A%20%26amp%3Bquot%3BHelvetica%20Neue%26amp%3Bquot%3B%2CHelvetica%2CArial%2Csans-serif%3B%20font-size%3A%2014px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20400%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3E%3CU%20style%3D%22box-sizing%3A%20border-box%3B%22%3EFinal%20Update%3C%2FU%3E%3A%20Saturday%2C%2004%20January%202020%2012%3A22%20UTC%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3EWe've%20confirmed%20that%20all%20systems%20are%20back%20to%20normal%20with%20no%20customer%20impact%20as%20of%2001%2F04%2C%2010%3A20%20UTC.%20Our%20logs%20show%20the%20incident%20started%20on%2001%2F04%2C%2009%3A20%20UTC%20and%20that%20during%20the%201%20hour%20that%20it%20took%20to%20resolve%20the%20issue%20some%20of%20customers%20may%20have%20experienced%20Alerting%20failure%20and%20Delayed%20alerts%20in%20East%20US.%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E%3CUL%20style%3D%22box-sizing%3A%20border-box%3B%20margin-bottom%3A%2010px%3B%20margin-top%3A%200px%3B%22%3E%0A%20%3CLI%20style%3D%22box-sizing%3A%20border-box%3B%22%3E%3CU%20style%3D%22box-sizing%3A%20border-box%3B%22%3ERoot%20Cause%3C%2FU%3E%3A%20The%20failure%20was%20due%20to%20an%20issue%20in%20%3CSPAN%20style%3D%22background-color%3A%20rgb(255%2C%20255%2C%20255)%3B%20box-sizing%3A%20border-box%3B%20color%3A%20rgb(51%2C%2051%2C%2051)%3B%20display%3A%20inline%3B%20float%3A%20none%3B%20font-family%3A%20%26amp%3Bquot%3BSegoeUI%26amp%3Bquot%3B%2C%26amp%3Bquot%3BLato%26amp%3Bquot%3B%2C%26amp%3Bquot%3BHelvetica%20Neue%26amp%3Bquot%3B%2CHelvetica%2CArial%2Csans-serif%3B%20font-size%3A%2014px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20300%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3Eone%20of%20our%20dependent%20services.%3C%2FSPAN%3E%26nbsp%3B%3C%2FLI%3E%0A%20%3CLI%20style%3D%22box-sizing%3A%20border-box%3B%22%3E%3CU%20style%3D%22box-sizing%3A%20border-box%3B%22%3EIncident%20Timeline%3C%2FU%3E%3A%201%20Hour%26nbsp%3B%20-%2001%2F04%2C%2009%3A20%20UTC%20through%2001%2F04%2C%2010%3A20%20UTC%3C%2FLI%3E%0A%3C%2FUL%3EWe%20understand%20that%20customers%20rely%20on%20Log%20Search%20Alerts%20as%20a%20critical%20service%20and%20apologize%20for%20any%20impact%20this%20incident%20caused.%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E-Satya%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-bottom-color%3A%20currentColor%3B%20border-bottom-style%3A%20none%3B%20border-bottom-width%3A%200px%3B%20border-image-outset%3A%200%3B%20border-image-repeat%3A%20stretch%3B%20border-image-slice%3A%20100%25%3B%20border-image-source%3A%20none%3B%20border-image-width%3A%201%3B%20border-left-color%3A%20currentColor%3B%20border-left-style%3A%20none%3B%20border-left-width%3A%200px%3B%20border-right-color%3A%20currentColor%3B%20border-right-style%3A%20none%3B%20border-right-width%3A%200px%3B%20border-top-color%3A%20lightgray%3B%20border-top-style%3A%20solid%3B%20border-top-width%3A%201px%3B%20box-sizing%3A%20content-box%3B%20color%3A%20rgb(0%2C%200%2C%200)%3B%20font-family%3A%20%26amp%3Bquot%3BHelvetica%20Neue%26amp%3Bquot%3B%2CHelvetica%2CArial%2Csans-serif%3B%20font-size%3A%2014px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20400%3B%20height%3A%200px%3B%20letter-spacing%3A%20normal%3B%20margin-bottom%3A%2020px%3B%20margin-top%3A%2020px%3B%20orphans%3A%202%3B%20text-align%3A%20center%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%20%2F%3E%3CDIV%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20rgb(0%2C%200%2C%200)%3B%20font-family%3A%20%26amp%3Bquot%3BHelvetica%20Neue%26amp%3Bquot%3B%2CHelvetica%2CArial%2Csans-serif%3B%20font-size%3A%2014px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20400%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3E%3CDIV%20style%3D%22box-sizing%3A%20border-box%3B%20font-size%3A%2014px%3B%22%3E%3CDIV%20style%3D%22box-sizing%3A%20border-box%3B%20font-size%3A%2014px%3B%22%3E%3CU%20style%3D%22box-sizing%3A%20border-box%3B%22%3EInitial%20Update%3C%2FU%3E%3A%20Saturday%2C%2004%20January%202020%2010%3A53%20UTC%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3EWe%20are%20aware%20of%20issues%20within%20Log%20Search%20Alerts%20and%20are%20actively%20investigating.%20Some%20customers%20in%20East%20US%20may%20experience%20may%20experience%20delayed%20alerts%20or%20Alerting%20failure%20during%20the%20impact%20.%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E%3CUL%20style%3D%22box-sizing%3A%20border-box%3B%20margin-bottom%3A%2010px%3B%20margin-top%3A%200px%3B%22%3E%3CLI%20style%3D%22box-sizing%3A%20border-box%3B%22%3E%3CU%20style%3D%22box-sizing%3A%20border-box%3B%22%3EWork%20Around%3C%2FU%3E%3A%26nbsp%3B%3C%2FLI%3E%3CLI%20style%3D%22box-sizing%3A%20border-box%3B%22%3E%3CU%20style%3D%22box-sizing%3A%20border-box%3B%22%3ENext%20Update%3C%2FU%3E%3A%20Before%2001%2F04%2013%3A00%20UTC%3C%2FLI%3E%3C%2FUL%3EWe%20are%20working%20hard%20to%20resolve%20this%20issue%20and%20apologize%20for%20any%20inconvenience.%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E-Madhuri%3C%2FDIV%3E%3CHR%20style%3D%22border-bottom-color%3A%20currentColor%3B%20border-bottom-style%3A%20none%3B%20border-bottom-width%3A%200px%3B%20border-image-outset%3A%200%3B%20border-image-repeat%3A%20stretch%3B%20border-image-slice%3A%20100%25%3B%20border-image-source%3A%20none%3B%20border-image-width%3A%201%3B%20border-left-color%3A%20currentColor%3B%20border-left-style%3A%20none%3B%20border-left-width%3A%200px%3B%20border-right-color%3A%20currentColor%3B%20border-right-style%3A%20none%3B%20border-right-width%3A%200px%3B%20border-top-color%3A%20lightgray%3B%20border-top-style%3A%20solid%3B%20border-top-width%3A%201px%3B%20box-sizing%3A%20content-box%3B%20height%3A%200px%3B%20margin-bottom%3A%2020px%3B%20margin-top%3A%2020px%3B%22%20%2F%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1088337%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3ELog%20Search%20Alerts%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Final Update: Saturday, 04 January 2020 12:22 UTC

We've confirmed that all systems are back to normal with no customer impact as of 01/04, 10:20 UTC. Our logs show the incident started on 01/04, 09:20 UTC and that during the 1 hour that it took to resolve the issue some of customers may have experienced Alerting failure and Delayed alerts in East US.
  • Root Cause: The failure was due to an issue in one of our dependent services. 
  • Incident Timeline: 1 Hour  - 01/04, 09:20 UTC through 01/04, 10:20 UTC
We understand that customers rely on Log Search Alerts as a critical service and apologize for any impact this incident caused.

-Satya

Initial Update: Saturday, 04 January 2020 10:53 UTC

We are aware of issues within Log Search Alerts and are actively investigating. Some customers in East US may experience may experience delayed alerts or Alerting failure during the impact .
  • Work Around
  • Next Update: Before 01/04 13:00 UTC
We are working hard to resolve this issue and apologize for any inconvenience.
-Madhuri