Home
%3CLINGO-SUB%20id%3D%22lingo-sub-363033%22%20slang%3D%22en-US%22%3EData%20Gaps%20appear%20in%20Azure%20Portal%20for%20Web%20test%20results%20in%20West%20US%20-%2003%2F07%20-%20Resolved%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-363033%22%20slang%3D%22en-US%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3EThursday%2C%2007%20March%202019%2023%3A00%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3EWe've%20confirmed%20that%20all%20systems%20are%20back%20to%20normal%20as%20of%2003%2F07%2C%2022%3A00%20UTC.%20Our%20logs%20show%20the%20incident%20started%20on%2003%2F05%2C%2018%3A00%20UTC%20and%20during%20that%20timeline%2C%20customers%20in%20%3CU%3EWest%20US%3C%2FU%3E%20region%20may%20have%20missed%20results%20intermittently%20from%20Web%20tests%20that%20ran.%3CBR%20%2F%3E%3CUL%3E%3CLI%3E%3CU%3ERoot%20Cause%3C%2FU%3E%3A%20The%20failure%20was%20due%20to%20client%20side%20connections%20not%20getting%20reset%20when%20endpoint%20configurations%20changed.%3C%2FLI%3E%3CLI%3E%3CU%3ELessons%20Learned%3C%2FU%3E%3A%20Connection%20persistency%20between%20services%20needs%20to%20be%20evaluated%20and%20fixed.%3C%2FLI%3E%3CLI%3E%3CU%3EIncident%20Timeline%3C%2FU%3E%3A%20%3CSPAN%20style%3D%22display%3A%20inline%20!important%3B%20float%3A%20none%3B%20background-color%3A%20rgb(255%2C%20255%2C%20255)%3B%20color%3A%20rgb(0%2C%200%2C%200)%3B%20font-family%3A%20%26quot%3BHelvetica%20Neue%26quot%3B%2CHelvetica%2CArial%2Csans-serif%3B%20font-size%3A%2014px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20400%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3E03%2F05%2C%2018%3A00%20UTC%3C%2FSPAN%3E%20through%20%3CSPAN%20style%3D%22display%3A%20inline%20!important%3B%20float%3A%20none%3B%20background-color%3A%20rgb(255%2C%20255%2C%20255)%3B%20color%3A%20rgb(0%2C%200%2C%200)%3B%20font-family%3A%20%26quot%3BHelvetica%20Neue%26quot%3B%2CHelvetica%2CArial%2Csans-serif%3B%20font-size%3A%2014px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20400%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3E03%2F07%2C%2022%3A00%20UTC%3C%2FSPAN%3E%3C%2FLI%3E%3C%2FUL%3EWe%20understand%20that%20customers%20rely%20on%20Application%20Insights%20as%20a%20critical%20service%20and%20apologize%20for%20any%20impact%20this%20incident%20caused.%3CBR%20%2F%3E%3CBR%20%2F%3E-Chandar.%3CBR%20%2F%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3C%2FDIV%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-363033%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EApplication%20Insights%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Thursday, 07 March 2019 23:00 UTC

We've confirmed that all systems are back to normal as of 03/07, 22:00 UTC. Our logs show the incident started on 03/05, 18:00 UTC and during that timeline, customers in West US region may have missed results intermittently from Web tests that ran.
  • Root Cause: The failure was due to client side connections not getting reset when endpoint configurations changed.
  • Lessons Learned: Connection persistency between services needs to be evaluated and fixed.
  • Incident Timeline: 03/05, 18:00 UTC through 03/07, 22:00 UTC
We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Chandar.