%3CLINGO-SUB%20id%3D%22lingo-sub-1593909%22%20slang%3D%22en-US%22%3EExperiencing%20Microsoft.Insights%20Resource%20Provider%20Registration%20issue%20-%2008%2F17%20-%20Resolved%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1593909%22%20slang%3D%22en-US%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EFinal%20Update%3C%2FU%3E%3A%20Monday%2C%2017%20August%202020%2021%3A48%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3EWe've%20confirmed%20that%20all%20systems%20are%20back%20to%20normal%20with%20no%20customer%20impact%20as%20of%208%2F17%2C%2020%3A51%20UTC.%20Our%20logs%20show%20the%20incident%20started%20on%208%2F11%2C%2010%3A27%20UTC%20and%20that%20during%20the%206%20days%2010%20hours%2024%20minutes%20that%20it%20took%20to%20resolve%20the%20issue%2C%20new%20subscriptions%20or%20customers%20registering%20Application%20Insights%20to%20their%20subscription%20experienced%20their%20request%20to%20register%20their%20subscription%20with%20Microsoft.Insights%20resource%20provider%20not%20completing%20within%20the%20expected%20time%20period.%20This%20would%20result%20in%20that%20subscription%20being%20unable%20to%20utilize%20Application%20Insights.%3CBR%20%2F%3E%3CUL%3E%3CLI%3E%3CU%3ERoot%20Cause%3C%2FU%3E%3A%20The%20failure%20was%20due%20to%20bug%20introduced%20in%20a%20recent%20deployment.%3C%2FLI%3E%3CLI%3E%3CU%3EIncident%20Timeline%3C%2FU%3E%3A%206%20days%2010%20hours%2024%20minutes%26nbsp%3B-%208%2F11%2C%2010%3A27%20UTC%20through%208%2F17%2C%2020%3A51%20UTC%3C%2FLI%3E%3C%2FUL%3EWe%20understand%20that%20customers%20rely%20on%20Application%20Insights%20as%20a%20critical%20service%20and%20apologize%20for%20any%20impact%20this%20incident%20caused.%3CBR%20%2F%3E%3CBR%20%2F%3E-Jeff%3CBR%20%2F%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EUpdate%3C%2FU%3E%3A%20Monday%2C%2017%20August%202020%2020%3A31%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3ERoot%20cause%20has%20been%20isolated%20to%20a%20bug%20introduced%20in%20a%20recent%20deployment%20which%20is%20impacting%20the%20ability%20of%20ARM%20to%20register%20a%20subscription%20with%20Microsoft.Insights%20provider.%20To%20address%20this%20issue%20we%20are%20reverting%20the%20changes%20across%20all%20regions.%3CBR%20%2F%3E%3CUL%3E%3CLI%3E%3CU%3EWork%20Around%3C%2FU%3E%3A%20None%3C%2FLI%3E%3CLI%3E%3CU%3ENext%20Update%3C%2FU%3E%3A%20Before%2008%2F17%2023%3A00%20UTC%3C%2FLI%3E%3C%2FUL%3E-Jeff%3CBR%20%2F%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EInitial%20Update%3C%2FU%3E%3A%20Monday%2C%2017%20August%202020%2018%3A28%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSPAN%20style%3D%22color%3A%20rgb(51%2C%2051%2C%2051)%3B%20font-family%3A%20SegoeUI%2C%20Lato%2C%20%22%20helvetica%3D%22%22%20neue%3D%22%22%3EWe%20are%20aware%20of%20issues%20within%20Application%20Insights%20and%20are%20actively%20investigating.%20Some%20customers%20may%20experience%20the%20request%20getting%20stuck%20when%20attempting%20to%20register%20with%20the%20Microsoft.Insights%20resource%20provider.%3C%2FSPAN%3E%3C%2FDIV%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CBR%20%2F%3E%3CUL%3E%3CLI%3E%3CU%3EWork%20Around%3C%2FU%3E%3A%20None%3C%2FLI%3E%3CLI%3E%3CU%3ENext%20Update%3C%2FU%3E%3A%20Before%2008%2F17%2020%3A30%20UTC%3C%2FLI%3E%3C%2FUL%3EWe%20are%20working%20hard%20to%20resolve%20this%20issue%20and%20apologize%20for%20any%20inconvenience.%3CBR%20%2F%3E-Jeff%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1593909%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EApplication%20Insights%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Final Update: Monday, 17 August 2020 21:48 UTC

We've confirmed that all systems are back to normal with no customer impact as of 8/17, 20:51 UTC. Our logs show the incident started on 8/11, 10:27 UTC and that during the 6 days 10 hours 24 minutes that it took to resolve the issue, new subscriptions or customers registering Application Insights to their subscription experienced their request to register their subscription with Microsoft.Insights resource provider not completing within the expected time period. This would result in that subscription being unable to utilize Application Insights.
  • Root Cause: The failure was due to bug introduced in a recent deployment.
  • Incident Timeline: 6 days 10 hours 24 minutes - 8/11, 10:27 UTC through 8/17, 20:51 UTC
We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Jeff

Update: Monday, 17 August 2020 20:31 UTC

Root cause has been isolated to a bug introduced in a recent deployment which is impacting the ability of ARM to register a subscription with Microsoft.Insights provider. To address this issue we are reverting the changes across all regions.
  • Work Around: None
  • Next Update: Before 08/17 23:00 UTC
-Jeff

Initial Update: Monday, 17 August 2020 18:28 UTC

We are aware of issues within Application Insights and are actively investigating. Some customers may experience the request getting stuck when attempting to register with the Microsoft.Insights resource provider.

  • Work Around: None
  • Next Update: Before 08/17 20:30 UTC
We are working hard to resolve this issue and apologize for any inconvenience.
-Jeff