Home
%3CLINGO-SUB%20id%3D%22lingo-sub-519317%22%20slang%3D%22en-US%22%3EExperiencing%20Issues%20in%20multiple%20locations%20for%20Azure%20Monitor%20services-%2005%2F02%20-%20Resolved%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-519317%22%20slang%3D%22en-US%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EFinal%20Update%3C%2FU%3E%3A%20Friday%2C%2003%20May%202019%2002%3A08%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3EWe've%20confirmed%20that%20all%20systems%20are%20back%20to%20normal%20with%20no%20customer%20impact%20as%20of%2005%2F02%2C%2023%3A30%20UTC.%20Our%20logs%20show%20the%20incident%20started%20on%2005%2F02%2C%2019%3A50%20UTC%20and%20that%20during%20the%203%20hours%2040%20that%20it%20took%20to%20resolve%20the%20issue%26nbsp%3Bsome%20customer%20might%20experienced%20data%20access%2Calerting%20failures%20during%20the%20impacted%20window%20across%20multiple%20regions.%3C%2FDIV%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CBR%20%2F%3E%3CUL%3E%3CLI%3E%3CU%3ERoot%20Cause%3C%2FU%3E%3A%20Root%20cause%20has%20been%20isolated%20to%20DNS%20issue%20that%20has%20impacted%20our%20upstream%20storage%20services%3C%2FLI%3E%3CLI%3E%3CU%3EIncident%20Timeline%3C%2FU%3E%3A%203%20Hours%20%26amp%3B%2040%20minutes%20-%2005%2F02%2C%2019%3A50%20UTC%26nbsp%3Bthrough%2005%2F02%2C%2023%3A30%20UTC%3CBR%20%2F%3E%3C%2FLI%3E%3C%2FUL%3EWe%20understand%20that%20customers%20rely%20on%20Application%20Insights%20as%20a%20critical%20service%20and%20apologize%20for%20any%20impact%20this%20incident%20caused.%3CBR%20%2F%3E%3CBR%20%2F%3E-Venkat%3CBR%20%2F%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EUpdate%3C%2FU%3E%3A%20Thursday%2C%2002%20May%202019%2021%3A38%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3ERoot%20cause%20has%20been%20isolated%20to%20DNS%20issue%20that%20has%20impacted%20our%20upstream%20storage%20services.%20This%20issue%20was%20then%20impacting%20data%20access%20and%20ingestion%20for%20Azure%20monitor%20services.%20To%20address%20this%20issue%20networking%20team%20has%20applied%20mitigation%20and%20most%20of%20our%20services%20are%20on%20recovery%20path.%20Data%20access%20is%20working%20as%20expected%20however%20some%20customer%20may%20continue%20to%20see%20data%20latency%20until%20issue%20is%20fully%20mitigated.%26nbsp%3B%3C%2FDIV%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CBR%20%2F%3E%3C%2FDIV%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CUL%3E%3CLI%3E%3CU%3ENext%20Update%3C%2FU%3E%3A%20Before%2005%2F03%2001%3A00%20UTC%3C%2FLI%3E%3C%2FUL%3E-Arvind%3CBR%20%2F%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20rgb(0%2C%200%2C%200)%3B%20font-family%3A%20%26quot%3BHelvetica%20Neue%26quot%3B%2CHelvetica%2CArial%2Csans-serif%3B%20font-size%3A%2014px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20400%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3E%3CDIV%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20rgb(0%2C%200%2C%200)%3B%20font-size%3A%2014px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20400%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3E%3CU%20style%3D%22box-sizing%3A%20border-box%3B%22%3EInitial%20Update%3C%2FU%3E%3A%20Thursday%2C%2002%20May%202019%2020%3A35%20UTC%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3EWe%20are%20aware%20of%20issues%20within%20Azure%20Monitor%20services%20and%20are%20actively%20investigating.%20Customers%20may%20experience%20data%20Access%20issues%20across%20multiple%20locations.%20We%20provide%20more%20updates%20as%20we%20learn.%3C%2FDIV%3E%3CDIV%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20rgb(0%2C%200%2C%200)%3B%20font-size%3A%2014px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20400%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3E%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E%3C%2FDIV%3E%3CDIV%20style%3D%22box-sizing%3A%20border-box%3B%20color%3A%20rgb(0%2C%200%2C%200)%3B%20font-size%3A%2014px%3B%20font-style%3A%20normal%3B%20font-variant%3A%20normal%3B%20font-weight%3A%20400%3B%20letter-spacing%3A%20normal%3B%20orphans%3A%202%3B%20text-align%3A%20left%3B%20text-decoration%3A%20none%3B%20text-indent%3A%200px%3B%20text-transform%3A%20none%3B%20-webkit-text-stroke-width%3A%200px%3B%20white-space%3A%20normal%3B%20word-spacing%3A%200px%3B%22%3E%3CUL%20style%3D%22box-sizing%3A%20border-box%3B%20margin-bottom%3A%2010px%3B%20margin-top%3A%200px%3B%22%3E%3CLI%20style%3D%22box-sizing%3A%20border-box%3B%22%3E%3CU%20style%3D%22box-sizing%3A%20border-box%3B%22%3ENext%20Update%3C%2FU%3E%3A%20Before%2005%2F02%2023%3A00%20UTC%3C%2FLI%3E%3C%2FUL%3EWe%20are%20working%20hard%20to%20resolve%20this%20issue%20and%20apologize%20for%20any%20inconvenience.%3CBR%20style%3D%22box-sizing%3A%20border-box%3B%22%20%2F%3E-Arvind%3C%2FDIV%3E%3CB%20style%3D%22box-sizing%3A%20border-box%3B%20font-weight%3A%20700%3B%22%3E%3C%2FB%3E%3CI%20style%3D%22box-sizing%3A%20border-box%3B%22%3E%3C%2FI%3E%3CU%20style%3D%22box-sizing%3A%20border-box%3B%22%3E%3C%2FU%3E%3CSUB%20style%3D%22bottom%3A%20-0.25em%3B%20box-sizing%3A%20border-box%3B%20font-size%3A%2075%25%3B%20line-height%3A%200%3B%20position%3A%20relative%3B%20vertical-align%3A%20baseline%3B%22%3E%3C%2FSUB%3E%3CSUP%20style%3D%22box-sizing%3A%20border-box%3B%20font-size%3A%2075%25%3B%20line-height%3A%200%3B%20position%3A%20relative%3B%20top%3A%20-0.5em%3B%20vertical-align%3A%20baseline%3B%22%3E%3C%2FSUP%3E%3CSTRIKE%20style%3D%22box-sizing%3A%20border-box%3B%22%3E%3C%2FSTRIKE%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-519317%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EApplication%20Insights%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Final Update: Friday, 03 May 2019 02:08 UTC

We've confirmed that all systems are back to normal with no customer impact as of 05/02, 23:30 UTC. Our logs show the incident started on 05/02, 19:50 UTC and that during the 3 hours 40 that it took to resolve the issue some customer might experienced data access,alerting failures during the impacted window across multiple regions.

  • Root Cause: Root cause has been isolated to DNS issue that has impacted our upstream storage services
  • Incident Timeline: 3 Hours & 40 minutes - 05/02, 19:50 UTC through 05/02, 23:30 UTC
We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Venkat

Update: Thursday, 02 May 2019 21:38 UTC

Root cause has been isolated to DNS issue that has impacted our upstream storage services. This issue was then impacting data access and ingestion for Azure monitor services. To address this issue networking team has applied mitigation and most of our services are on recovery path. Data access is working as expected however some customer may continue to see data latency until issue is fully mitigated. 

  • Next Update: Before 05/03 01:00 UTC
-Arvind

Initial Update: Thursday, 02 May 2019 20:35 UTC

We are aware of issues within Azure Monitor services and are actively investigating. Customers may experience data Access issues across multiple locations. We provide more updates as we learn.

  • Next Update: Before 05/02 23:00 UTC
We are working hard to resolve this issue and apologize for any inconvenience.
-Arvind