Experiencing data access issues in Azure Portal for Many Data Types - 06/04 - Resolved

Published Jun 04 2021 10:34 AM 682 Views
Final Update: Friday, 04 June 2021 19:05 UTC

We've confirmed that all systems are back to normal with no customer impact as of 6/4, 18:52 UTC. Our logs show the incident started on 05/28, 18:05 UTC.

Customers using Azure Functions may have been presented with the message, "Click ‘Add Diagnostic setting’ above to configure the collection of the following data"  list of App Service Diagnostics logs when attempting to configure Function Apps to export data using the Diagnostics Preview blade. Customers may have been unable to configure export to Storage, Event Hubs, or Log Analytics for FuntionAppLogs. Existing Diagnostics settings would continue to work.

Root cause: A deployment from a dependent service that Azure Functions relies on was rolled out on 28 May 2021, had caused a configuration change causing configurations to Function Apps for export data using the Diagnostics Preview blade to experience issues.

Mitigation: We rolled out a hotfix to revert the configuration change, mitigating the issue.

We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.


-Jack

Update: Friday, 04 June 2021 18:27 UTC

Customers using Function Apps may be presented with the message, "Click ‘Add Diagnostic setting’ above to configure the collection of the following data"  list of App Service Diagnostics logs when attempting to configure Function Apps to export data using the Diagnostics Preview blade. Customers may be unable to configure export to Storage, Event Hubs, or Log Analytics for FuntionAppLogs. Existing Diagnostics settings will continue to work.

Current Status: We have identified a recent deployment had a configuration change which caused impact to App Services. We have developed and are currently testing a hotfix as a mitigation workstream the next update will be provided in 2 hours, or as events warrant.
  • Next Update: Before 06/04 20:30 UTC
-Jack

Update: Friday, 04 June 2021 18:27 UTC

We continue to investigate issues within Application Insights. Root cause is not fully understood at this time. Some customers continue to experience . We are working to establish the start time for the issue, initial findings indicate that the problem began at . We currently have no estimate for resolution.
  • Work Around:
  • Next Update: Before 06/04 20:30 UTC
-Jack

Initial Update: Friday, 04 June 2021 17:24 UTC

We are aware of issues within Diagnostics Logs and are actively investigating. Customers that want to configure their Function Apps to export data using the Diagnostics Preview blade are unable to configure export to Storage, Event Hubs, or Log Analytics for FunctionAppLogs. Instead they see a list of App Service Diagnostics logs. Note that logs that are already configured will continue to work and this issue just affects users trying to configure new settings or adjust existing ones. This setting is in public preview.

  • Next Update: Before 06/05 07:30 UTC
We are working hard to resolve this issue and apologize for any inconvenience.

-Jack
%3CLINGO-SUB%20id%3D%22lingo-sub-2417091%22%20slang%3D%22en-US%22%3EExperiencing%20data%20access%20issues%20in%20Azure%20Portal%20for%20Many%20Data%20Types%20-%2006%2F04%20-%20Resolved%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2417091%22%20slang%3D%22en-US%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EFinal%20Update%3C%2FU%3E%3A%20Friday%2C%2004%20June%202021%2019%3A05%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3EWe've%20confirmed%20that%20all%20systems%20are%20back%20to%20normal%20with%20no%20customer%20impact%20as%20of%206%2F4%2C%2018%3A52%20UTC.%20Our%20logs%20show%20the%20incident%20started%20on%2005%2F28%2C%2018%3A05%20UTC.%3C%2FDIV%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CBR%20%2F%3E%3C%2FDIV%3E%3CDIV%20style%3D%22%22%3E%3CDIV%20style%3D%22%22%3ECustomers%20using%20Azure%20Functions%20may%20have%20been%20presented%20with%20the%20message%2C%20%22Click%20%E2%80%98Add%20Diagnostic%20setting%E2%80%99%20above%20to%20configure%20the%20collection%20of%20the%20following%20data%22%26nbsp%3B%20list%20of%20App%20Service%20Diagnostics%20logs%20when%20attempting%20to%20configure%20Function%20Apps%20to%20export%20data%20using%20the%20Diagnostics%20Preview%20blade.%20Customers%20may%20have%20been%20unable%20to%20configure%20export%20to%20Storage%2C%20Event%20Hubs%2C%20or%20Log%20Analytics%20for%20FuntionAppLogs.%20Existing%20Diagnostics%20settings%20would%20continue%20to%20work.%3C%2FDIV%3E%3CDIV%20style%3D%22%22%3E%3CBR%20%2F%3E%3C%2FDIV%3E%3CDIV%20style%3D%22%22%3ERoot%20cause%3A%20A%20deployment%20from%20a%20dependent%20service%20that%20Azure%20Functions%20relies%20on%20was%20rolled%20out%20on%2028%20May%202021%2C%20had%20caused%20a%20configuration%20change%20causing%20configurations%20to%20Function%20Apps%20for%20export%20data%20using%20the%20Diagnostics%20Preview%20blade%20to%20experience%20issues.%3C%2FDIV%3E%3CDIV%20style%3D%22%22%3E%3CBR%20%2F%3E%3C%2FDIV%3E%3CDIV%20style%3D%22%22%3EMitigation%3A%20We%20rolled%20out%20a%20hotfix%20to%20revert%20the%20configuration%20change%2C%20mitigating%20the%20issue.%3C%2FDIV%3E%3CBR%20%2F%3E%3CP%3EWe%20understand%20that%20customers%20rely%20on%20Application%20Insights%20as%20a%20critical%20service%20and%20apologize%20for%20any%20impact%20this%20incident%20caused.%3CBR%20%2F%3E%3C%2FP%3E%3CBR%20%2F%3E-Jack%3CBR%20%2F%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%20style%3D%22%22%3E%3CU%20style%3D%22font-size%3A%2014px%3B%22%3EUpdate%3C%2FU%3E%3A%20Friday%2C%2004%20June%202021%2018%3A27%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3E%3CDIV%20style%3D%22%22%3ECustomers%20using%20Function%20Apps%20may%20be%20presented%20with%20the%20message%2C%20%22Click%20%E2%80%98Add%20Diagnostic%20setting%E2%80%99%20above%20to%20configure%20the%20collection%20of%20the%20following%20data%22%26nbsp%3B%20list%20of%20App%20Service%20Diagnostics%20logs%20when%20attempting%20to%20configure%20Function%20Apps%20to%20export%20data%20using%20the%20Diagnostics%20Preview%20blade.%20Customers%20may%20be%20unable%20to%20configure%20export%20to%20Storage%2C%20Event%20Hubs%2C%20or%20Log%20Analytics%20for%20FuntionAppLogs.%20Existing%20Diagnostics%20settings%20will%20continue%20to%20work.%3C%2FDIV%3E%3CDIV%20style%3D%22%22%3E%3CBR%20%2F%3E%3C%2FDIV%3E%3CDIV%20style%3D%22%22%3ECurrent%20Status%3A%20We%20have%20identified%20a%20recent%20deployment%20had%20a%20configuration%20change%20which%20caused%20impact%20to%20App%20Services.%20We%20have%20developed%20and%20are%20currently%20testing%20a%20hotfix%20as%20a%20mitigation%20workstream%20the%20next%20update%20will%20be%20provided%20in%202%20hours%2C%20or%20as%20events%20warrant.%3C%2FDIV%3E%3CUL%20style%3D%22font-size%3A%2014px%3B%22%3E%3CLI%3E%3CU%3ENext%20Update%3C%2FU%3E%3A%20Before%2006%2F04%2020%3A30%20UTC%3C%2FLI%3E%3C%2FUL%3E-Jack%3CBR%20%2F%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CU%3EUpdate%3C%2FU%3E%3A%20Friday%2C%2004%20June%202021%2018%3A27%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3EWe%20continue%20to%20investigate%20issues%20within%20Application%20Insights.%20Root%20cause%20is%20not%20fully%20understood%20at%20this%20time.%20Some%20customers%20continue%20to%20experience%3CIMPACT%20statement%3D%22%22%20from%3D%22%22%20a%3D%22%22%20user%3D%22%22%20perspective%3D%22%22%3E.%20We%20are%20working%20to%20establish%20the%20start%20time%20for%20the%20issue%2C%20initial%20findings%20indicate%20that%20the%20problem%20began%20at%3CMM%20dd%3D%22%22%3E.%20We%20currently%20have%20no%20estimate%20for%20resolution.%3CBR%20%2F%3E%3CUL%3E%3CLI%3E%3CU%3EWork%20Around%3C%2FU%3E%3A%3CNONE%20or%3D%22%22%20details%3D%22%22%3E%3C%2FNONE%3E%3C%2FLI%3E%3CLI%3E%3CU%3ENext%20Update%3C%2FU%3E%3A%20Before%2006%2F04%2020%3A30%20UTC%3C%2FLI%3E%3C%2FUL%3E-Jack%3CBR%20%2F%3E%3C%2FMM%3E%3C%2FIMPACT%3E%3C%2FDIV%3E%3CHR%20style%3D%22border-top-color%3Alightgray%22%20%2F%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3CDIV%3E%3CU%3EInitial%20Update%3C%2FU%3E%3A%20Friday%2C%2004%20June%202021%2017%3A24%20UTC%3CBR%20%2F%3E%3CBR%20%2F%3EWe%20are%20aware%20of%20issues%20within%20Diagnostics%20Logs%20and%20are%20actively%20investigating.%20Customers%20that%20want%20to%20configure%20their%20Function%20Apps%20to%20export%20data%20using%20the%20Diagnostics%20Preview%20blade%20are%20unable%20to%20configure%20export%20to%20Storage%2C%20Event%20Hubs%2C%20or%20Log%20Analytics%20for%20FunctionAppLogs.%20Instead%20they%20see%20a%20list%20of%20App%20Service%20Diagnostics%20logs.%20Note%20that%20logs%20that%20are%20already%20configured%20will%20continue%20to%20work%20and%20this%20issue%20just%20affects%20users%20trying%20to%20configure%20new%20settings%20or%20adjust%20existing%20ones.%20This%20setting%20is%20in%20public%20preview.%3C%2FDIV%3E%3CDIV%3E%3CBR%20%2F%3E%3C%2FDIV%3E%3CDIV%3E%3CUL%3E%3CLI%3E%3CU%3ENext%20Update%3C%2FU%3E%3A%20Before%2006%2F05%2007%3A30%20UTC%3C%2FLI%3E%3C%2FUL%3EWe%20are%20working%20hard%20to%20resolve%20this%20issue%20and%20apologize%20for%20any%20inconvenience.%3C%2FDIV%3E%3CDIV%3E%3CBR%20%2F%3E-Jack%3C%2FDIV%3E%3CDIV%20style%3D%22font-size%3A14px%3B%22%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FLINGO-BODY%3E
Version history
Last update:
‎Jun 04 2021 12:17 PM
Updated by: