Final Update: Wednesday, 26 May 2021 16:41 UTC
We've confirmed that all systems are back to normal with no customer impact as of 05/26, 15:30 UTC. Our logs show the incident started on 05/26, 07:00 UTC and that during the 8 hours 30 minutes that it took to resolve the issue some of customers experienced some customers may have not been able to perform control plane operation, such as viewing work spaces or solutions via the portal, Powershell or CLI. Delays of data ingestion may also be experienced in USGov Virginia region
-Subhash
We've confirmed that all systems are back to normal with no customer impact as of 05/26, 15:30 UTC. Our logs show the incident started on 05/26, 07:00 UTC and that during the 8 hours 30 minutes that it took to resolve the issue some of customers experienced some customers may have not been able to perform control plane operation, such as viewing work spaces or solutions via the portal, Powershell or CLI. Delays of data ingestion may also be experienced in USGov Virginia region
- Root Cause: The failure was due to a back end service misconfiguration.
- Incident Timeline: 8 Hours & 30 minutes - 05/26, 07:00 UTC through 05/26, 15:30 UTC
-Subhash
Update: Wednesday, 26 May 2021 14:51 UTC
Root cause has been isolated to the configuration change in one of the backend dependent service. To address this issue we have manually restored the configuration changes. Some customers may have not been able to perform control plane operation, such as viewing work spaces or solutions via the portal, Poweshell or CLI. Delays of data ingestion may also be experienced in USGov Virginia region.
Root cause has been isolated to the configuration change in one of the backend dependent service. To address this issue we have manually restored the configuration changes. Some customers may have not been able to perform control plane operation, such as viewing work spaces or solutions via the portal, Poweshell or CLI. Delays of data ingestion may also be experienced in USGov Virginia region.
- Work Around: None
- Next Update: Before 05/26 17:00 UTC
Update: Wednesday, 26 May 2021 11:43 UTC
Root cause has been isolated to the configuration change in one of the backend dependent service. To address this issue we have manually restored the configuration changes. Some customers may have not been able to perform control plane operation, such as viewing work spaces or solutions via the portal, Poweshell or CLI. Delays of data ingestion may also be experienced in USGov Virginia region.
Root cause has been isolated to the configuration change in one of the backend dependent service. To address this issue we have manually restored the configuration changes. Some customers may have not been able to perform control plane operation, such as viewing work spaces or solutions via the portal, Poweshell or CLI. Delays of data ingestion may also be experienced in USGov Virginia region.
- Work Around: None
- Next Update: Before 05/26 15:00 UTC
Initial Update: Wednesday, 26 May 2021 08:44 UTC
We are aware of issues within Log Analytics and are actively investigating. Some customers may have not been able to perform control plane operation, such as viewing work spaces or solutions via the portal, Poweshell or CLI. Delays of data ingestion may also be experienced in USGov Virginia region.
-Vyom
We are aware of issues within Log Analytics and are actively investigating. Some customers may have not been able to perform control plane operation, such as viewing work spaces or solutions via the portal, Poweshell or CLI. Delays of data ingestion may also be experienced in USGov Virginia region.
- Work Around: None
- Next Update: Before 05/26 12:00 UTC
-Vyom
Updated May 26, 2021
Version 5.0