Final Update: Wednesday, 19 May 2021 15:58 UTC
We've confirmed that all systems are back to normal with no customer impact as of 05/19, 15:45 UTC. Our logs show the incident started on 05/19, 14:30 UTC and that during the 1 hour 15 minutes that it took to resolve the issue customers may have experienced issues with missed or delayed alerts in Fairfax.
- Root Cause: Engineering team has determined that part of the backend workflow for processing Log Search Alerts became unhealthy after it had reached an operational threshold.
- Incident Timeline: 1 Hour & 15 minutes - 05/19, 14:30 UTC through 05/19, 15:45 UTC
We understand that customers rely on Log Search Alerts as a critical service and apologize for any impact this incident caused.
-Vincent
Published May 19, 2021
Version 1.0