Customer Impact On July 26th, 2022, starting from 11:02 AM UTC, Europe enterprise and trial users faced issues when trying to access Automation Hub.
Root Cause
AutomationHub Service's Compute Infrastructure couldn't talk to other services because of secret expiration.
Detection & Response
Our automated alerting system notified on call engineers about the problem within minutes of the outage impacting our applications. We manually moved all our customers to other nodes in same region.
As part of response to the outage, we are moving to managed identities in AutomationHub and all other services to prevent recurrence in the future.