Major Outage
Incident Report for Asana
Postmortem

What happened

  • At 2021-10-14 22:03 UTC a configuration change we made triggered a bug, causing all of one kind of stateful servers to crash
  • Once identified we reverted the change, but because the servers were stateful, it took time for them to start and warm their caches before they could serve normally

What we'll do moving forward

  • We'll be doing additional review and improving our testing processes as changes like these are rolled out

Est down time:

  • 15 minutes, plus 10 minutes of partial downtime during recovery
Posted Oct 27, 2021 - 22:41 UTC

Resolved
This incident has been resolved.
Posted Oct 14, 2021 - 22:32 UTC
Identified
The issue has been identified and a fix is being implemented.
Posted Oct 14, 2021 - 22:27 UTC
Investigating
We're currently experiencing some difficulties; as a result, a majority of our users are unable to access Asana. Our Development Team is currently working to resolve this issue as soon as possible. Sincere apologies for the inconvenience caused, please keep an eye on this page for the latest updates.
Posted Oct 14, 2021 - 22:10 UTC
This incident affected: US (App, API, Mobile, Automations and Background Actions, Webhooks and Event Streams).