From 07:05 AM to 09:56 AM UTC, Friday, February 5th, 2021, line item budgets experienced instability in our primary data center. This issue was resolved by switching to a secondary data center.
During the incident window, some line items could have under and/or over delivered, as their budgets would not have updated in a timely manner.
2021-02-05 07:05 UTC: Incident Identified: NYM2 data center became unresponsive
2021-02-05 09:05 UTC: Budgeting team received alerts
2021-02-05 09:56 UTC: Incident Resolved: Budgeting task moved from NYM2 data center to LAX1 data center
The root cause of the incident was caused by an issue in one of the Budget Pacing processes in the NYM2 data center that required patching.
Our engineers resolved the issue by moving the bulk of the processing from one datacenter to the other.
The incident has been fully resolved. We apologize for the inconvenience this issue may have caused, and thank you for your continued support.
We have identified and patched the following issue:
We are monitoring our systems closely, and will provide an update as soon as the issue has been fully resolved.