We are observing the counters update backlog decreasing. We estimate it to fully catch up in 7-8 hours. Till then, job counter updates will still be delayed unfortunately
Posted Feb 21, 2023 - 09:52 PST
Update
We are observing the counters update backlog decreasing. We estimate it to fully catch up in 7-8 hours. Till then job counter updates will still be delayed unfortunately
Posted Feb 21, 2023 - 09:04 PST
Update
We are continuing to monitor for any further issues.
Posted Feb 21, 2023 - 08:41 PST
Monitoring
We have deployed the fix and observing. Processing backlog is decreasing but is still high, and counter updates are delayed as a result. We will post more information when it is resolved.
Posted Feb 21, 2023 - 08:07 PST
Update
We have identified the root cause and are preparing the fix
Posted Feb 21, 2023 - 05:33 PST
Investigating
Job processing is not affected. We can confirm no data or integrity loss. We observe large latency in the mentioned counters update time though.