Since 29th of November, some customers have been experiencing problems receiving exports of Dashboard. This was due to an update of one of our input load balancing systems, which was not fully compatible with a component used by the exports of dashboard.
Actions performed:
A rollback was performed.
The error was not easy to identify, as it did not directly affect the services concerned and it was not a global issue. Despite the implementation of a dedicated task force, it took us some time to understand that it was related to the load balancing system.
Actions to come:
Update the components to be fully compatible with the new version of the load balancer, and reschedule an update of the load balancer.
Posted Dec 06, 2022 - 10:42 UTC
Resolved
The issue has been resolved and all exports have been sent.
Posted Dec 06, 2022 - 10:42 UTC
Update
We have fixed the issue. We are now working on sending exports.
Posted Dec 05, 2022 - 14:54 UTC
Identified
We are still currently experiencing delays in the generation of Dashboard scheduled exports. Our technical teams are continuing to work on it to resolve this issue as soon as possible. Several potential causes of the incident were already identified and are being investigated. We apologize for any inconvenience caused.
Posted Dec 05, 2022 - 08:50 UTC
Investigating
We are currently experiencing delays in the generation of some Dashboard scheduled exports. Our technical teams are working to resolve this issue so that these exports may be sent as soon as possible. We apologize for any inconvenience caused.