System Errors in AP-NORTHEAST-1

Incident Report for Wasabi Technologies

Postmortem

On 21 May 2025 at 02:45 UTC, Wasabi’s Tokyo vault was impacted by system errors, causing client requests to result in 5xx errors for any API calls to their S3 buckets. This issue was due to an internal failure in the Tokyo Region where the backend server had a hardware fault, impacting the cluster of which it was a member. Our Operations Team identified the failure and took corrective action by performing a cluster failover to resolve the issue, which returned the service back to an operational state at 10:55 UTC 21 May 2025.

Posted 1 month ago. May 30, 2025 - 13:26 UTC

Resolved

This incident has been resolved, please contact support@wasabi.com with any outstanding questions.
Posted 2 months ago. May 21, 2025 - 13:07 UTC

Monitoring

A fix has been implemented and we are monitoring the results.
Posted 2 months ago. May 21, 2025 - 11:13 UTC

Identified

The issue has been identified and we are working towards to a solution.
Posted 2 months ago. May 21, 2025 - 10:42 UTC

Investigating

We are currently experiencing system errors in our AP-NORTHEAST-1 region. Customers may experience elevated HTTP 5XX error responses when interacting with their Wasabi bucket(s)/objects. We will update this page as we have more information.
Posted 2 months ago. May 21, 2025 - 09:47 UTC
This incident affected: AP-Northeast-1 (Tokyo).