[Testnet] Trading Engine
Incident Report for BitMEX
Postmortem

The BitMEX [Testnet] Trading platform experienced instability on 5 January 2021 between 10:30 UTC and 11:40 UTC. The [Testnet] platform was put into maintenance mode to prevent an inconsistent experience for users while we triaged the issue. We identified the root cause of the instability as an intermittent storage subsystem problem in our cloud provider hardware, which resulted in unstable performance and occasional system pausing. Though the storage sub-system automatically recovered after a period of time, as a precaution we failed over to another node in a controlled manner. We apologise for the inconvenience this may have caused. Please contact Support should you have any further queries.

Posted Jan 07, 2021 - 13:29 UTC

Resolved
The [Testnet] Trading Engine is now back online. We apologise for any inconvenience. If you have any further questions, please contact Support.
Posted Jan 05, 2021 - 11:35 UTC
Identified
UPDATE: We’re bringing the [Testnet] Trading Engine back online, initially via cancel-only mode until approximately 11:40 UTC, where no new orders can be placed.
Posted Jan 05, 2021 - 11:19 UTC
Investigating
We have identified an issue with our [Testnet] Trading Engine server, and are working to restore full service as soon as possible. As we are resolving this issue the [Testnet] Trading Engine will be temporarily unavailable.

We apologise for any inconvenience this may be causing.

We are looking into the cause of this issue, and will be sharing an update as soon as possible. If you have any further questions, please contact Support.
Posted Jan 05, 2021 - 10:30 UTC
This incident affected: Testnet (Trading Engine).