Hosting outage
Incident Report for INVERS GmbH
Postmortem

The final incident report can now be requested via your support contact.

Posted Jul 20, 2023 - 15:00 UTC

Resolved
This incident has been resolved.
Posted Jul 16, 2023 - 02:38 UTC
Update
Systems are fully back, the CloudBoxx events and tracking are handled now and might be delayed for the time being.
Posted Jul 16, 2023 - 02:33 UTC
Update
The CloudBoxx systems are all back since a while, we keep monitoring and change the status to operational if it stays stable.
Posted Jul 16, 2023 - 02:21 UTC
Monitoring
Systems are coming back, but not all connections are up yet, we monitor the stability and check all systems now step by step.
Posted Jul 16, 2023 - 02:08 UTC
Identified
Core components were replaced and the systems are currently booting.
Posted Jul 16, 2023 - 01:29 UTC
Update
Also the hosting service provider expected the problem to be fixed in between, it's not solved yet. The emergency teams are in close contact but no new ETA by now.
Posted Jul 16, 2023 - 01:18 UTC
Update
We are still in a close contact with the hosting service provider. We also involved C-level on their side and work on a fast resolution.
Posted Jul 16, 2023 - 00:46 UTC
Update
The feedback from the hosting provider is that the ETA is ~1h. We are working with the technicians of the hosting provider for a faster resolution time.
Posted Jul 16, 2023 - 00:04 UTC
Update
Parts of the infrastructure of the provider are back now, but our services are still down. No ETA yet.
Posted Jul 15, 2023 - 23:29 UTC
Update
Some hosted services are back but we are not out of the woods yet.
Posted Jul 15, 2023 - 22:41 UTC
Update
Our 24/7 emergency teams are working with the hosting service provider to get back the services asap. The hosting service provider confirmed an issue on their site.
Posted Jul 15, 2023 - 22:16 UTC
Update
Our hosting provider is working on the issue.
Posted Jul 15, 2023 - 21:58 UTC
Investigating
We are currently an outage of one of our datacenters. We are investigating and escalating to our provider.
Posted Jul 15, 2023 - 21:38 UTC
This incident affected: CloudBoxx (CloudBoxx (REST API), CloudBoxx Events (RabbitMQ), Installer Apps (SmartControl)), FleetControl (FleetControl), Legacy Stack (CocoSoft Hosting - Europe, CocoSoft Hosting - Asia, ICS Hosting - Worldwide), and OneAPI (OneAPI (REST API), OneAPI and Insight Events (RabbitMQ)).