Welcome to Staffbase Status

We continuously monitor outages, slowdowns, and other issues. Should there be any interruptions in service, we'll provide status updates here.

[App/Intranet] - Unavailability for App & Intranet on the German system
Incident Report for Staffbase
Postmortem

As our investigation of the incident is complete, we would like to provide you with more detailed information about the incident that occurred on March 8 at 9:24 CET.

Summary:
We’ve experienced an unusual high load on our systems. As a result of the high load, our system led to an out-of-memory (OOM) kill of our gateways. 

Impact:
Due to the unusual high load on our system, all customer applications on our German system were either very slow or not available for approximately 20 minutes.

Future Improvements:
We have identified several areas where we can improve our systems to prevent similar incidents from occurring in the future. To prevent future incidents, we will be implementing the following future improvements:

  • Increasing the maximum number of pods on the Istio Ingress Gateways to allow for better scalability and handling of increased traffic.
  • Implementing node autoscaling to help distribute the load on our system more efficiently and ensure that we have the resources available to handle increased traffic.

We thank you for your patience and understanding as we work to improve our systems and prevent future incidents. If you have any questions or concerns, please do not hesitate to reach out to our customer support team at support@staffbase.com.

Posted Mar 17, 2023 - 15:49 CET

Resolved
The issue is resolved. We apologize for the inconvenience this has caused.
Please get in touch with us at support@staffbase.com in case you're still having any problems. We’re happy to help!
Posted Mar 08, 2023 - 11:30 CET
Monitoring
We have made adjustments that restore full availability of the App/Intranet. We will continue to monitor and optimise the systems to ensure their stability.
We will provide a final update at a later date.
Posted Mar 08, 2023 - 10:35 CET
Investigating
Some customers may experience problems loading/opening the app.
Our teams are investigating the behavior and working to fix it as soon as possible. We will inform you, as soon as we have more details on the issue.
We apologize for the inconvenience. If you have any questions about this issue, please contact our support team at support@staffbase.com.
Posted Mar 08, 2023 - 09:38 CET
This incident affected: Employee App & Front Door Intranet (all regions) (Core API (Germany) [SLA], Media API (Germany) [SLA], Web Application (Germany) [SLA]).