We are currently investigating an issue on printercloud15. Users may be getting errors or seeing latency when accessing instances on printercloud15.

Incident Report for PrinterCloud

Postmortem

On March 20, 2023, a high internal load occurred within the network file system of the Canada region, causing instability in the platform. The root cause was identified as a bug in our server operating system. We rolled back the most recent updates prior to when the bug was introduced which brought stability across the region.

We have identified the primary factor for this incident was a bug in the Ubuntu operating system that was introduced into our environment on March 9, 2023, and has since been removed. For more information regarding this bug please refer to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2009325

Posted Mar 21, 2023 - 15:34 MDT

Resolved

At approximately 1:30 PM MT on March 20th, 2023 PrinterCloud servers started experiencing high-load in the Canada region. The web application was unavailable or intermittently loading with slow response times.

During our troubleshooting efforts we rolled back the latest system updates, and restarted our systems in effort to stabilize the environment.

Our current status is:
All systems are operational, we will continue to monitor and investigate the cause for the high-load on our servers.

We sincerely apologize for the inconvenience and thank you for your patience.

Posted Mar 20, 2023 - 15:55 MDT

Monitoring

A fix has been implemented and we are monitoring the results.

Posted Mar 20, 2023 - 14:49 MDT

Investigating

We are currently investigating this issue.

Posted Mar 20, 2023 - 13:47 MDT

This incident affected: PrinterLogic | SaaS Canada (PrinterLogic | SaaS Canada, MSP Portal - Canada).