We would like to provide additional detail surrounding the downtime which occurred on 6/18/2021
What happened?
At 9:10am PST, the CA1 server environment experienced downtime which resulted in all QLess applications becoming temporarily inaccessible on the server.
Duration: 10 minutes.
Cause
The root cause of the outage was due to a rare condition that was triggered on one of our backend servers. Customers reaching the site during that period of time could not reach the site, affecting 100% of them.
Remediation
Upon receiving a monitoring alert notification QLess engineers restarted the service.
Prevention
QLess has initiated a complete refactoring of the affected application. The new service application will be more fault-tolerant, available and self-healing.