Maintenance Windows for Sauce Labs
Customers may experience intermittent errors during automated browser and virtual mobile device tests in our US-West-1 datacenter. We are closely monitoring and investigating the affected services.
2021-July-29 Service Incident
Incident
Report for Sauce Labs
Postmortem
Dates:
Thursday July 29, 2021, 1100 - 1530 UTC
What happened:
Performance data for tests running in the US-West-1 data center was not loading.
Why it happened:
Performance request logs sent to the API Metrics Service failed to populate the Sauce Labs UI because of an incorrect set-up.
How we fixed it:
We deactivated sending request logs temporarily.
What we are doing to prevent it from happening again:
We will change the Performance API to use a new library that will send non-blocking requests to the API Metrics Service. We will also add additional monitoring for our API Metrics service.
Resolved
Fix has been deployed and tests are now working as expected. All services are fully operational.
Identified
We have identified the issue and are working on remediation.
Update
We are continuing to investigate this issue.
Investigating
Performance APIs and tests may be slow to load or not work. We are investigating.
This incident affected: Insights (US-West, EU-Central).