Dear Headless User, due an unplanned deploy, testing on Headless may be affected with intermittent downtimes, causing some tests to possibly fail. This outage is scheduled for about 3 hours maximum, between 7:00pm PDT - 10:00pm PDT on Thursday, August 8, 2019. Things are expected to be back to normal once the deploy has finished. We apologize for the inconvenience.
2020-October-14
Incident
Report for Sauce Labs US East Data Center
Postmortem
Dates
Wednesday, October 14, 2020 7:00 pm ET - Thursday, October 15, 2020 1:40 am ET
What happened:
Customers experienced elevated wait times and increased rate of tests unexpectedly terminating from approximately 7:00 pm to 11:00 pm.
Why it happened:
Our GKE cluster underwent automated upgrades during the incident window which caused services to be unexpectedly terminated.
How we fixed it:
Automated cluster upgrade completed and service returned to normal operations.
What we are doing to prevent it from happening again:
We’re adjusting maintenance windows to reduce customer impact. We’re also investigating increasing system robustness to handle cluster interruptions.
Resolved
The issues is resolved, Headless (us-east-1) testing should be back to normal.
Monitoring
Headless tests (us-east-1) have a small chance to error while starting. We've identified the issue and are monitoring, but errors still may occur.
This incident affected: Headless Testing.