All OS X builds delayed
Incident Report for Travis CI
Resolved
Mac builds are being processed normally.
Posted Jun 30, 2016 - 21:19 UTC
Update
After canceling older jobs, .org Mac build queue still has a sizable back log, resulting in noticeable delay.
Posted Jun 30, 2016 - 16:10 UTC
Update
We are starting to cancel older outstanding Mac builds on .org
Posted Jun 30, 2016 - 14:45 UTC
Update
Private builds on the Mac are being processed normally.
Posted Jun 30, 2016 - 13:32 UTC
Update
We still have a substantial back log on the public Mac build queue before the busiest time of the day. We will cancel queued jobs starting around 10:00 EDT (14:00 UTC, 16:00 CEST, 07:00 PDT).
Posted Jun 30, 2016 - 12:29 UTC
Monitoring
Backlog is being processed on both sites. We'll continue to make updates as things progress.
Posted Jun 29, 2016 - 21:45 UTC
Update
We are continuiing to process the backlog on both sites, so delays will continue. We'll post updates as we begin to catch up on the backlog
Posted Jun 29, 2016 - 20:39 UTC
Update
We're beginning to process builds for both travis-ci.org and travis-ci.com and we are monitoring things closely. We'll provide another update in 60 minutes or if we have an update sooner.
Posted Jun 29, 2016 - 18:46 UTC
Update
We've been able to stabilize and repair the core virtualization layer and after some testing in staging, we're beginning to ramp up capacity to start processing jobs, but with partial capacity at first. We'll provide another update in 60 minutes or if we have an update sooner.
Posted Jun 29, 2016 - 18:23 UTC
Update
We're working in our infrastructure provider and vendor support on getting our core virtualization layer back into service and we hope to have start processing builds again within the next 60-90 minutes. We'll provide another update in 60 minutes or if we have an update sooner.
Posted Jun 29, 2016 - 18:00 UTC
Update
We're working in our infrastructure provider and vendor support on rissues with our core virtualization layer. We'll provide another update in 60 minutes or if we have an update sooner.
Posted Jun 29, 2016 - 17:04 UTC
Update
At this time there's no change in the state of things. All of our OSX builds are currently paused due to issues with our core virtualization layer and we're working in our infrastructure provider and vendor support on recovering things. We'll provide another update in 60 minutes or if we have an update sooner.
Posted Jun 29, 2016 - 16:20 UTC
Update
We apologize for the continued delays. All of our OSX builds are currently paused due to issues with our core virtualization layer and we're working in our infrastructure provider and vendor support on recovering things. We'll provide another update in 60 minutes or if we have an update sooner.
Posted Jun 29, 2016 - 15:14 UTC
Update
We're going to temporarily pause all OS X related build processing
Posted Jun 29, 2016 - 14:04 UTC
Update
In order to work to stabilize some internal load in our vSphere cluster and get back to full capacity, we're going to be throttling builds for a few minutes and this will increase build delays temporarily.
Posted Jun 29, 2016 - 13:55 UTC
Identified
We're currently running with reduced capacity for our OSX builders, due to some hosts having hardware issues. We're working with our infrastructure provider to determine why and resolve the issue
Posted Jun 29, 2016 - 13:00 UTC