Reading Connectivity
Incident Report for EX Networks
Resolved
Power has remained stable and we are marking this incident as closed. An RFO will follow after a full investigation.
Posted Nov 15, 2016 - 16:07 GMT
Monitoring
Power has been restored to both feeds for all clients. The 'B' side is currently running on generators and the 'A' on mains.
Posted Nov 15, 2016 - 10:44 GMT
Update
Further update from the DC:

"99% of clients have a working power feed (either 'A' or both 'A' and 'B'), but some clients have equipment that is single PSU and plugged into a power feed currently offline.

The current status is we have generator engineers on their way to site. We have confirmed the power network in this area is experiencing a fault, and SSEPD (Scottish and Southern Electric Power Distribution) are currently expecting it to be resolved at 10:15."
Posted Nov 15, 2016 - 09:52 GMT
Update
Further update from the data centre:

"There has been an HV mains failure to the site, on both the feeds. We believe this is a local supply issue from the grid.

Our backup generators started automatically as per planned operating procedure, but went into fault. We have started the generators manually which are currently powering site, although some clients are still affected."
Posted Nov 15, 2016 - 09:06 GMT
Update
Our networking devices are still showing one of the power feeds as down. At this time, only a single power feed in the data centre is active.
Posted Nov 15, 2016 - 08:57 GMT
Update
Our network devices within the data centre are back up which indicates power has been, at least, partially restored. However this site should be considered at risk until we have the all clear, and a RFO from the data centre.
Posted Nov 15, 2016 - 08:46 GMT
Identified
The data centre operator has confirmed they have suffered a major fault with the power system. We have engineers working on the problem right now, and will provide further details as soon as possible.
Posted Nov 15, 2016 - 08:41 GMT
Investigating
EXN have appeared to have lost connectivity to the Reading Data Centre. Further details to follow.
Posted Nov 15, 2016 - 08:39 GMT