Subject: [MyServers] Power Outage in Sovereign House - 15th September 2006
Today, at 16:24 UK time we experienced a power outage in our POP rack in Sovereign House. (This is the core of our network in this site.)
The reason for the power outage was that a power supply in one of our Cisco 6500 routers failed. There was a major component failure, and this created a short circuit. As a result of the short circuit, the fuses to the rack tripped.
Our engineers on site quickly diagnosed this problem, and removed the faulty power supply. They found that when power was applied to the power supply it smoked and emitted sparks.
Power was restored at 16:52 and the routers booted up at this point.
We would like the apologise to customers for the inconvenience caused. We are taking action shortly to install a UPS into this rack, to give all network equipment resilient feeds. Although the power to this rack is currently "protected" and comes off a UPS, the type of failure we experienced was not mitigated by this as it caused an upstream breaker to fail.