Web Hosting Talk : Advertising Forums : Industry Announcements : Providers and Network Outages and Updates : HE.net Fremont entire data center power loss

[StephenRS]

We had servers in opposite ends of the room (row4 near the NOC, row11 near the kitchen) at HE.net Fremont go down hard... power loss.

Anyone know details?

1:30pm Pacific Time

[RackMy.com]

Yeah, heard it could be related to UPS maintenance (heard that from 3 people)?

[DavidU]

I just got off the phone with Tiffany at HE.

She said it was a "hiccup" during routine UPS work.

I call bullsh*t since we have 8 cabinets there more or less offline and another cabinet in a totally different part of the datacenter also offline.

-davidu

[comers]

Hello,


I am thinking to contract cabinet full with line 100mbits in I HE, but finish to me scaring, you who you are with them who you can say to me? that uptime has? they are good? recommendable? excellent? bad?


Please Help for HE

[DavidU]

Originally posted by comers
Please Help for HE

Please help for davidu

[webtech]

I would like to see an explanation from HE.Net as my sales rep is unresponsive to this situation. We have 1 cabinet and around 50-75mbps from them out there and it was down.

[argonblue]

No luck on the phone (all circuits busy), emailing the noc yielded a "glitch during routine UPS maintenance". We had a guy over there who got "accidental power down of main UPS" from one of the techs. Apparently, there are a lot of angry people over there.

It's not the end of the world, but very disappointing indeed.

[abnormis]

all of our cabinets in fremont,ca went down hard as well. not very happy about this situation.

[argonblue]

Hey webby--where did you disappear to?

Originally posted by webtech
I would like to see an explanation from HE.Net as my sales rep is unresponsive to this situation. We have 1 cabinet and around 50-75mbps from them out there and it was down.

[ottenhoffs]

Been down since 4:30 pm EST (now 7:30pm EST). Anyone else still down?

[trevyn]

Same here; I had a cabinet go down, and my reseller's cabinets appear to have as well according to the router reboot stats.

The timing isn't such to annoy me at this time assuming everything comes up OK, just strikes me as kind of funny. Will be interesting to see what happens as a result.

[ReliableServers]

Damn! sounds like when exchangecolo had their problem last year.

[trevyn]

Originally posted by ottenhoffs
Been down since 4:30 pm EST (now 7:30pm EST). Anyone else still down?

According to my router graphs, it looks like it came back up around 3:30PST, but I'm not certain if it may have actually come up earlier or later than that. At any rate, everything seems to be working now.

[DavidU]

We still have a ton of people offline and HE's phones are totally swamped.

They have sucked, continue to suck and will probably suck forever.

Even when they are online and working, they suck. we get so much arp traffic and broadcast storms from other subnets it's shocking.

They are also listed all over SPEWS and whatnot. (not that I care about SPEWS)

And has anyone noticed how everyone who works there seems to be related?

-davidu

[abnormis]

looks like they need ups's for their ups's.

i sure hope someone got fired for this mess...

:/