Please note, before anyone posts here asking.. Is WeinBar down? etc.etc.

We are having an issue at the NOC. Please be aware that we are working on it at this time and do not expect a long outage. This is an issue with the fiber drops from both Genuity and UUNet.

I have been assured that things will get back ASAP. If there will be an extended outage, I will post that here as well. I do not have any more answers at this time. You can always call us at 480-661-1300 if you need to talk to us, but for now, this is the only information I have.

Thank you for your understanding in this matter.

eek, lucky i come here when things go pear shaped :)

cheers for the updates Michael, keep us informed of any breaking news.

Regards

-XT

Ahhhh wondered why my mail had stop appearing..... yikes...

looks like its been down just over 70 minutes at time of writing this message.

my system stopped responding at 4:30 GMT.

anyone phoned them up to see if they have any further details?

ok, i just phoned them, they said they were hoping for it to be back up in the next 15 mins

... tick tock ;)

ok, looks like another 15 mins
ive been told its a fiber drop between uunet and genuity again

anyone see one of those moments where the NOC says:

15 mins... 15 mins... 15mins... 15mins... 15mins etc...

i can see that coming !! hehe

Well, at least they are letting us know.... but it's bloody annoying ;)

oh well, this looks like a long term thing (i know the NOC said it wasnt) but hey its still down, im turning off and going the pub

can someone post here when its back up again? cheers

You have to be a bit understanding here though. When things like a UUnet outage occurs, it is beyond the host's control to fix it. Basically, he's in the same boat you are - waiting for UUnet/Genuity to go back up. When he tells you "15 more minutes" that is because that is what THEY are probably telling him.

Sooooo...please understand that it's a rough situation for all involved and be patient. You have to give him major credit for passing along info and letting you know as much as he does!

*been there, done that, sucks to have customers blame you for something you have no control over* :)

--Tina

yeah, i can understand, im not really blaming them.

but its still down, lol

4 hours and counting, hehe

OK, most sites are back online. If you are still having issues, please go to our helpdesk, http://helpdesk.weinbar.com and let us know.

Here is/was the situation. At about 6:00AM MST power was cut to the building and the UPS's kicked in. Once the juice died, the backup generator was lit. This kept the network running fine until about 9:30AM MST. This is when the drops (outside of the datacenter) lost their power. This was out of our control since the UPS's that were on these boxes do not have a generator to power them in case of a longer loss of power.

Once the technicians were able to rectify this problem, the routers in our datacenter were not functioning correctly. We reloaded the ARPS and most everything went fine. There was a problem when the power kicked back in from the generators going off and the main power being reinstated so there was a momentary loss of power in wheich some of the boxes were rebooted unexpectledly. Some of these boxes needed to have their filesystems fixed (fsck) and we were able to restore them fully. Some customers have changed their passwords (which is a very good thing!) but have not updated us with them, so if maintenance needed to be done, we had no way of providing the root pw to kickstart it. Some of these customers we are waiting on so that they can provide it to us.

If you have anymore questions on the subject, please let us know offline at noc@weinbar.com and we will answer them expeditiously.

Thank you all for you patience, and have a great weekend!

Why do these things always seem to happen on weekends? Whenever I've had a network component go down or a hard disk fail or some such thing, it's always been on a Saturday or Sunday.

Originally posted by Intelligent Hosting
Why do these things always seem to happen on weekends? Whenever I've had a network component go down or a hard disk fail or some such thing, it's always been on a Saturday or Sunday.

God's way of keeping us humble. :D

--Tina

Is anybody else still down?

I've been up (so to speak) for hours now.....

Still, at least this didn't happen on Christmas Day! :eek:

I'm up but my SSH is off and my cgi scripts arent working.

Originally posted by AffordableHost


God's way of keeping us humble. :D

As long as he doesn't do it on Christmas... :D

Originally posted by Intelligent Hosting
Why do these things always seem to happen on weekends? Whenever I've had a network component go down or a hard disk fail or some such thing, it's always been on a Saturday or Sunday.

There is more intelligence in those devices than we could ever imagine.