We have email and connectivity issues since last night. Just curious if anyone else is......

From Alabanza (9:45AM PDT):


Good afternoon, yesterday afternoon and evening we experienced some network
issues. It appears there was a problem with a switch at our NOC. There was
also a problem with an AT & T circuit. The problem was thought to be
resolved as of 5am this morning. We have been receiving some requests that
our network is still sluggish and timing out at certain points. We have
notified two of our top system administrators and they are working to fix
the problem as quickly as possible.

Yeah, we got the standard "we had a router go down" or "we had a switch go down" email too.

But we are still getting complaints from our customers.

It's one of the main swicthes inside the NOC. An operating system upgrade went bad over the weekend, and 75% of packets were lost. They quickly realized this and took the swicth offline for repair, but now 100% of the traffic is going through 1 switch. It's like the Long Island Expressway Eastbound at 5:20 PM with 2 lanes out of 3 closed through Queens right now... the official statement says that it should be resolved by close of business Tuesday (yikes!), but as I was speaking to my account rep the folks from AT&T arrived at the NOC to assist in the resuscitation efforts. Meanwhile we've fielded *many* calls from confused and angry clients. We're stifling the desire to just blame the whole thing on Code Red though.. ;)

Originally posted by shpilkus
We're stifling the desire to just blame the whole thing on Code Red though.. ;)

*chuckle*
We had a guy e-mail us a few hours ago and even asked if it *was* Code Red causing the problem. Tempting as it may be to do a ***** and smoke screen with that little gem, we stuck with the truth. It's actually times like this I appreciate the customer base we have. Not many complaints at all, and those that have e-mailed us, most were just pointing out the slowdown, and wondering what was up (to which they all got the correct reply). A lot of them were around when Alabanza went and did this near the start of the year so know the drill.

I think I'm probably more pissed about it than our customers are...

Greg Moore

Are all Alabanza sites and resellers affected?

I'm still having issues with my sites, and we're going on 18 hours now. Heavy packet loss and latency.

Yes pretty much. The problem seems to have been corrected now though so back to business as usual.

Greg Moore