Anybody having the same problems as me?
I cannot access the website/ticket center. The server always pingtime-out and it's extremely slow.

The FS main site is awfully slow for me also...

Same here, very very slow.

The site is very very slow today. Tracert very slow and times out also. I hope this is just a hiccup because I just ordered a server last night.

John

Originally posted by dario
The site is very very slow today. Tracert very slow and times out also. I hope this is just a hiccup because I just ordered a server last night.

John

Sounds like bad luck *Don't you hate when that happens*

They're having problems.
If you do a trace, the problem is actually from HE.NET ( you can't even access www.he.net)

:(

They (FastServers.net) haven't reply to my tickets which they normally did within 15 minutes

It's been almsot 2 hours now.

Originally posted by k6cheung
They're having problems.
If you do a trace, the problem is actually from HE.NET ( you can't even access www.he.net)

:(

They (FastServers.net) haven't reply to my tickets which they normally did within 15 minutes

It's been almsot 2 hours now.
he.net comes up fine from Australia but fastservers.net is very slow.

hey guys...

It's ok now.

It WAS okay after the first down time (3 hours ago). But it WAS okay for only 15 minutes and then it went down again.

You never know! Keep on monitoring it (and that's the ONLY thing we can do).

In fact,

It still NOT okay. I am still getting packet loss ( around 30 %)

Believe it or not, every network has problems from time to time. The crew @ HE is doing their best- we trust them absolutely completely, as things like this happen literally once a season, or twice a year.

:)
Very sorry for the trouble, the engineers that ride routers 24/7 are doing their absolute best to smooth this over permanently.

When more details are available, we'll be glad to share them!

No problem. We all understand. :D

But if you got the 'finally OKAY' from He.net, please let us konw.

(There are still some packet loss at this moment)

It's still down. Almost 6 hours ... =(

Yeah.

I am started to get upset too. He.net Fixed their own problem but not the fastservers.net. :angry:

Service From A+ downgraded to B- now.

Kenny & those monitoring:

It's all of MAE-West / PAIX that is having an issue. It isn't even HE alone. Notice HE is still having identical packet loss themselves:

As of 2 minutes ago:

Pinging he.net [216.218.186.2] with 32 bytes of data:

Request timed out.
Request timed out.
Reply from 216.218.186.2: bytes=32 time=120ms TTL=242
Reply from 216.218.186.2: bytes=32 time=100ms TTL=242
Reply from 216.218.186.2: bytes=32 time=100ms TTL=242
Reply from 216.218.186.2: bytes=32 time=121ms TTL=242
Reply from 216.218.186.2: bytes=32 time=110ms TTL=242
Reply from 216.218.186.2: bytes=32 time=110ms TTL=242
Request timed out.
Request timed out.
Reply from 216.218.186.2: bytes=32 time=110ms TTL=242
Reply from 216.218.186.2: bytes=32 time=100ms TTL=242

....................................

Please bear with us and have patience before you begin to open up a WHT flame. Most of the bay area is having problems right now in an extremely rare event.

If you have any questions please give us a call toll free, or get in touch with our support staff.

Thanks sir.

he.net is down for me, fastservers.net are working perfect...

I picked a good day to start with a new server :rolleyes:

Agreed, bad luck all around.
This is an extremely rare event- I am confident that future months & years will back up that claim.

6 hours already ! What happened ?

I know those He.net guys are in Fremont. Can't they hop over to Cisco and steal some of their routers.

Why don't they have redundent network? I am not a network admin so I can't comment, but is it THAT expensive to have a backup router or some sort ?!

I wonder if a backup T1 line would help. :confused:

I am GUESSING the problem is not connecting the outside world. Somehow they (HE) can swap router so that HE.NET (www.he.net) was not down.

64.71.131.174 is the router that WAS dropping packet (that's after you reach He.net)

Anyways, problem fixed now ?

They have been down more today then up.. :( They said router problems to us..

Kenny,

If routing and redundancy was as easy as you make it sound, the internet would definitely be a much happier place for friends and families. I will definitely post up technical details on the source of the matter once I have it. If you don't want to take my word for how extremely rare this situation is, that is perfectly fine. I will let our future service make amends to the situation.

At the current time I definitely would like the engineers @ MAE West/HE to focus 100% of their time on stabilizing the situation permanently. If I can squeeze any details out, I will be sure to share them. Until then, best of luck to them as they deal with what must be an issue of immense proportions.

Remember you can always contact our staff via a number of avenues in the meantime. :)

I am wishing upon a star that things are ironed out shortly.
:cool:

I have to say that although today has been a horrible day (been bouncing up and down since 8:00 EST this morning) This is the first, only, and hopefully last time this has happened. Powersurge/fastservers.net has been extremely reliable in the months we have been with them. Their support staff has been kind and very helpful. Even today they have answered every phone call and ticket I have placed about this situation. While details have been vauge, I myself being a unix/network tech understand that sometimes you really don't know exactly whats wrong until about 10 minutes after you fix it. I am sure that details will be forthcoming when the situation is fixed.

I just wanted to post this so that possible customers would not think this is the norm for this company.

Don't get me wrong. I still think this is a good company to join. It can be shown by they have the guts to post messages up during the problem.

(Many ISP will simply ignore you until the problem is fixed - and ask you, do you have problems NOW!?)

This is very unfortunate and if you really knew how hard our entire staff is working to get a final resolution to this it would amaze you. Network Stability at HE.NET has been nothing less than stellar for the past 2 years, of course they have had some minor downtime ranging from 15-45 minutes only a handful of times since we have been with them.

FastServers.Net has been doing very well because of this board and fanatic customers we have been getting, and I just wanted to let everyone know that we are working the hardest possible to make these problems short lived. I will be happy to keep anyone that has a server posted on the status until it is resolved, just give me an e-mail ap@fastservers.net.

Just keeps bouncing on, then off, then on, etc. I caught about 10 minutes there where I could upload lots of stuff to the new server :) Then down for 20 min. Then up for 5. lol

Ribbit

I've been encountering packet loss throughout most of the day, up to 25%, but now I've been unable to access Fastservers at all for the last 45 minutes.

I was just going to re-review the SLA but can't! :(

I’m also having trouble accessing the Fastservers site from the UK :( hope it comes back up soon!

Aaron ,

I know you guys been working on it but when I called at 2 pm they said no longer than another 1:45 mins but it is now almost 7 EST and I am getting emails from my client who you know who am talking about. I tried the www.ticketresponse.com and it wont load, I tried to contact you via AIM but you don't answer :bawling:

Actually got some decent news a short while ago that the problem had been resolved and now the networking crew is gradually piecing the network segments back together @ the datacenter. So that is excellent news which should lead to service being restored shortly.

Crossing fingers, etc.



:cool:

Originally posted by JG

I was just going to re-review the SLA but can't! :(

I think it's 5% refund per hour - but the problem is not cause by FastServer so I don't think we're bound for that.

I am wondering they(FastServers) get any SLA with HE.NET.

Well , but He.NET can claim the problem is caused by the router and we should blame Cisco. And then Cisco can blame their engineers....

isildur

A 12 pack of Dr Pepper and we'll call it even =)

**** happens, it's major yes, but it's rare and we have contact so Im cool

Originally posted by isildur
Actually got some decent news a short while ago that the problem had been resolved ...

isildur , please please put the problem and possibly the resolution on a web page (after you're less busy) so that we can all learn :D

It is good for us too that we can referral our customers to that page and know what has happened.

I will definitely do my best to provide that.
You know how datacenters work though, in cases like this, the news is always a solution is right around the corner. I am just passing on information as I have it- I will definitely post up the technical details in glorious fashion once I get a hold of them; *when things are completely resolved*

What a day.

I will keep you informed.

Umm.. Dr Pepper too, since we're taking requests :D

heh...

I'm waiting for my server as well. :) I don't necessarily hold this against them... as this certainly seems like a rare incident...

arn

Originally posted by ********
... I am getting emails from my client who you know who am talking about. ...

Honestly, I want to know how you reply your clients' angry emails , given the fact that most of them don't understand much about there is "downtime" on the network.

First, explain the OSI model to them, then explain TCP/IP, then explain routing tables, then explain hardware costs and loads, after you've done that, and their head has exploded they will understand one thing, you are doing all you can, which is this case FS is.

Originally posted by Samuel
First, explain the OSI model to them, then explain TCP/IP, then explain routing tables, then explain hardware costs and loads, after you've done that, and their head has exploded they will understand one thing, you are doing all you can, which is this case FS is.

LOL Samuel, that is a good one. So....What is OSI model ? hahahaha

Anyways, I am at least doing one thing I can do - "monitor" the situation and once it's back up, I can login and verify everything is okay.

Oh....getting a TTL expired in transit (rather than unreachable) from the router now. That's an improvement!

Hello, I had been getting complaints from my clients earlier today of the server running buggy, and then I saw it myself, and then it went down, and it's been down for a couple of hours now. What is the ETA for everything being back up and running?

I have some somewhat juicy though disheartening details.
(well, to a point)

After progress was THOUGHT to be made earlier, things are extremely more complicated. Apparently there is (and has been since early today) a gigantic assault hitting the routers on the perimeter of the HE network @ MAE West. It's not your simple run of the mill lovely assault from aunt jeanie's basement workstation either. Apparently the engineers are dealing with a multi-pronged attack from different timezones/continents?

In a nutshell, that is bad. They breached their network segment from the rest of those that colocate at HE, in order to simplify the process of pinpointing a solution.

Basically, I wish them luck. They'll need it. However, the place is has a legendary uptime and efficiency rating, IMHO --- HE will get it figured out and we'll be back to normal soon.

I wish I could elaborate on "soon"
I will keep you informed!

iSuperWeb,

It's been like that for the last 12 hours now. They have some major issue with some router or something like that.

We're all waiting for our servers to go back up.

Believe it or not. This is my 3rd MAJOR downtime in a month , 2 with FDCServer, now with FASTServer, my clients are going to kill me.

Ouch K6, sorry to hear that. I'm in the same boat as you. With my previous provider, I've lost count of the amount of times the server had gone down. Sometimes for 2 days. I just started changing over all of my clients to FastServers.net on Monday/Tuesday, so this isn't a good start at all.

Hey isildur or ap_surge, if you could keep us updated as to what is going on we would appreciate it.

I've always wondered about this - isn't it easy to track who attacked you and sic' the coppers on em?

It's quite simple if it's one person or destination launching the attack. However, in this situation it's apparently much more complicated then that- after speaking to the engineers a few minutes ago, it appears they are making progress! Things will be crunching along, if they are restored to some extent. (in the next few minutes)

Hopefully as it turns to night, the engineers will have a much better chance at a final solution, with incoming bandwidth continuing to drop.

Good luck to them- I will keep you posted!

Not so permanently affixed to the net, now are we?

:) Owen


Permanently affixed to the information superhighway

Hello,

My servers are working fine now. I am able to access my servers at he.net. :D

Hope it would stay up :rolleyes:

I just checked and fastservers.net went up also

hmm... now if I can get my server... :)

arn

my fastserver account has worked for about an hour

Things are improving! I will have an update soon.
Hopefully server builds will continue and other orders & etc processed as the night rolls onward.

Thank you for your patience.
I will get some technical detail to you all if at all possible.

Though don't hold your breath for a night of complete "smooth sailing" yet. Looking very good right now, though!
;)

Things seem to be all good for me here also :) Let's hope it's smooth sailing!

Originally posted by isildur
Things are improving! I will have an update soon.
Hopefully server builds will continue and other orders & etc processed as the night rolls onward.

Thank you for your patience.
I will get some technical detail to you all if at all possible.

Though don't hold your breath for a night of complete "smooth sailing" yet. Looking very good right now, though!
;)
Congrats on the cool manner in which you handled this one. I imagine you're pulling your hair out in total frustration.

:beer:

Originally posted by Aussie Bob

Congrats on the cool manner in which you handled this one. I imagine you're pulling your hair out in total frustration.

:beer:

I was thinking the same thing all through reading this thread.


Just sent a few hundred pings, no packet loss for me. But then, I'm only 4 hops away ;)

Word from the NOC is "resolved"
In other words thee offenders (from multiple timezones, I might add) hath been terminated/jailed ?
Hopefully jailed.

At any rate here's hoping things revert to iron-clad status at the MAE West/HE node in the hours and days to follow.

Have a fanshmabulous night, if possible.

:D

I would also like to highly commend FastServers.net for how they handled this, and keeping us updated here on WHT. Me being a FastServers.net client for 2+ weeks, I have been HIGHLY impressed with everything, and to me a company shows they're true service by when they are having an problem, and they passed with flying colors in my opinion. :)

Thanks for the updates =)

isildur and ap_surge

i give you 5/5 stars you guys did awesome at providing updates as soon as possible and that was every hour or so and when servers are down updates = good even if they are'nt very big

thumbs up guys

Awesome. :D

Well Done FastServers.NET. Let's hope that this won't be happen again in 6 years. hehehe.

zdwebhosting, Alright PM you on my comments for FastServers.NET. Well you know , it's something like He.NET's network + better customer service.

those guys at FS handled this professionally...i might try them as well :D