Web Hosting Talk







View Full Version : Eservers down?


rbro
05-24-2002, 07:00 PM
I can't bring up my server or the eservers.biz site. Anyone know what's up?

drewnick
05-24-2002, 07:02 PM
We have an entire cabinet in DV2 that is down currently... hmm..

rbro
05-24-2002, 07:04 PM
So what happens with that 100% uptime SLA now?

rbro
05-24-2002, 07:08 PM
I just called DV2 and got some kind of answering service. WTF? I thought they were staffed 24/7? Anyone know what's up?

f5hosting.com
05-24-2002, 07:09 PM
Glad to se that I am not the only one...funny thing is, I have two servers with DV2 and only one is down.

f5hosting.com
05-24-2002, 07:11 PM
I just called them too...good luck getting any kind of fast service with these guys...it aint gonna happen. I have had trouble tickets in for a month that have yet to be answered.

BurtonHost
05-24-2002, 07:15 PM
One of the main routers is down at DV2.. affecting some subnets...
They are working on it ASAP..

cabalstudios
05-24-2002, 07:16 PM
Our engineers are working on it, the router came back but could not hold the load.....

Will keep you informed....


Original Message
------------------------------
Emergency Maintenance - 24/05/2002
We are rebooting the layer 3 router

The outage will occur at approximately 4 pm, and it is expected to be very short (1-2 minutes).

Thank you!

Shazad Boota
eServers dot Biz

f5hosting.com
05-24-2002, 07:18 PM
If this is eservers, why are MY servers affected? The servers that are affected are DV2 servers? The tranxactglobal.com website is down also...this is getting ridiculous!

cabalstudios
05-24-2002, 07:21 PM
This is one of the networks main routers at DV2 side ..... not all of the network is affected ...

We have engineers working to bring it backup...

Apologise for any inconvience caused!

drewnick
05-24-2002, 07:22 PM
At least it's Friday afternoon before a holiday. The traffic in Atlanta right now is rediculous.... makes this look like baby stuff. ;-)

Drew

Stew
05-24-2002, 07:23 PM
2nd time in a couple of weeks now.

quote
Original Message
------------------------------
Emergency Maintenance - 24/05/2002
We are rebooting the layer 3 router

The outage will occur at approximately 4 pm, and it is expected to be very short (1-2 minutes).

Thank you!

Shazad Boota
eServers dot Biz
end quote


If this this something that you guys were made aware of then why is it that I never heard anything. Same last time, when the switch or whatever it was was tested.

SLA 100%

Mdot
05-24-2002, 07:26 PM
Originally posted by f5hosting
If this is eservers, why are MY servers affected? The servers that are affected are DV2 servers? The tranxactglobal.com website is down also...this is getting ridiculous!

- DV2, tranxactglobal, eservers <- they all a located in the same place - DV2 dc

rbro
05-24-2002, 07:27 PM
Originally posted by Stew
2nd time in a couple of weeks now.
SLA 100%

Yeah, I don't quite get it either. If you get notiification that there's going to be even a brief service interruption. why not let your customers know so we can let our customers know? And where does the 100% uptime SLA fit into all of this? And could you also address the issue of the phone number/answering service? One od the reasons I chose Eservers was the 100% uptime SLA and the 24/7 phone access to the data center, not an answering service! I shouldn't have to come to WHT to find out what's going on...:mad:

drewnick
05-24-2002, 07:28 PM
Hold them to it and get some $$ back. That way they'll test more responsibly.

Drew

cabalstudios
05-24-2002, 07:29 PM
Stew,

We are partners with DV2 and were informed about 5 mins prior to the reboot ....
It was an emergency and a note was posted on the Forum ....

We only expected it to be 1-2mins, as it was a reboot, but it seemed the router could not hold the load, when it came back

The CPU is being checked on the router now...

BurtonHost
05-24-2002, 07:31 PM
If you check the SLA.. this was emergency maintenance which means that it was taken down by them to sort it.. and therefore I dont think the SLA applies.. I may be wrong though

The DV2 datacenter has been stable for months now.. these things happen.. I'm sure they will sort is as fast as they can.

f5hosting.com
05-24-2002, 07:40 PM
You guys dont have backup equipment there at that datacenter? Configure a new router and THEN check what is wrong with the screwed one. I got customers yelling at me from every angle!

cabalstudios
05-24-2002, 07:43 PM
Yes we do have a backup hardware; we are checking the possibilities and are trying to make sure everything flows seamlessly again...

Stew
05-24-2002, 07:44 PM
just concerned that dv2 are not communicating with their customers is all. I appreciate that emergencies happen, but the last one was a planned outage, which I, and many others knew nothing about. I thought from your post earlier (cabalstudios) that this was the same.
Anyway, my server is back up, but slow.

:unhappy:

kingpcgeek
05-24-2002, 07:46 PM
I have a tranxactglobal server that has been done for at least 45 minutes now.

Are we sure someone hasn't gone out of business? The technical contact number for the whois on tranxactglobal.com is disconnected and the toll free technical support number you receive when calling the other number listed on the whois is also not working.

cabalstudios
05-24-2002, 07:47 PM
Stew i understand where you and all the other customers stand.

This was an emergency reboot, which was only expected to last 2mins MAX .... Things turned out different and we are working to fix it.

rbro
05-24-2002, 07:48 PM
My server's still down:( . Hey Cabal, how come there's an answering service on the phones at the data center? I thought there was24/7 phone access to DV2, or by that did you mean 24/7 access to their answering service? Please address the SLA as well.

cabalstudios
05-24-2002, 07:51 PM
We have everyone working hard around the noc to get this all fixed. The NOC is staffed 24/7 and we have everyone working to speed up the process.

As for the SLA this was an Emergency Maintenance and therefore you do not qualify for refund under the SLA agreement.

ImHosted
05-24-2002, 07:52 PM
Server is still down..arghh!

However, I believe this is tranxactglobal or DV's fault... Where is Jeff or the NOC guys?

At least cabal is around to help...

cabalstudios
05-24-2002, 07:54 PM
Jeff is at the DataCenter/NOC working along with the network engineers to get this all backup.

rbro
05-24-2002, 07:55 PM
Originally posted by cabalstudios
We have everyone working hard around the noc to get this all fixed. The NOC is staffed 24/7 and we have everyone working to speed up the process.


What about phone access to the NOC 24/7..it's not really available is it?


As for the SLA this was an Emergency Maintenance and therefore you do not qualify for refund under the SLA agreement.

What was the emergency?

JamesTe
05-24-2002, 07:56 PM
What is Dv2 866 #?

cabalstudios
05-24-2002, 07:58 PM
Yes phone-access to the admin/tech is available 24/7, but at this moment in time, they are all working to get the router issue fixed ....

rbro
05-24-2002, 07:59 PM
Originally posted by JamesTe
What is Dv2 866 #?

866-344-4382, but it's just an answering service. They won't let you actually talk to anyone at the NOC, which I just discovered to my dismay.....

qps
05-24-2002, 07:59 PM
The number for their answering service is 866-344-4DV2. You can reach Jeff Hinkle directly at 770-605-4760.

rbro
05-24-2002, 08:01 PM
Originally posted by cabalstudios
Yes phone-access to the admin/tech is available 24/7, but at this moment in time, they are all working to get the router issue fixed ....

OK, well I guess that makes sense. I thought it was always an answering service. And the emergency that occurred requiring this maintenance was......??????

cabalstudios
05-24-2002, 08:01 PM
The Router is back and looking good....

kingpcgeek
05-24-2002, 08:03 PM
no more outages today or is this a tease?

rbro
05-24-2002, 08:03 PM
Originally posted by cabalstudios
The Router is back and looking good....

Thank god. Cabal, what was the emergency please?

BurtonHost
05-24-2002, 08:05 PM
If you're hosted with eServers shouldn't you really be going through them with any problems, rather than trying to contact the NOC of which you are not customers, but eServers of which you are..

Telephoning the NOC will only slow them down, they work hard to fix problems.

Anyway, everything looks to be sorted now. Good ping results..

denisdekat
05-24-2002, 08:06 PM
I would have to say here that if there was an earthquake, a fire, a taking of hostages, that that would be an emergency. If the network going down is an emergency, then your gurantee is BS. I can't believe that you could offer a %100 uptime guarantee which does not include the fialure of the network components, from server tocolo's border router.

rbro
05-24-2002, 08:09 PM
Originally posted by BurtonHost
If you're hosted with eServers shouldn't you really be going through them with any problems, rather than trying to contact the NOC of which you are not customers, but eServers of which you are..


Well eservers site was down and email also was not going through. In addition Eservers provided the NOC phone number to its customers. This is one of the reasons I chose eservers. It appeared that they were offering a 100% uptime guarantee with 24/7 phone access to the NOC as well as having an excellent reputation on this board.

drewnick
05-24-2002, 08:13 PM
I was this close (shows pinch) to driving over there. It's just a 15 minute drive.
Drew

cabalstudios
05-24-2002, 08:13 PM
The emergency was the router#1 was due for a reboot to clear things up, as it had an uptime of over 11months..
We had to do this tonight as it seemed we had no alternative....

I'd like to thanks everyone for there co-operation with us, in this matter.

qps
05-24-2002, 08:16 PM
I've never heard of a normal router reboot taking close to an hour... but then again, I have only been following this industry for eight years.

rbro
05-24-2002, 08:17 PM
Originally posted by cabalstudios
The emergency was the router#1 was due for a reboot to clear things up, as it had an uptime of our 11months..
We had to do this tonight as it seemed we had no alternative....


Rebooting a router that's had an uptime for 11 months sounds like something that was or should have been planned. Am I missing something here? If it's something you had to do and had no alternative...then you can't really be expected to meet a 100% uptime guarantee, right?

cabalstudios
05-24-2002, 08:17 PM
Originally posted by jkehe
I've never heard of a normal router reboot taking close to an hour... but then again, I have only been following this industry for eight years.

How did i know, you would try to make the most of this.

cabalstudios
05-24-2002, 08:19 PM
Originally posted by rbro


Rebooting a router that's had an uptime for 11 months sounds like something that was or should have been planned. Am I missing something here? If it's something you had to do and had no alternative...then you can't really be expected to meet a 100% uptime guarantee, right?


This was planned and scheduled, but we decided to do it ahead of our scheduled plans

Every datacenter has emergency maintenance which occurs and we are not different!

We strive on our 100% uptime SLA, as our expertise and hardware allows us to offer such a service, but maintenance of the hardware is how it is maintained.

qps
05-24-2002, 08:21 PM
Originally posted by cabalstudios
How did i know, you would try to make the most of this.

As a former customer of DV2, I have a knowledge of "emergency" situations they have experienced over the past year. I have nothing against you eServers.biz/cabalstudios...

rbro
05-24-2002, 08:23 PM
Originally posted by cabalstudios

This was planned and scheduled, but we decided to do it ahead of our scheduled plans

Then it's not an emergency for christ sakes! You don't "decide" on an emergency!! Look I'm not trying to beat you guys up here, but if you're going to make claims like "100% uptime guarantee, not 99.999%, but 100%" then you better be ready to explain situations like this and better be ready to refund your customers as a result.

cabalstudios
05-24-2002, 08:25 PM
Originally posted by jkehe


As a former customer of DV2, I have a knowledge of "emergency" situations they have experienced over the past year. I have nothing against you eServers.biz/cabalstudios...

How strange that this is the first emergency situation that has occured this year, and you claim to have been in more .... Maybe on your own dream island :D

qps
05-24-2002, 08:30 PM
Originally posted by cabalstudios
How strange that this is the first emergency situation that has occured this year, and you claim to have been in more .... Maybe on your own dream island :D

DV2 has had plenty of outages in the past twelve months. I'm sure you could find quite a few people that would agree with me. I can't say anything about their network in the past two months, however. That's certainly shorter than a year.

EDIT: This is the last comment I will be making on this thread. Interested parties can PM me for more information.

cabalstudios
05-24-2002, 08:34 PM
Originally posted by jkehe


DV2 has had plenty of outages in the past twelve months. I'm sure you could find quite a few people that would agree with me. I can't say anything about their network in the past two months, however. That's certainly shorter than a year.

Jkehe, i know the background between you and DV2, and you and I and all our customers know the truth behind your "false" claims, however i do not wish to turn this thread into a cat and mouse fight...

I have been with DV2 for over 9 months and this is the first emergency situation of such....

BurtonHost
05-24-2002, 08:37 PM
I've been with them for 7 months.. and this is the first "emergency" outage I've had.. The other I've experienced was planned testing of the BGP4 which was very small..

So, all these outages that have been mentioned about the last 12 months Did they happen over 7 months ago.. or are they more recent and I and my customers just haven't noticed?

rbro
05-24-2002, 08:45 PM
Originally posted by cabalstudios

I have been with DV2 for over 9 months and this is the first emergency situation of such....

How can you ofer a 100% uptime guarantee? It's bogus.....This was not an emergency by your own admission. You know people on this forum get really ticked off about unlimited this and unlimited that. How about bogus 100% uptime guarantees? ANd don't try to say that it was an emergency , you just said yourself that you "decided" to do this ahead of schedule.... Please don't make bogus claims of 100% uptime guarantee if you can't back them up. WHy not just say 99.99% and be done with it?

cabalstudios
05-24-2002, 08:51 PM
Richard,

The 100% uptime is not an bogus claim,

It was scheduled and brought forward in the provision of service to enforce the 100% uptime SLA.

ImHosted
05-24-2002, 09:09 PM
We have servers at eServers.biz for months and things have been great... As I am aware, this is the first 'emergency' outage.

For the price, service and support that eServers.biz has given us, We would be paying 3x the amount at a competing service. Their service has been top-notch and equals to that of Rackspace... :)Stuff ups happen and they were one of the first on the forum to help out.. We have been with other dedicated providers who are much more expensive that these guys, not to mention much longer downtimes and support..

>Rbo: Please don't make bogus claims of 100% uptime guarantee if you can't back them up. WHy not just say 99.99% and be done with it?

99.99% would be something on the lines of 15-40 seconds of downtime. What difference would that be over 100% ??? Would it matter? :confused:

JamesTe
05-24-2002, 09:40 PM
My server's are back up now.

UmBillyCord
05-24-2002, 09:43 PM
Originally posted by cabalstudios
Richard,

The 100% uptime is not an bogus claim,

It was scheduled and brought forward in the provision of service to enforce the 100% uptime SLA.

Who would *schedule* a core router reboot at 4 PM PT? That is nuts. Every DC we have been in do so at 2 AM PT. That makes sense.

I agree. 100% uptime is BS. I guess everyone can have 100% uptime when everything is a "emergency". Understood, a 100% uptime is not really a guarantee, only a QOS. But if you offer this QOS, you should honor it. That is a chance you take.

srnetworkeng
05-24-2002, 09:55 PM
I just want to thank all the customers that showed some nice words about how good we are to them. We do try our very best to help you guys out and give you everything you ask for, even if some of it is crazy!!!!! :) jk

From what I have heard from my own customers and from other web sites and forums, you guys are getting the deal of the century.... price, support, and service. unmatched if you ask me. I am sure there are other opinions about that out there, and you are more than welcome to have them. :) I mean, what are you paying here? and what would you pay anywhere else? is it so bad you have to trash hard working individuals like myself on a public forum....


We apologize for the downtime this evening. Upon noticing our router processses hanging we scheduled to reboot the router to see if it would clear it up. Nothing else we were doing would fix it. Upon reboot, nothing changed. We deduced from the error messages on boot that we had a bad processor. We then swapped it out, made the necessary config changes and the router is back up and so far looking better than ever. We are going to send the processor to cisco to have them check it out to see what went wrong with it.

And yes, aside from the BGP test we did a month ago, this is our first major outage in the past 7 months. I wouldn't know of anything prior to that as that is how long I have been with DV2.

cabalstudios
05-24-2002, 10:10 PM
Originally posted by UmBillyCord


Who would *schedule* a core router reboot at 4 PM PT? That is nuts. Every DC we have been in do so at 2 AM PT. That makes sense.

I agree. 100% uptime is BS. I guess everyone can have 100% uptime when everything is a "emergency". Understood, a 100% uptime is not really a guarantee, only a QOS. But if you offer this QOS, you should honor it. That is a chance you take.


Quoting my own post (below)

You will notice i said "It was scheduled and brought forward", and the emergency caused us to do it at 4PM EST ... The actual schedule would have been after 1AM EST ....

Originally posted by cabalstudios

It was scheduled and brought forward in the provision of service to enforce the 100% uptime SLA.

cbtrussell
05-24-2002, 10:10 PM
99.99% would be something on the lines of 15-40 seconds of downtime. What difference would that be over 100% ??? Would it matter?
Actually, 99.99 would be 52.56 minutes of downtime per year, or just over 4 minutes a month. :)

The emergency was the router#1 was due for a reboot to clear things up, as it had an uptime of over 11months.. We had to do this tonight as it seemed we had no alternative....


Cabalstudios,

We don't know each other, so obviously this isn't a personal attack or anything like that, I'm just chiming in with my 0.02...

but...

1) the excuse above is the lamest thing I've ever heard. The emergency was it was due for a reboot because it'd been up for eleven months? I suspect that's what you were told by your contact, but that's a good excuse. you should ask your provider WHY this had to happen during business hours with no notice, and don't accept answers like the above. tell 'em to come clean, 'hey, our router was about to crash hard...'

2) planned? you yourself said you got 5 minutes notice. that's not planned.

3) this most certainly should qualify under SLA. that's what it's there for. this certainly doesn't qualify under an emergency provision, what would be the point of having a SLA at all? otherwise everytime a piece of equipment had a problem, we could all just label it an emergency and move on.

seriously, no offense intended... just pointing out the obvious... good luck with your business, it speaks highly that you were at least posting on here trying to keep folks informed.

Brandon

PS - to you guys fussing about answering the phone, I understand you want info, and they probably should have had an admin or the answering service giving a status update, but would you rather they answer calls from you and 500 other pissed customers, or spend their effort trying to get the network back up? cut 'em some slack.... :)

PPS - i took too long to write, looks like you posted good info on the reason up there since i started typing my post. good follow-up... best of luck.

cabalstudios
05-24-2002, 10:17 PM
cbtrussell looks like you have your answers above :D hehe

Thanks alot....
Once again thanks to everyone for there co-operation....

Have a nice weekend!

sailor
05-24-2002, 10:25 PM
One of our core routers went to 99% utilization a ocuple of days ago and we examined the logs and found that it was updating OSPF adjacencies at the time - we thoough we had a problem with the configuration somehow and examined it - but could find nothing. We had no errors reported on the router - after a reboot it was fine. then this afternoon - it did it again - we examined what was going on and again - no issue. we then rebooted it and it came back with the same problem through multiple reboots. we then decided to replace hardware - after replcing the primary rsp on it - it came back and we reloaded the ocnfig - this remedied the issu. We have fond that the rsp was dying and was intermittently having problems over the last few days - all is well now and we were able to recover a core router failure in 1.5 hours. I am proud of the staff. Great job guys.

This is why many of you (allen - F5) had one server up and one down - we divide our servers across our core. Our dns servers feed through the dying core and we are going to change that. Also - I could not get out to the internet to post anything - since I was not near a computer.

finally - yes our calls come to a 24x7 answering service that logs the calls and performs escalation for us. We do not want our techs that are working on your problems doing nothing but getting flooded with calls. This would be disastrous. This is an outsourced call center - it is cheaper than building our own. MUCH. who cares if it is our or someone elses - they get the job done for us. If you can imagine on an outage like this - if we stopped to take everyones calls and spend time chatting with them - it would be disastrous - we will be happy to taht now that things are fixed. I think we did a great job recovering from a catastrophic core failure - 1.5 hours. :) I wil ltake htat any day - I remember another post about a much bigger company tham us that had to bring a router across town adn it took a half a day.

Any one that wants a credit - please email me and I wil be happy to do somehting for you to stand behind our 100% sla. ?This is not a problem at all. We are happy to do it. Thanks !!!


I hope everyone has a great day - and I will make sure we update our old phone numbers on whois so that people dont think we are going out of business. HEHE. . Thanks - JH

richy
05-24-2002, 10:50 PM
nice reply. nice to see you honoring your sla:) geez it might even restore my faith in sla's:) well done on fixing it so quickly and being so honest.

RackMy.com
05-24-2002, 11:05 PM
Do you only have one core router?

panopticon
05-24-2002, 11:37 PM
I really respect Sailor's reply.

I have always thought a lot of cabalstudios/eservers.biz but I don't like the idea that they advertise a "100% SLA" and then say that because it's "scheduled emergency maintenance" it's not covered. Wouldn't any downtime at all fall under "emergency maintenance scheduled because of the emergency" thus making that 100% SLA a 0% SLA? The 5 minute planned reboot would seem to be "scheduled maintenance" but what followed was obviously downtime. If that isn't downtime covered by the SLA, what would be?

Don't get me wrong - the prices are great. But if you're not able to back up your SLA you should lower it to something you can stand behind - 99.5% or 99.8% is much more respectable if honored than 100% if it means absolutely nothing. Sailor's offer to honor the SLA is what I would like to hear. I personally would not force him to honor it if I had a server there, provided this was just a fluke, but I would want to know that they would and do stand behind the SLA.

rbro
05-25-2002, 12:53 AM
Originally posted by panopticon
I really respect Sailor's reply.

I have always thought a lot of cabalstudios/eservers.biz but I don't like the idea that they advertise a "100% SLA" and then say that because it's "scheduled emergency maintenance" it's not covered. Wouldn't any downtime at all fall under "emergency maintenance scheduled because of the emergency" thus making that 100% SLA a 0% SLA? The 5 minute planned reboot would seem to be "scheduled maintenance" but what followed was obviously downtime. If that isn't downtime covered by the SLA, what would be?

Don't get me wrong - the prices are great. But if you're not able to back up your SLA you should lower it to something you can stand behind - 99.5% or 99.8% is much more respectable if honored than 100% if it means absolutely nothing. Sailor's offer to honor the SLA is what I would like to hear. I personally would not force him to honor it if I had a server there, provided this was just a fluke, but I would want to know that they would and do stand behind the SLA.

I agree completely . That is/was my point exactly. I too really appreciate sailor's reply and I don't think I'll be asking him to honor any kind of refund, but knowing that he offered it makes all the difference. And yes, the 100% uptime means absolutely nothing, Cabal and company. I think you would save yourselves from embarrasing situations like this (not the dv2 router issue and fix - nice job guys!) if you would adopt a realistic uptime SLA. I have no problems with your service and your responses to support queries are quick, but you lose credibility when you guarantee 100% uptime and then call it an "emergency" when there's downtime. It's really meaningless and the fact that you don't seem to understand this or acknowledge it is still perplexing to me. I also understand the phone/call center issue as well. Nice job at DV2.

Matrix
05-25-2002, 02:12 AM
What's this Jheke character rambling on about??

twrs
05-25-2002, 02:59 AM
Oh boy, I'm glad I'm not alone. I just came home today and got the error report from the website monitoring service. It seems that my server was down around 2002-05-24 18:16:16 to 20:03:21 (Eastern Time), almost two hours.

I respect Sailor's reply and refund offer. Thanks also for fixing the router problem, I hope that wouldn't happen again.

I'm curious how much will you refund for this almost two hours downtime? So anyone here took the refund offer yet??? :D

jayjay
05-25-2002, 03:28 AM
I know we've gotten many customers because of their hosts are on DV2 boxes..

Stew
05-25-2002, 04:57 AM
Whatever business you are in some people will love you, and some will have bad experiences. A lot of it tho is down to communication.
Thanks CabalStudios for coming on here and helping to fill in some concerned customers.
Thanks Sailor, for the great server.

No requirement for a refund here, but please, if you are gonna do anything 'scheduled' can you make sure you let your customer base know in advance.
Cheers

mahinder
05-25-2002, 06:54 AM
looks like down again atleast from india :eek:


C:\>tracert eservers.biz

Tracing route to eservers.biz [209.51.159.226]
over a maximum of 30 hops:

1 741 ms 261 ms 120 ms 203.197.36.22
2 190 ms 110 ms 161 ms 203.197.36.1
3 581 ms 130 ms 110 ms 203.197.72.222
4 721 ms 441 ms 110 ms lvsb-vsb-stm-1.Bbone.vsnl.net.in [202.54.2.190]

5 320 ms 310 ms 321 ms if-7-0.bb8.NewYork.Teleglobe.net [207.45.198.65]

6 310 ms * 331 ms sl-gw9-nyc-7-0.sprintlink.net [144.232.173.129]

7 * 841 ms 321 ms sl-bb20-nyc-11-1.sprintlink.net [144.232.7.93]
8 360 ms 321 ms 320 ms sl-bb20-pen-10-0.sprintlink.net [144.232.18.37]

9 641 ms 801 ms 321 ms sl-gw4-pen-9-0.sprintlink.net [144.232.5.18]
10 711 ms 461 ms 871 ms sl-cogentcomm-5-0.sprintlink.net [160.81.202.18]

11 731 ms 992 ms 1782 ms p4-0.core01.dca01.atlas.cogentco.com [66.28.4.17
]
12 591 ms 340 ms 321 ms p15-0.core02.dca01.atlas.cogentco.com [66.28.4.2
2]
13 621 ms 1092 ms 1011 ms p14-0.core01.atl01.atlas.cogentco.com [66.28.4.1
25]
14 1292 ms 1071 ms 1242 ms 66.28.5.242
15 341 ms 330 ms 351 ms dv2.demarc.cogentco.com [66.28.28.254]
16 * * * Request timed out.
17 * * * Request timed out.
18 * * * Request timed out.
19 * * * Request timed out.
20 * * * Request timed out.
21 * * * Request timed out.
22 * * * Request timed out.
23 * * * Request timed out.



C:\>tracert dv2.com
Unable to resolve target system name dv2.com.


:eek3:
edit:

http://www.domainwhitepages.com/ trace

Traceroute
Tracing route to eservers.biz [209.51.159.226]

hop rtt rtt rtt ip address fully qualified domain name
1 0 0 0 216.46.228.241 port-216-3073265-dal16509b-drtn.devices.datareturn.net
2 0 0 0 64.29.192.237 port-64-1949933-zzt0prespect.devices.datareturn.net
3 10 0 0 64.29.192.226 port-64-1949922-zzt0prespect.devices.datareturn.net
4 0 0 0 209.246.152.201 gigabitethernet3-0-101.ipcolo2.dallas1.level3.net
5 0 0 0 209.244.15.93 gigabitethernet10-1.core2.dallas1.level3.net
6 0 0 0 209.247.10.109 so-4-1-0.mp2.dallas1.level3.net
7 40 40 40 209.247.9.114 so-2-0-0.mp1.sanjose1.level3.net
8 40 41 40 64.159.2.133 gigabitethernet4-2.core1.sanjose1.level3.net
9 50 50 50 205.215.1.229 so-2-1-3.pr1.sanfrancisco1.ca.us.netrail.net
10 50 40 50 205.215.12.1 gige2-1.tr1.sanfrancisco1.ca.us.netrail.net
11 60 60 60 66.28.28.57 p13-0.core02.sfo01.atlas.cogentco.com
12 80 71 80 66.28.4.133 p14-0.core02.dfw01.atlas.cogentco.com
13 80 70 80 66.28.4.25 p15-0.core01.dfw01.atlas.cogentco.com
14 80 80 91 66.28.4.98 p13-0.core01.iah01.atlas.cogentco.com
15 90 90 80 66.28.4.46 p15-0.core01.tpa01.atlas.cogentco.com
16 90 80 91 66.28.4.142 p14-0.core01.jax01.atlas.cogentco.com
17 180 200 210 66.28.4.138 p5-0.core01.atl01.atlas.cogentco.com
18 81 90 90 66.28.5.246 g50.ba01.b000173-0.atl01.atlas.cogentco.com
19 90 90 80 66.28.28.254 dv2.demarc.cogentco.com
20 * * *
21 * * *
22 * * *
23 * * *

Trace aborted





hmmm, dv2.com is also not reachable. :rolleyes:

SuperDon
05-25-2002, 06:55 AM
Down from here too.....

Furton
05-25-2002, 06:57 AM
Seems like my server is down again, can't connect from the UK.

twrs
05-25-2002, 07:10 AM
Same here. My server is down too :angry:

Daniel
05-25-2002, 07:13 AM
Down here too :angry: :bawling: :angry:

Mdot
05-25-2002, 07:23 AM
yes, they're down again :angry:

SuperDon
05-25-2002, 07:28 AM
They came back up for just a few minutes.....and now down again!

Stew
05-25-2002, 07:40 AM
server ok here, but painfully slow

Mdot
05-25-2002, 07:42 AM
they're up now..
"up and down, up and down.."

coight
05-25-2002, 08:16 AM
Ours are out again :(

Stew
05-25-2002, 08:20 AM
same here
:bawling:

StevenG
05-25-2002, 08:22 AM
my servers been down for 2 hours - eservers is back up but we aren't - What's the hold up?

coight
05-25-2002, 08:24 AM
Ours are backup, Eservers.biz tells me that one switch is left before everything is functional stay tuned guys :)



Two servers of ours are still down

cabalstudios
05-25-2002, 08:28 AM
Yes after examining the logs last night when everything was stable, we decided to move two switches over to another router to improve reliability to the next level.

One of the switches is back, and so will the other one shortly.
EDIT : Both Switches are back .... everything should be back to normal.

coight
05-25-2002, 08:34 AM
Ours are back!, thanks for the support from eservers.biz :)

StevenG
05-25-2002, 08:34 AM
All is good down under

mahinder
05-25-2002, 08:55 AM
yeah, now working properly and fast. :agree:

:)

sailor
05-25-2002, 09:18 AM
ok - we reblanced things this morning - we found that more servers were deployed on one core as a reult of our growth and we decided to move them to the other side and have the cores equally distributed.

This is done.

This will remedy some of the problems you guys have noticed that one of your servers was smokin on transfer rates and the other was not.


Future - your next question is - what are you dong to control this and have you learned from this - absolutely - we are going to all layer 3 switches on the server uplinks from here on out. the core will handle on packet forwarding and bgp. We are testing foundry fastiron 4802 and cisco 2948g-l3 this week. We wil pick one based on cost / performance and availability in the secondary market.

All new servers will be deployed on these and we will over time migrate some other servers existing to them .


You will all have big smiles on your faces on the upgrades!!!!!

RackMy.com
05-25-2002, 11:10 AM
Do you have only one core router/switch?

cabalstudios
05-25-2002, 11:23 AM
Nope, we have 3 core routers and many core switches, like i said before this only affected about 25% of our network.

Its all fixed, and we are taking precautions to improve it even more.

Thanks for your co-operation, and have a nice weekend!

sbrad
05-25-2002, 11:37 AM
Its all fixed, and we are taking precautions to improve it even more.
Edited.
Deleted.
Whatever you want to call it.

cabalstudios
05-25-2002, 11:49 AM
sbrad,

PM'd you.... waiting for an reply...

qps
05-25-2002, 11:52 AM
Here's an idea: buy enough routers/switches so that you can make your network redundant. It is possible for an outage like this to happen without any customers seeing anything more than a momentary blip while BGP throws them to a different path. It's completely unnecessary to split your customers into two separate networks. It is very possible to never have any kind of network outage if you are multihomed - I've seen it and it works.

(SH)Saeed
05-25-2002, 12:53 PM
I'm glad we're out of there. We learned the hard way that it's not worth the headache and sleepless nights to save a few dollars.
:eek:

MCHost-Marc
05-25-2002, 01:28 PM
Originally posted by sailor
This is done.

Hello? We have 2 servers that have IPs not resolving, please take a look at the ticket.

RackMy.com
05-25-2002, 01:35 PM
Nope, we have 3 core routers and many core switches, like i said before this only affected about 25% of our network. Do you have 3 seperate core systems of three systems in the same core?

twrs
05-25-2002, 01:47 PM
Sailor, how much refund would I receive for this severe downtime?

Incognito
05-25-2002, 09:47 PM
Should have known he couldn't have passed on an opportunity to take a shot. To JKehe: You are a competitor to Sailor and your lack of professionalism only degrades yourself. Regardless of what happened at DV2, it is not your place to get involved.

To twrs, I would suggest you contact him elsewhere to ask for your refund. I know others who have.

As to the thread, not going to repeat the "this isn't DV2's support forum" statement, but just to say, at one time or another we all will experience problems. This one was major. But, best for those involved to see how DV2 handles it with them and evaluate on an ongoing basis with them.

I personally have not received less than 99.94% uptime on any server I have there. However, I am in the process of purchasing a company that suffered 2 hours down time during this instance and I know others suffered more. Again, give DV2 the opportunity to make things right, evaluate their overall performance, and if it isn't satisfactory leave.

However, for those of us who are competitors (and, yes although a customer I do also compete with them), it is never our place to jump in and take shots. In fact, I take no joy or satisfaction in problems experienced by any of my competitors...I have enough to do taking care of my own business.

Matrix
05-25-2002, 10:59 PM
What is this Jkehe characters problem?

mdrussell
05-26-2002, 04:58 AM
Mr. Kehe's problem is payment, or rather lackof. He didn't pay his bills on time to DV2, they cut off his servers and his customers for an extended period until he paid his bills again.

The Laughing Cow
05-26-2002, 07:00 AM
Now my question is - as others have said - why not just have a backup of each hardware device in use router,switch blah blah.

Then I would have thought you would backup the configurations to TFTP for example then when you put the new router in just copy from the TFTP back to NVRAM.

Or is it more complicated than this?

cabalstudios
05-26-2002, 08:09 AM
I think this is being dragged on a little, but just to clarify we have 3 CORE CISCO 7513 routers, and we do have backup hardware of all our main systems.

The CPU module was the issue in the router, which has been sent back to Cisco for examination and was replaced with a backup. We are testing foundry fastiron 4802 and cisco 2948g-l3 level3 switches this week.

Have a nice evening!

thesmallguyshost
05-26-2002, 12:51 PM
Originally posted by cabalstudios
We have everyone working hard around the noc to get this all fixed. The NOC is staffed 24/7 and we have everyone working to speed up the process.

As for the SLA this was an Emergency Maintenance and therefore you do not qualify for refund under the SLA agreement.

What exactly is a SLA for then? YOU/DV2 casued the problem by rebooting the router and now you're not going to stand by your SLA.

And what would cause a router to need an 'emergency reboot' ? You say it couldn't handle the load after it came back.. so that implies it WAS handling the load before... so why reboot it?

thesmallguyshost
05-26-2002, 12:55 PM
Originally posted by cabalstudios
The emergency was the router#1 was due for a reboot to clear things up, as it had an uptime of over 11months..
We had to do this tonight as it seemed we had no alternative....

I'd like to thanks everyone for there co-operation with us, in this matter.

Huh? What's it running? Windows? You had to reboot it because it had been too long??!!???

That is NOT an emergency... YOUR equipment.. YOUR fault. Looks like everyone needs to offer 100% sla becuase that means they don't really have to stand by it when they don't want to.

thesmallguyshost
05-26-2002, 12:57 PM
Originally posted by cabalstudios



This was planned and scheduled, but we decided to do it ahead of our scheduled plans

Every datacenter has emergency maintenance which occurs and we are not different!


Read these two sentences again.... was it planned or was it an emergency? You don't have PLANNED EMERGENCIES....

thesmallguyshost
05-26-2002, 01:01 PM
Originally posted by cabalstudios
Richard,

The 100% uptime is not an bogus claim,

It was scheduled and brought forward in the provision of service to enforce the 100% uptime SLA.

So now it's scheduled? Last response was it's an emergency.

I know i'm late on these posts but this is very interesting.

100% mean 100% period..... emergency, planned it doesn't matter.... if it's down for 1 min it's NOT 100%

cabalstudios
05-26-2002, 01:04 PM
rastoma, ehm...

this has already been explained, and is non of your business, your a competitor, YOU just need an opportunity to bash any hosts to make yourself look better, but take my word for it, IT DOSENT WORK LIKE THAT, your making yourself look like a FOOL.

The information on this board or any of our boards is for current or future clients not competitors.

As, for our clients that wanted to know or still want to know, we do have our own support forums.

As far as we are concerend this topic is closed in WHT.

Anyone that has outstading issues or queries use the CORRECT support forums, and you will get answers to your questions.


Imran

rastoma, keep your personal vendeta to yourself were not interested.

thesmallguyshost
05-26-2002, 01:05 PM
Originally posted by srnetworkeng

And yes, aside from the BGP test we did a month ago, this is our first major outage in the past 7 months. I wouldn't know of anything prior to that as that is how long I have been with DV2.

Doesn't a typical BGP setup include TWO routers? If so, what happened to the backup they are supposed to have?

Stew
05-26-2002, 01:08 PM
agreed this is not a support forum for dv2/transxact/eservers but we turn to this site when your sites are actually unavailable because your entire network is down.

Anway, it's all working again now, yay
:)

cabalstudios
05-26-2002, 01:12 PM
Originally posted by Stew
agreed this is not a support forum for dv2/transxact/eservers but we turn to this site when your sites are actually unavailable because your entire network is down.

Anway, it's all working again now, yay
:)

Stew,

Our entire network was not down, only %25 was affected.

We, understand you having queries on this board as, our support servers were down, but they have been up for well over 24 hours, and theres no need to continue a thread on this board, when the only respect you get is none, from competitors, who just want to bash and bash all day.

Thanks
Imran

thesmallguyshost
05-26-2002, 01:12 PM
Originally posted by jkehe
Here's an idea: buy enough routers/switches so that you can make your network redundant. It is possible for an outage like this to happen without any customers seeing anything more than a momentary blip while BGP throws them to a different path. It's completely unnecessary to split your customers into two separate networks. It is very possible to never have any kind of network outage if you are multihomed - I've seen it and it works.

That's the mistake a lot of people are believing in some DC's nowadays.... they claim multihomed/bgp when in fact they just have more than one provider.

It's not the same.

cabalstudios
05-26-2002, 01:15 PM
Originally posted by rastoma


That's the mistake a lot of people are believing in some DC's nowadays.... they claim multihomed/bgp when in fact they just have more than one provider.

It's not the same.

Now, I understand where your'e coming from; you and Jeff Kehe, what would one expect from you, nothing but LIES.


Imran

Stew
05-26-2002, 01:16 PM
I apologise for saying your entire network was down.
I was unable to connect to your support area, or the transxactglobal support area, so in my limited view that means it's all down.

Sorry
:love:

cabalstudios
05-26-2002, 01:19 PM
Originally posted by Stew
I apologise for saying your entire network was down.
I was unable to connect to your support area, or the transxactglobal support area, so in my limited view that means it's all down.

Sorry
:love:

No need to apologise I understand where your coming from, If I was in your shoes i'd do the same, but some people are just plain EVIL.


Imran

thesmallguyshost
05-26-2002, 01:20 PM
Originally posted by cabalstudios
rastoma, ehm...

this has already been explained, and is non of your business, your a competitor, YOU just need an opportunity to bash any hosts to make yourself look better, but take my word for it, IT DOSENT WORK LIKE THAT, your making yourself look like a FOOL.

The information on this board or any of our boards is for current or future clients not competitors.

As, for our clients that wanted to know or still want to know, we do have our own support forums.

As far as we are concerend this topic is closed in WHT.


I'm not BASHING anyone. I'm questioning your replies to customers. This board is NOT your board.. it's a PUBLIC DISCUSSION of event's.. the topic at hand which is fine.. everyone has problems.. I've had my own. But I was just bringing to task you're own statements that changed from post to post and about your SLA. That's all. I did NOT bash you or your company or DV2. If it was construed as such I apologize.. and if called you a FOOL as you did me then that would be construed as bashing. But I don't lower myself to those kinds of personal attacks. A publicly posted discussion and me making comments on a publicly posted document (IE your SLA) is just that.. a discussion.

For some reason there's more to this then meets the eye and you're apparantly offended for some reason because of this... that brings on even more wonderment.


Imran

rastoma, keep your personal vendeta to yourself were not interested.

thesmallguyshost
05-26-2002, 01:21 PM
(hit reply insted of edit :)

thesmallguyshost
05-26-2002, 01:25 PM
Originally posted by cabalstudios


Now, I understand where your'e coming from; you and Jeff Kehe, what would one expect from you, nothing but LIES.


Imran

I did not indicate that DV2 did not have BGP... it's a common thing for DC's to advertise now aways multiple connections and call it multihomed.

My, my.... are you so worried about something........

cabalstudios
05-26-2002, 01:32 PM
rastoma,

You're well known for what you do on this forum, and this isnt the first time you have tried to attack both ourselves and DV2.

Do you remember the investor (kip3d) that you lied to about our business, and that we were a "bunch of indians with free loans from USA banks", talking about going down to such a level, you went to the lowest level.

Its a shame all kip3d did was tell me the whole conversation he had with you, and slapped you red in the face.

Imran

qps
05-26-2002, 01:48 PM
You are so defensive. You can say that I lie all day long - most people don't believe you anyway. As long as I get the message out to even just one person that what goes on at DV2 is just no good business, I feel that I've done my part to contribute to this board. This board, after all, was founded to allow customers to post reviews and experiences with companies, whether positive or negative.

Ratsoma and I have had our disagreements in the past, and I'm pretty sure you can find them on this board. What's funny is that he posted a simple comment on the thread, and you attacked him just the same as you attack me.

Please keep in mind, cabalstudios, that I have nothing against you personally, other than your choice to do business with DV2. I hope that your comments from this point forward will not personally attack myself or any other member of this board... that's not what this board is for.

cabalstudios
05-26-2002, 01:57 PM
You can say that I lie all day long - most people don't believe you anyway. As long as I get the message out to even just one person that what goes on at DV2 is just no good business, I feel that I've done my part to contribute to this board. This board, after all, was founded to allow customers to post reviews and experiences with companies, whether positive or negative.

jkehe,

I never said that you LIED, I have in the past argued with you about other issues, but they are not relevant in this case, and by the way rastoma is not a client, and never will be.


Thanks

SoftWareRevue
05-26-2002, 02:04 PM
Originally posted by cabalstudios


jkehe,

I never said that you LIED, I have in the past argued with you about other issues, but they are not relevant in this case, and by the way rastoma is not a client, and never will be.


Thanks Right. You were only talking to rastoma when you said, Now, I understand where your'e coming from; you and Jeff Kehe, what would one expect from you, nothing but LIES.

I see that only infers that anything jkehe says would be a lie. And not actually calling him a liar. :rolleyes:

This thread has been quite revealing. I imagine, even the casual surfer, can draw their own conclusions easily.

mdrussell
05-26-2002, 02:08 PM
Originally posted by SoftWareRevue
This thread has been quite revealing. I imagine, even the casual surfer, can draw their own conclusions easily.

Absolutely - nothing like some alternative entertainment on a Sunday :rolleyes: :eek:

cabalstudios
05-26-2002, 02:09 PM
Now, I understand where your'e coming from; you and Jeff Kehe, what would one expect from you, nothing but LIES.

The intentions of this post, was forwared to rastoma not jkehe, otherwise I would have stated "what would one expect from both of you, nothing but LIES"

I rest my case.


Imran

cabalstudios
05-26-2002, 02:10 PM
Originally posted by voxtreme-matt


Absolutely - nothing like some alternative entertainment on a Sunday :rolleyes: :eek:

Well, someone has to spice up life at some stage. ;)

Let the secrets be revealed.


Imran

thesmallguyshost
05-26-2002, 02:32 PM
Oh well...

I have no idea what you're talking about and I would never refer to a group of people 'as a bunch of indians'. I have too many varied ethnic backgrounds in my family to be disrespectful like that.

Anyway.... good look to all... to Sailor, Imran and anyone else here.

Have a nice weekend.

qps
05-26-2002, 04:35 PM
Originally posted by cabalstudios
I never said that you LIED, I have in the past argued with you about other issues, but they are not relevant in this case, and by the way rastoma is not a client, and never will be.

I don't have any idea of what you are talking about. I've never been a customer of yours, and have never done business with you. I have done business with DV2 in the past, however, which gives me every right to comment about the services they offer. Just because you think DV2 is good, and I think DV2 is bad, it does not give you the right to infer that everything that I say is a lie.

MCHost-Marc
05-26-2002, 06:36 PM
All the flaming going on at WHT, who's better and who's worse ...its just incredible. Do you guys get paid to do this all day long? Come on, get back to business.

bruce1234at
05-27-2002, 06:21 AM
i would have to agree...i would of thought those of you guys who have companies to run would not have to time to waste arguing over such petty little things.

clocker1996
05-27-2002, 08:02 AM
k lets just end it right here
i dont think anybody should reply after this post

311
05-27-2002, 08:07 AM
Originally posted by clocker1996
i dont think anybody should reply after this post

Okay...:homer:

mahinder
05-27-2002, 09:58 AM
Originally posted by clocker1996
k lets just end it right here
i dont think anybody should reply after this post

:look:

:D

Gem Hexen
05-28-2002, 07:45 PM
Jeez guys, just stop posting!

Joana
05-28-2002, 08:21 PM
Originally posted by clocker1996
k lets just end it right here
i dont think anybody should reply after this post

no problem :D

mwatkins
05-28-2002, 10:04 PM
;) OK :cool:

rally
05-28-2002, 10:15 PM
np:cool: :smokin: :pimp:

Joana
05-28-2002, 10:16 PM
:wavey:

MotleyFool
05-29-2002, 10:50 AM
sure thing!

thats why i aint posting

The Laughing Cow
05-29-2002, 12:26 PM
in this thread?

Sean
05-29-2002, 04:27 PM
its wednesday

sean

sailor
05-29-2002, 06:36 PM
(edit) we are friends -everyone is happy :)

allera
05-29-2002, 06:46 PM
Originally posted by sailor
yes go and read about seans little act of immaturity LOL!!!

Right on man -
Oh, the irony... :D

Sean
05-29-2002, 09:36 PM
Originally posted by sailor
yes go and read about seans little act of immaturity LOL!!!

Right on man -

right on

ebay-nut
06-22-2002, 07:19 PM
....