I can reach my server.... are they down? :bawling:

I'd say so....

Target Name: www.pwebtech.com
IP: 64.21.5.34

1 13 ms 13 ms 42 ms [10.110.30.1]
2 28 ms 14 ms 28 ms bb1-fe0-0-0.sptnbrg1.sc.home.net [24.4.112.1]
3 41 ms 13 ms 27 ms c1-se5-1.gnvlsc1.home.net [24.7.77.77]
4 41 ms 14 ms 41 ms c1-pos1-0.nrflva1.home.net [24.7.65.218]
5 41 ms 41 ms 27 ms c2-pos2-0.washdc1.home.net [24.7.65.213]
6 42 ms 14 ms 28 ms c1-pos10-0.washdc1.home.net [24.7.78.177]
7 27 ms 27 ms 27 ms ATM2-0.BR3.DCA8.ALTER.NET [204.255.168.5]
8 55 ms 28 ms 28 ms 0.so-4-1-0.XR1.DCA8.ALTER.NET [152.63.36.6]
9 41 ms 41 ms 27 ms 0.so-3-0-0.TR1.DCA8.ALTER.NET [152.63.144.49]
10 69 ms 28 ms 41 ms 115.at-6-2-0.TR1.NYC9.ALTER.NET [152.63.9.198]
11 55 ms 27 ms 41 ms 187.ATM5-0.XR1.NYC4.ALTER.NET [152.63.21.121]
12 41 ms 41 ms 42 ms 189.ATM6-0.GW7.NYC4.ALTER.NET [152.63.25.105]
13 82 ms 41 ms 55 ms internap-gw.customer.alter.net [157.130.50.86]
14 69 ms 41 ms 42 ms border11.ge3-0-bbnet2.nyc.pnap.net [209.191.128.145]
15 55 ms 27 ms 55 ms nac-1.border11.nyc.pnap.net [209.191.130.94]
16 55 ms 55 ms 42 ms a0-0-0-1010.core1.oct.nac.net [209.123.11.149]
17 55 ms 27 ms 55 ms vlan1.msfc1.oct.nac.net [207.99.21.35]
18 55 ms 69 ms 55 ms [207.99.8.198]
19 * * * Destination Address Unreachable []
20 * * * []
21 * * * []
22 * * * []
23 * * * []
24 * * * []
25 * * * []
26 * * * []
27 * * * []
28 * * * []
29 * * * []
30 * * * []
31 * * * []
32 * * * []
33 * * * []
34 * * * []
35 * * * []

Its working from here :o)

Regards
Craig

i cant seem to access them :(

They're up for me...


==================================================
=== VisualRoute report on 12-Jul-01 9:34:59 PM ===
==================================================

Real-time report for www.pwebtech.com [64.21.5.34] (100% done)

Analysis: 'www.pwebtech.com' was found in 12 hops (TTL=244). It is a HTTP server (running Apache/1.3.12 (Unix) PHP/4.0.4pl1
FrontPage/4.0.4.3 mod_ssl/2.6.5 OpenSSL/0.9.5a).

--------------------------------------------------------------------------------------------------------------------------------------------------------------
| Hop | %Loss | IP Address | Node Name | Location | Tzone | ms | Graph | Network |
--------------------------------------------------------------------------------------------------------------------------------------------------------------
| 0 | | 151.197.8.20 | adsl-151-197-8-20.phila.adsl.bellatlantic.net | Philadelphia, PA, USA | -5.0 | | | Bell Atlantic |
| 1 | | 10.7.23.1 | - | ... | | 28 | -x- | (private use) |
| 2 | | 151.197.4.66 | F0-1-0.Q-RTR1.PHIL.verizon-gni.net | ?Reston, VA 20191 | | 37 | -x------- | Bell Atlantic |
| 3 | | 205.171.62.101 | jfk-edge-04.inet.qwest.net | New York, NY, USA | -5.0 | 29 | -x- | Colorado Supernet, Inc. |
| 4 | | 205.171.30.109 | jfk-core-02.inet.qwest.net | New York, NY, USA | -5.0 | 27 | x- | Colorado Supernet, Inc. |
| 5 | | 205.171.30.86 | jfk-edge-01.inet.qwest.net | New York, NY, USA | -5.0 | 34 | -x- | Colorado Supernet, Inc. |
| 6 | | 208.46.158.38 | internap-nyc.qwest.net | - | | 27 | x-- | Qwest Communications |
| 7 | | 209.191.128.145 | border11.ge3-0-bbnet2.nyc.pnap.net | New York, NY, USA | -5.0 | 52 | --x--- | ?209.191.128.0 |
| 8 | | 209.191.130.94 | nac-1.border11.nyc.pnap.net | New York, NY, USA | -5.0 | 27 | x-- | ?209.191.130.0 |
| 9 | | 209.123.11.149 | a0-0-0-1010.core1.oct.nac.net | - | | 28 | -x- | Net Access Corporation |
| 10 | | 207.99.21.35 | vlan1.msfc1.oct.nac.net | - | | 27 | x-- | Net Access Corporation |
| 11 | | 207.99.8.198 | - | ?Newton, NJ 07860 | | 37 | x- | Net Access Corporation |
| 12 | | 64.21.5.34 | www.pwebtech.com | ?Newton, NJ 07860 | | 35 | -x-- | Net Access Corporation |
--------------------------------------------------------------------------------------------------------------------------------------------------------------
Roundtrip time to www.pwebtech.com, average = 35ms, min = 27ms, max = 55ms -- 12-Jul-01 9:34:59 PM

I can access them just fine. Although, my trace went across Abovenet before NAC.... which it normally doesn't do for me.

It's back from here now too... Maybe a momentary problem then?

Yep, they are backup and faster then ever!

They were doing a hardware upgrade from what I here. That is why there were some intermittant connection problems.

They are up now.... Boy I luv em!:D

I wanted to confirm that we had a multi-hour outage too, confirmed by network monitoring we have in place.

PWebTech did not notify us in advance...

That stinks :( How long were they down?

Originally posted by StephenRS
I wanted to confirm that we had a multi-hour outage too, confirmed by network monitoring we have in place.

PWebTech did not notify us in advance...


Multi-hour? It lasted all of about ten minutes, here.

My network monitoring logs shows major slowdowns all day for 7/12 (over 4 second response time to a 100 byte request, normally takes 0.1 second).... we switched to our other site.

We kept monitoring so we would know when things cleared up.

-- Our monitoring showed 3:24:56pm it was 100% down until 3:29:36.
-- Then at 5:34:29pm could not reach our server at all until 6:03:00pm.

Not one request, and we tried to connect every 1/2 second. And as I said, it was very slow when we could connect. Some delays as long as 12 or 15 seconds.

Clearly something bad going on... 7/12 (Thursday). All times above are PDT.

Check your web logs on your servers, I bet you will see the 5:35 to 6:03 as a total blackout.... with some loss up until 6:12pm.

For our purposes, delays of more than 2 seconds are enough to ruin the purpose of the server... so my "multi-hours" includes the slowdowns.

You're the guy that runs the Ebay thing, right? I can see how such things would affect you pretty harshly. Fortunately, it's a rare occurrence at NAC/Pegasus - I've got a down from 8:49PM Eastern to 9:05PM Eastern for yesterday, and that's it (matches your time, but shorter range). A little longer than the ten minutes I mentioned previously, but not horrible. We didn't see any massive slowdowns that lasted all day, though, I can tell you that. Overall, the performance at NAC has been good, wouldn't you agree?

Yes, PWEBTECH has good overall performance. I'm in Seattle - and our other server is at Phoenix.

I wish their network was a little more consistent... we sometimes see problems going in/out from both Phoenix and Seattle at the same time -- but they aren't that frequent... but more frequent than what we have in Phoenix.

I'm trying to find a California ISP who can even come close to the price, so far no luck :)

Heh. I think I'd be more worried about the rolling blackouts/brownouts out there.

I'm not. Look, all ISP's have problems, period :) I believe in total redundancy, not perfection.

PWebTech didn't need power outages to have problems.

Any ISP worth a pile of salt has already dealt with power problems if they are in CA. Probably why I can't find any at even 1.5x the price of what I'm paying PWebTech!

If I could get 50GB/month 1U for under $250 in SF/San Jose/Fremont, I'd be happy...

Tell that to Yahoo and Exodus. Of course, that was a little more severe than a regular power outage, but it's pretty impressive to have lines blow up under the NOC and both the primary and secondary power backup sources fail. Woooeee. The price of modern technology, eh? :)

Do let us know if you find anything like that, though...the only condition is that you can't be dreaming it - it must be real. ;)

I was watching a news piece about the blackouts and they said it could happen elsewhere, in other parts of the country... sure you all laugh at us now... :(

*Goes to store to buy a bigger UPS*

It's true that rolling blackouts are already a problem in more states than California, and other states might be feeling that threat soon too. However, it really depends on your carrier. I'm dead in the middle of Northern California, and I have absolutely no worries about any rolling blackouts, due to who my city's provider is. However, not more than 5 to 12 miles away in about any direction, they have been hit.

Also, it's worth mentioning, that the one's that were hit, was only once, for about an hour, since this "power emergency" started so long ago in this state. You'll be okay with going with any state, even in this situation, as long as you investigate the provider and the location of the data center. There's some prime places in my area, right next to (on the same block as) the switching station, a major hospital, a school, a police station and a fire station (plus being on a provider that doesn't have to do the rolling blackouts -- we're safe here). The only problem being, getting the lines, since there's no NOC there now.

Of course, speaking of rolling blackouts for people that are affected, when they capped the prices, it would be helpful if the crooked power company's didn't just completely and literally shut off their plants, just out of sheer greed. I feel sorry for the people affected. Those company's should be forced to sell and be shot.

Just to make something clear that bit of downtime that happened the other day, was NOT a result of a downed link, power, or failure of any kind. I am not going to go into the details of it. If have told a few clients what happened, if any CLIENTS want to know, I would be more than happy to tell them. Just email me. We are implementing a solution to help deter this problem from happening again, we believe this give us very good protection against it.

A little longer than the ten minutes I mentioned previously, but not horrible. Wow, you guys are easy :)

So did anyone here what they are actually going to do in CA about the power shortages? I heard that Bush wants to build 1 new power plant every month for 20 years.

Why would you want servers in California? The only people they would be faster for are people on that coast. Besides Level3 California isn't all that fast. My friend in California can get a faster ping on my servers at Nac then he can on any servers in the level3 room less than 100 miles away!

Originally posted by RackMy.com
Wow, you guys are easy :)



It's never easy. :)

But these things happen, and that's the way it is. No sense in getting an ulcer, no matter what the cause, unless a) it's something caused by the provider themselves, like Sprint screwing up BGP in Orlando, which happened a couple months ago, or b) you simply can't get in touch with that provider to see what's going on. People like Stephen have backup plans for what they deem to be mission critical items, and he's to be praised for that. 10-15 minutes when you know the provider is working on it is a great deal better than, say, four hours when you have no idea what's going on.

Jay and crew are the best I've seen yet, and I appreciate, personally, the stuff they've done over this past week working with us, as it's been a rather hellish week.

OK, now that's over, and we can all go back to our happy little lives. :)

Chicken, if you guys out there could figure out a way to harness the electricity from lightning and send it out there, you'd be more than welcome to come here to Florida. The summers would probably give you enough juice to last the rest of your life. There's nothing quite like seeing the flash of lightning and simulteneously hearing the thunder crash around you (hint to people where these types of storms don't occur: this means that you're right dead center of the storm, and shouldn't take a stroll outside for a peek - after all, the odds of getting struck by lightning here are better than the odds of winning the lottery). Frightens the cats, though...

Originally posted by Chicken
I was watching a news piece about the blackouts and they said it could happen elsewhere, in other parts of the country... sure you all laugh at us now... :(

*Goes to store to buy a bigger UPS*

You mean you don't already have a generator in your backyard? :stickout

Speaking of pegasus...

How do you reach their support?
http://www.pwebtech.com/contactus.html

I called both the 888 and 973 area code numbers (toll free and direct)... and I get no answer then sent to a voice mail loop for mailbox that won't take message.

is there some other number you are supposed to call for emegency 24x7 support?

My situation isn't that serious, just the first time I've had to call them.

If you need to reach us, emergecny dial the NOC Line, that I sent you a while ago, which is staffed 24/7.

I found the number and was able to get a live person.

Originally posted by Annette
Chicken, if you guys out there could figure out a way to harness the electricity from lightning...

We're much too busy attempting to harness the power of earthquakes, wildfires, costal mudslides, and gridlocked traffic, but we'll look into that one as soon as we exhaust our own 'natural resources' such as these. :D

Monday morning, brief outage starts at 01:04:15 then comes back before 01:06. Then 1:19:50am PDT I see another outage, going on 20 minutes so far...

I can not reach my server or the pwebtech.com site from either Seattle or Phoenix.

Anyone else?

Doesn't anyone read other posts. NAC is upgrading there core routers and switches. This is scheduled nac.net downtime.

Jay - I am not "anyone" - I am a customer. Who is "NAC"? Where are we supposed to read about these outages?

For some reason, I wasn't nofitied via the noc mailing list, I was supposed to get an email about this on wed, but, we were upgrading our mail servers on that day, so I think we missed it, and thus wasn't aware of it.

Well, your timing is terrible. This is right when I do my once a week downtime, now I'm screwed. I sure hope this outage is prevention toward future ones :)

Thats the general idea, i.e more ram, new IOS versions, faster CPU's.

Back up at 01:47:31.

Hey Jay,

You may want to ask NAC why they are updating all their routers at once. That's never a smart idea!

Worldcom learned that the hard way a couple years ago.

Originally posted by RackMy.com

Worldcom learned that the hard way a couple years ago.

BWAHAHAHAHAHAHA!! WorldCom learns nothing :D.