PacificRack down again?

Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > PacificRack down again?

Posted by Mikie4648, 03-21-2011, 04:12 AM
All my sites and servers are down.

Im getting a bit tried of the continual fiasco. I can count more than 3 occassions this has happened in so many months.
Posted by Mikie4648, 03-21-2011, 04:14 AM
Up again after about 15min.
Posted by IH-Chris, 03-21-2011, 04:25 AM
have you contacted them? Did they give you a reason? Is this isolated to a dedicated server?
Posted by Mikie4648, 03-21-2011, 04:27 AM
Nope, i have more than 1 server on multiple subnets.
Posted by IH-Chris, 03-21-2011, 04:32 AM
It might be good to contact their support department to see what is up. They should be able to tell you what the problem was. If not, PM CGotzmann, I'm sure he would be more than glad to assist you.
Posted by PeterPP, 03-21-2011, 04:42 AM
what lax are you at?
Posted by CGotzmann, 03-21-2011, 04:51 AM
No, we did not have downtime ....
Posted by Steven, 03-21-2011, 04:53 AM

Quote:

Originally Posted by CGotzmann

No, we did not have downtime ....

I saw downtime on a couple routes... My main monitoring node is on the PR network, there was some blips to a few areas during the OP's timeframe.
Posted by Mikie4648, 03-21-2011, 04:55 AM
So im imagining it? I lost all my ssh sessions. I tested websites on multiple boxes all returned page not founds and my email clients reported triangles indicating that it could not connect to any server. It lasted a good 15 - 20min.
Posted by IH-Chris, 03-21-2011, 04:56 AM

Quote:

Originally Posted by Steven

I saw downtime on a couple routes... My main monitoring node is on the PR network, there was some blips to a few areas during the OP's timeframe.

oops, that could change things up a bit.
Posted by Katie, 03-21-2011, 04:57 AM
This is due to one of our upstream having an unexpected router reboot. When their router rebooted it took some minutes/seconds while BGP found a different path to us.

Chris should be able to provide more details when he has them.
Posted by CGotzmann, 03-21-2011, 04:58 AM
Did you get a traceroute? Please submit it to our helpdesk so we can investigate.
We didn't get any monitors going off though it could have been isolated to a few specific routes. Though we for sure did not have an all out outage. We are checking a bit deeper now.
Posted by IH-Chris, 03-21-2011, 04:59 AM
Now if that isn't contradicting..
Posted by Katie, 03-21-2011, 05:02 AM

Quote:

Originally Posted by IH-Chris

Now if that isn't contradicting..

Yes, because we were both checking it out at the same time.
Posted by CGotzmann, 03-21-2011, 05:03 AM

Quote:

Originally Posted by IH-Chris

Now if that isn't contradicting..

We have many upstreams, if one of their routers rebooted it could cause some routes to be affected (the ones going over the affected backbone) until BGP re-converged.

I'm not going to make factual statements until I have more information, we are still researching and waiting for a reply from the backbone's NOC. The one fact I do know is that the downtime was not network-wide.

Update:
I'm looking at all the uplinks to our backbones/peers and I see which one had the issue and we are waiting on a response from their NOC as to what happened, as the issue did not occur on our end. Looks like there was a short dip in bandwidth which jumped back to normality shortly there after.

This is probably best a conversation for our own community forums or support desk however.
Posted by IH-Chris, 03-21-2011, 05:08 AM
Cool deal, figured you would be on it. But was confused with the previous comment.
Posted by Mikie4648, 03-21-2011, 05:09 AM
No problem thanks for looking into this.
Posted by CGotzmann, 03-21-2011, 05:32 AM
Theres a thread started regarding this in our community forums (I dont think I can link to them per WHT rules), I will update it once we have more information from nLayer. It's probably a better place to discuss this.

If the issue begins to repeat itself throughout the night, we will drop them from BGP to alleviate the issue until we have a response/resolution. Though, I would guess that it was probably just a one-time thing as nLayer is usually very reliable.
Posted by anon-e-mouse, 03-21-2011, 06:20 AM

Quote:

Originally Posted by CGotzmann

(I dont think I can link to them per WHT rules),

You can down here if it is pertaining to the outage.
Posted by NetDepot - Terrence, 03-21-2011, 10:55 AM

Quote:

Originally Posted by Motiv

Sorry to hear about your bad experiences with the network there. Where is PR located?

They are located in LA, but I think they also have a location in Dallas.
Posted by jackpx, 03-21-2011, 12:31 PM

Quote:

Originally Posted by THAMAN

They are located in LA, but I think they also have a location in Dallas.

Yes, they have DC in LA y TX
Posted by Katie, 03-21-2011, 12:37 PM
You can check our forum thread here: http://forum.quadranet.com/showthrea...1-1-02AM-GMT-8

Right now the RFO is still being diagnosed. No further issues have occurred on the uplink but if any emergency maintenance is planned, we will let you know there.