WiredTree dead

Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > WiredTree dead

Posted by bpcbpc, 03-06-2012, 12:19 PM
WiredTree not working properly :/ https://grove.wiredtree.com down for me.

I'm pinging my site: 35% packet loss (dedicated hosting on WiredTree). Can't load my sites in my browser at all.

What's happening. Any WiredTree support people here?
Posted by Askforhost-AJ, 03-06-2012, 12:21 PM
working on my side
Posted by huckyboy, 03-06-2012, 12:21 PM
same here

from the wt twitter

We're not down, but one of our upstream backbone providers may be having issues. We are looking into it.
Posted by Yogesh Sarkar, 03-06-2012, 12:22 PM
Same here, unable to access my sites.
Posted by KMyers, 03-06-2012, 12:23 PM
Hello,
Grove is loading for me, just real slow
Posted by bpcbpc, 03-06-2012, 12:23 PM
Just opened their Twitter - yep, there's some info. (it wasn't there when I started to write this topic).
Posted by davidpaj, 03-06-2012, 12:28 PM
I can't get to wiredtree.com or my servers.... Worried....
Posted by PCplayground, 03-06-2012, 12:30 PM
Same here, can't access my sites or grove.

"It's not just you! http://grove.wiredtree.com looks down from here. "
http://www.downforeveryoneorjustme.c....wiredtree.com
Posted by twhiting9275, 03-06-2012, 12:32 PM
Dead from here as well, and I'm not that far from Chicago.
Something's definitely up (or down).
Posted by dyna!, 03-06-2012, 12:32 PM
Seems to be very slow/timing out. Trace is really unreliable once it hits their edge routers; there seems to be a lot of DDoS attacks against hosts today so may be related (just a guess).
Posted by VidiJoe, 03-06-2012, 12:39 PM
Same goes here. Hopefully they get this resolved soon, can't admin any of our websites
Posted by davidpaj, 03-06-2012, 12:39 PM
Me too here in N.C. man this has messed up my workday.
Posted by VidiJoe, 03-06-2012, 12:41 PM
Looks like it has been solved - I am seeing my sites and can also access grove now
Posted by san-deep, 03-06-2012, 12:42 PM
Same here getting following error on my sites
502 Bad Gateway
The server returned an invalid or incomplete response

Unable to login to groove getting following error:
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.
Posted by Yogesh Sarkar, 03-06-2012, 12:43 PM

Quote:

Originally Posted by VidiJoe

Looks like it has been solved - I am seeing my sites and can also access grove now

Nope, still not working here.
Posted by PCplayground, 03-06-2012, 12:44 PM
They just tweeted "Engineers are still working on it"

Edit: I'm still down, sometimes I get the 502 error on the grove panel now though.
Posted by davidpaj, 03-06-2012, 12:46 PM
I can ping my server, but i can't access it.
Posted by twhiting9275, 03-06-2012, 12:47 PM
So much for 'managed networks', right?
Funny, their own network is fine, but everyone else's isn't.
I don't count grove as part of 'their own network' by any means, but their own page is a breeze to load.
Posted by davidpaj, 03-06-2012, 12:52 PM

Quote:

Originally Posted by linux-tech

So much for 'managed networks', right?
Funny, their own network is fine, but everyone else's isn't.
I don't count grove as part of 'their own network' by any means, but their own page is a breeze to load.

I'm not knocking them down, but I've wondered the same thing, why there pages load and ours don't. I thought we were all in the same datacenter.
Posted by whiplash13, 03-06-2012, 12:53 PM
Same issue here. It starts to load but never finishes. This may be the straw that broke the camel's back for me and Wiredtree. Been seeing some really slow response times from NY lately with them and they see no issues on their side. It may just come down to their provider network.
Posted by davidpaj, 03-06-2012, 01:00 PM

Quote:

Originally Posted by whiplash13

Same issue here. It starts to load but never finishes. This may be the straw that broke the camel's back for me and Wiredtree. Been seeing some really slow response times from NY lately with them and they see no issues on their side. It may just come down to their provider network.

I'm kind of any the same boat on a different issue, but managing servers as a living myself, I understand things happen. I'm trying to be patient.
Posted by Serverji, 03-06-2012, 01:05 PM
All my servers are down. They claim 100% Network Uptime SLA.
Does this qualify for a refund ?
Posted by bpcbpc, 03-06-2012, 01:06 PM

Quote:

Originally Posted by linux-tech

So much for 'managed networks', right?
Funny, their own network is fine, but everyone else's isn't.
I don't count grove as part of 'their own network' by any means, but their own page is a breeze to load.

Yep, got to find out which company is hosting their main page, and rent a server there for myself too. But seriously, this sucks :/ I'm losing money here...
Posted by Awesys, 03-06-2012, 01:06 PM
Just adding here that my server is also down.
Posted by Khattak, 03-06-2012, 01:08 PM
Down times are routine with Wiredtree now, Its down for me as well.
Posted by davidpaj, 03-06-2012, 01:09 PM

Quote:

Originally Posted by bpcbpc

Yep, got to find out which company is hosting their main page, and rent a server there for myself too. But seriously, this sucks :/ I'm losing money here...

I'm loosing money too, a few hundred so far.
Posted by KMyers, 03-06-2012, 01:09 PM

Quote:

Originally Posted by Serverji

All my servers are down. They claim 100% Network Uptime SLA.
Does this qualify for a refund ?

Hello,
Please read the entire thread about the "credit" you can get. Its not a full refund, just a partial credit

Quote:

WiredTree guarantees network availability for our public Internet network to be 100%. In the event that our network does not experience 100% network uptime in a given month, WiredTree will refund 5% of the customer's monthly service fees for those servers affected, for each 30 minutes of network downtime experienced up to 100% of the monthly service fees for those servers affected.

Posted by VidiJoe, 03-06-2012, 01:16 PM
Spoke to soon only getting one site. Nothing we can do except wait it out
Posted by hosting_talk, 03-06-2012, 01:17 PM
All my websites are down for more then a hour now...WiredTree will pay my advertising bills and my loses?
Posted by KMyers, 03-06-2012, 01:19 PM

Quote:

Originally Posted by hosting_talk

All my websites are down for more then a hour now...WiredTree will pay my advertising bills and my loses?

No, at most they will credit you for 5% of your monthly server bill for each 30 minutes of downtime. You cannot claim lost income
Posted by twhiting9275, 03-06-2012, 01:19 PM

Quote:

Originally Posted by davidpaj

I'm not knocking them down

That's ok, I was
You'd expect to get reasonable service when you pay $300+/month for a server, right? Apparently, not so much with these guys.

Quote:

Originally Posted by davidpaj

but I've wondered the same thing, why there pages load and ours don't. I thought we were all in the same datacenter.

In the same DC doesn't necessarily mean on the same network or routed the same way. It appears that the issue is with the hops right close to the DC, as the closer you get, the higher your ping tests are, according to hyperspin

Of course THEY'RE trying to spin this as "it's not everyone, just a few people"
Posted by rsferreira, 03-06-2012, 01:20 PM
We're facing problems here too.
Posted by davidpaj, 03-06-2012, 01:22 PM
My customers can handle there site being down, it's the email that's the problem.
Posted by Dannyarr, 03-06-2012, 01:22 PM
Every time WT goes down people say "it happens everywhere"... while that is certainly true it seems to happen significantly less elsewhere.

We moved our main servers away from WiredTree last year but kept 2 legacy servers there as we simply didn't have time to move them (and to date still don't). Since December 2010 we've had 7+ HOURS of downtime on each server.

Meanwhile in the same time period at Liquid Web (Storm) we've had ~45 minutes, at Linode ~10 minutes and at Hivelocity ~5 minutes (though we've only had servers there for the past 3 months).

Is the grass greener on the other side? Definitely.

This post is not meant to dis WiredTree, I'm simply stating my experience. The support we received there was always great but the downtimes are simply unacceptable.
Posted by PCplayground, 03-06-2012, 01:23 PM
How do they measure the time for their SLA? Looks like we are coming up on an hour and a half, 15%.
Posted by Kingfish85, 03-06-2012, 01:27 PM
I see I'm not the only one. I tried to call their support, but it just goes to a busy signal. I assume they're working on the problem. I can get a response from everything, no packet loss. Can't get to PP or WHM.
Posted by SimonChewbacca, 03-06-2012, 01:27 PM
I'm in the UK, been down for over an hour. Just got off the phone with a friend in Cookham (near Maidenhead) and they can't access the site. So I don't know how that link they posted on twitter is getting its data from.

This has happened a couple of times last months and now again!!

The service had to go down just as I was typing in a long article!

Wish I hadn't paid up for a year!!
Posted by samfing, 03-06-2012, 01:34 PM
My sites are down too. Grove loads without content and support page gives me 500 Internal server error eventually. I called Wiredtree phone number several times but always busy. I guess we just have to wait...
Posted by cher, 03-06-2012, 01:34 PM
My VPS isn't accessible to me in the US but I have had someone from the UK (Glasgow) contact me through my support app, who was browsing through my website just fine. So it isn't everyone who is affected.
Posted by diesel12, 03-06-2012, 01:37 PM
BTW, hyperspin and other uptime service monitors are very unreliable with this current issue. Site uptime and hyperspin both show wiredtree.com and our sites up, but we can't reach any of them ... .... so sometimes (for the specific type of issue that is occurring) http pinging is unreliable in determining whether a site is successfully being served ...
Posted by SimonChewbacca, 03-06-2012, 01:39 PM
It's strange I'm seeing google analytics (real-time beta) active users crawling up to 120 users then sharply dropping to 60 then to 4 users, it's been like this for the past 45 mins. Rising then falling.
Posted by wandering_burr, 03-06-2012, 01:40 PM
According to their twitter feed they are having trouble with an upstream provider. But they also wrote that they have 4 different backbone providers.

Can someone explain how they can be unreachable when a single upstream provider is down or misconfigured?
Posted by diesel12, 03-06-2012, 01:45 PM
I'm interested in the specifics of the issue as well. We've avoided cloud services for some time now believing we could achieve more reliability by having a dedicated, but that's seeming to be less true over time ...
Posted by PCplayground, 03-06-2012, 01:46 PM
New twitter posts from wiredtree:
The issue originally packet loss over Savvis. Once identified, we brought down the connection. That fixed the issue for many people.

Bringing the connection down, like we have many times in the past, seemed to have triggered a software bug on distribution switch #3

This bug/issue has caused issues on that distribution switch, which is causing packet loss for client servers behind it.

This is what we are working on resolving now.
Posted by Apocalypse, 03-06-2012, 01:46 PM
I'm having the same problems as everyone else on my VPS, i only use it as a mail/dns sever and I can still receive mail fine but i cannot send mail at all and im getting 40%+ packetloss from my server.

Overall I can't say i'm unhappy with them in general, been a client since 2010, support has always been fast but i hope they can work this issue promptly and get some sort of redundancy working so it doesn't happen next time.
Posted by samgreco, 03-06-2012, 01:47 PM
Funny, I just bought another VPS elsewhere to move from Wiredtree. It was supposed to happen today. But cannot start until we are sure they are up and solid. Well, as sure as anyone could be.

What's happened to WT? They used to be one of the go to providers. Top of the heap.
Posted by ABBB, 03-06-2012, 02:01 PM
We're down (again) as well, this is so frustrating!!
Posted by Yogesh Sarkar, 03-06-2012, 02:02 PM
Latest update from them:

Quote:

The issue originally packet loss over one of our backbone providers Savvis to some locations. Once identified, we brought down the connection. That fixed the issue for many people. Bringing the connection down, like we have many times in the past, seemed to have triggered a software bug on distribution switch #3. This bug/issue has caused issues on that distribution switch, which is causing packet loss for client servers behind it. This is what we are working on resolving now.

Posted by diesel12, 03-06-2012, 02:04 PM
The surest way to lose the goodwill we spend so much time building with our clients is to take their site and email down. It breaks my heart when this happens because my clients are fighting for their lives to stay afloat in a tough economy. They're running adwords, trying to hustle, trying to sell their asses off to make a good living and provide THEIR clients with the best service possible, just as we are. Then we take down their email, take down their site and leave them dead in the water. It causes them to lose credibility, hurts relationships with their customers and can even cause them to lose deals when prospects from their advertising campaigns can't pull up their site and those prospects go elsewhere ... This applies for us as well.

In 2012, there should be enough redundancy and foresight to prevent some of the outages we've seen in the past with WT, possibly including this one ... hard to tell without the facts. Our clients deserve better and I believe we do as well. "Things break and sh@t happens" are no longer acceptable excuses in 2012.

SLA can never bring back lost advertising revenue, lost goodwill and potential lost deals and sales that inevitably occur over the hours and hours of downtime we're experiencing with WT. This isn't the first, second, or even third or fourth time we've experience significant downtime with WT in the last few years, I just hate to see us part ways under circumstances like this, such a shame and a waste that was very likely preventable.
Posted by andreaf, 03-06-2012, 02:06 PM
I'm getting a little sick of it...
Posted by Serverji, 03-06-2012, 02:15 PM
They are getting worse day by day.
I am moving all my remaining servers to Servint.
Posted by jpeacock, 03-06-2012, 02:18 PM
Grass is always greener on the other side... but yeah, perhaps they could do a better job with communication
Posted by san-deep, 03-06-2012, 02:20 PM
My sites coming up now here.
Anyone else getting there sites back ?
Posted by Capricorn, 03-06-2012, 02:20 PM
I'm getting a little sick of this as well. My pingdom report for wiredtree shows 96 individual down times > 1 minute in the last year. 9 hours of downtime.

My other VPS measure downtime in minutes per year not hours. Like someone above said, yes it happens to everyone but really seems to happen to WT far too often.
Posted by zeiyaiter, 03-06-2012, 02:20 PM
OK Now!!
!
Posted by PCplayground, 03-06-2012, 02:21 PM
I'm up now as well, I just hope it stays that way.
Posted by njfail, 03-06-2012, 02:23 PM
My site is down as well.
Posted by huckyboy, 03-06-2012, 02:24 PM
seems to be resolved now from where i am now. (philippines)
Posted by Aorozco, 03-06-2012, 02:24 PM
Serverji, as an info, i recently migrate from servint TO wt, i have three servers with WT. I had more memory with servint (free) but very often problems with the mail.

My only option now is Knownhost; i have with the three, and if this happen in WT two more times in this year, i consolidate all between knownhost and WT
Posted by heartcore, 03-06-2012, 02:25 PM
From here in Washington State we're seeing https://grove.wiredtree.com/ but our dedicated server is still inaccessible.
Posted by njfail, 03-06-2012, 02:26 PM
So we should submit tickets to receive a 25% credit for 2:30 hrs of downtime?
Posted by UnderEstimated, 03-06-2012, 02:27 PM
THey said it is resolved but my sites are still down too.
Posted by heartcore, 03-06-2012, 02:29 PM
Our dedicated server is now accessible.
Posted by samfing, 03-06-2012, 02:35 PM
My sites (VPS) are up now.
Posted by andreaf, 03-06-2012, 02:37 PM
Yep, they're back.
Posted by SimonChewbacca, 03-06-2012, 02:38 PM
panda's gonna love my bounce rate.
Posted by VidiJoe, 03-06-2012, 02:40 PM

Quote:

Originally Posted by SimonChewbacca

panda's gonna love my bounce rate.

That is always my worry with server outages and issues
Posted by bpcbpc, 03-06-2012, 02:40 PM
Yes, works now.
Posted by heartcore, 03-06-2012, 02:52 PM
@UnderEstimated, you might want to login to Grove and make sure your current ISP-assigned IP Address isn't being blocked.
Posted by UnderEstimated, 03-06-2012, 02:53 PM

Quote:

Originally Posted by heartcore

@UnderEstimated, you might want to login to Grove and make sure your current ISP-assigned IP Address isn't being blocked.

I can access the server but not the websites. It just says looking up.
Posted by njfail, 03-06-2012, 03:11 PM
To those of you having problems with your dedicated servers being down still, wiredtree retweeted a solution:

A tip for the @wiredtree people that have their dedis down, restart apache & mysql, i had to do it due to users clogging.
Posted by UnderEstimated, 03-06-2012, 03:12 PM

Quote:

Originally Posted by njfail

wiredtree retweeted:

A tip for the @wiredtree people that have their dedis down, restart apache & mysql, i had to do it due to users clogging.

Did that too.
Posted by PCplayground, 03-06-2012, 04:18 PM
You should probably open a ticket then.
Posted by tianleng, 03-07-2012, 09:04 AM
My VPS down... again.
Two SLA claims (14 Feb -5hrs | 6 Mar -9hrs) still pending refunds.
Getting sick of WT.
Posted by tianleng, 03-14-2012, 02:17 PM
Anyone claimed SLA refund before ? Normally how long it takes to process ?
Posted by Khattak, 03-14-2012, 11:25 PM
they have refused to pay that. They are sucking big time.
Posted by p0go, 03-15-2012, 12:07 AM
I didn't notice any problems and still don't notice...

I hope this is all resolved for you, i didn't take the time to read every post of the thread besides the original opening of the thread and a few of the following comments and responses, but I believe there help desk would be able to provide you much better assistance then here at WHT, even if they do have REPs, the most they would be able to tell you in most cases is that if there is anything going on, and to submit a ticket or ask you for any open ticket numbers related to the questioned situation.
Posted by huckyboy, 03-15-2012, 02:48 AM
i doubt that they would refuse to pay. i just got mine credited to my account
Posted by tianleng, 03-16-2012, 08:46 AM
Wiredtree down again. All my sites down... or was it just my VPS only ?
Posted by Kingfish85, 03-16-2012, 09:06 AM

Quote:

Originally Posted by tianleng

Wiredtree down again. All my sites down... or was it just my VPS only ?

nothing is down for me..
Posted by bpcbpc, 03-16-2012, 12:46 PM

Quote:

Originally Posted by Khattak

they have refused to pay that. They are sucking big time.

Not true. I got a refund according to their policy.
Posted by PCplayground, 03-16-2012, 04:39 PM
I also received a partial refund today.
Posted by BloggerDude, 03-16-2012, 08:35 PM
hey is wiredtree down right now????
Posted by Kingfish85, 03-16-2012, 08:36 PM

Quote:

Originally Posted by BloggerDude

hey is wiredtree down right now????

Not down for me....
Posted by jackpx, 03-16-2012, 09:16 PM
online for me...
Posted by tianleng, 03-19-2012, 10:16 PM

Quote:

Originally Posted by njfail

So we should submit tickets to receive a 25% credit for 2:30 hrs of downtime?

Just to find out how much credit were you all given for the recent spikes of downtime ?
I opened two tickets, each downtime of >5hrs.
They combined both and credited me 25%.
Posted by Cape Dave, 03-19-2012, 11:02 PM
Seems to me this is a thread that Wired Tree would want to put to bed. Seeing Wired Tree is dead as a topic heading each time I login to WHT is not making me want to host with them
Posted by Kingfish85, 03-19-2012, 11:15 PM
http://i.imgur.com/HZfNW.gif
Posted by Cape Dave, 03-19-2012, 11:38 PM
Funniest thing I ever saw! Thank you!
Posted by tianleng, 03-20-2012, 01:40 AM
Actually I submitted 3 SLA claims.
One was from Feb which was "pending" till now with no recent update!
I am a small customer and has been happy with their support for ~2yrs, till recent spikes of downtimes and SLA claim issues.
Posted by Apocalypse, 03-23-2012, 06:07 PM
Is wiredtree down again for everyone else? i cant access my VPS or grove at the moment.

Edit: Grove seems to be up now.
Just got a very prompt reply from support may be a particular issue with my server.
Posted by WiredTree Zac, 03-23-2012, 06:12 PM
No, not down. We haven't been since the OP. open a ticket or call us

Mods: can this be locked? The initial issues are weeks old and there has been no reoccurrence.
Posted by cyberSAR, 03-23-2012, 06:50 PM
Well it's down for me. Grove is slow and not sure if my ticket went through. Called and they stated they have a network issue identified.
Posted by Kingfish85, 03-23-2012, 06:56 PM

Quote:

Originally Posted by WiredTree Zac

No, not down. We haven't been since the OP. open a ticket or call us

Mods: can this be locked? The initial issues are weeks old and there has been no reoccurrence.

No. All of my services are up. I wish WHT would delete this damn thread.
Posted by MattS, 03-23-2012, 07:05 PM
Down on my end. Gonna submit a ticket to see what's up. Grove itself is up at least.
Posted by twhiting9275, 03-23-2012, 07:08 PM

Quote:

Originally Posted by VopaHost

No. All of my services are up. I wish WHT would delete this damn thread.

Deleting it would kind of be bad
now, closing it, absolutely.
Edit:
Just checked, all up here
Posted by Kingfish85, 03-23-2012, 07:11 PM

Quote:

Originally Posted by MattS

Down on my end. Gonna submit a ticket to see what's up. Grove itself is up at least.

Hmm. Maybe I shot my mouth off too fast!

Quote:

Originally Posted by linux-tech

Deleting it would kind of be bad
now, closing it, absolutely.
Edit:
Just checked, all up here

Yea, all of my services are up as well.
Posted by san-deep, 03-23-2012, 10:37 PM
We are facing problem with wiredtree for past 4 hours.
Pages may load/may not load.. Unsure what the issue is.

Outages are being very common at there end now !!
Posted by anon-e-mouse, 03-23-2012, 10:47 PM

Quote:

Originally Posted by san-deep

We are facing problem with wiredtree for past 4 hours.

Feel free to open a new thread if the problems persist