Turnkeyinternet Down

Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > Turnkeyinternet Down

Posted by jj@24khost, 06-04-2012, 10:08 AM
At this time there services are unreachable
Posted by Kaiser Sose, 06-04-2012, 10:09 AM
Cant get them on the phone either...
Had a 100% uptime for me till now so hopefully its only minor.
Posted by jj@24khost, 06-04-2012, 10:11 AM
Probably a router issue.
Posted by KMyers, 06-04-2012, 10:13 AM

Quote:

Originally Posted by sosolabs

At this time there services are unreachable

Is it just their website or all customer infrastructure?
Posted by RC-Martin, 06-04-2012, 10:13 AM
Yes they are down.
Posted by jj@24khost, 06-04-2012, 10:15 AM
my vps is unavailable, which is my support and billing server.
Posted by KMyers, 06-04-2012, 10:16 AM

Quote:

Originally Posted by sosolabs

my vps is unavailable, which is my support and billing server.

Hopefully they fix it soon. I was with Turnkey for over a year and only recall one minor outage, it was short lived.

Edit : It appears this was short lived as well. Their site is now responsive. Can anyone confirm if their VPSs are also working?
Posted by FareDay, 06-04-2012, 10:32 AM
Seems to be online for me. Probably resolved the issue.
Posted by turnkeyinternet, 06-04-2012, 10:35 AM
Yes a carrier circuit flap, caused some dead routes briefly - most traffic re-routed right away and failed over to our backup juniper, some routes didn't properly fail over right away.

Everything was taken care of within about 5 to 10 minutes though - we are double checking while our meshed network for our juniper edge routers had large blocks of routes not properly routing out the carrier circuits (to circumvent the downed carrier line).
Posted by RC-Martin, 06-04-2012, 10:37 AM

Quote:

Originally Posted by turnkeyinternet

Yes a carrier circuit flap, caused some dead routes briefly - most traffic re-routed right away and failed over to our backup juniper, some routes didn't properly fail over right away.

Everything was taken care of within about 5 to 10 minutes though - we are double checking while our meshed network for our juniper edge routers had large blocks of routes not properly routing out the carrier circuits (to circumvent the downed carrier line).

Thanks for the update Everything works fine now.
Posted by numeraire, 06-04-2012, 05:38 PM
We saw downtime of almost 30 minutes from start to finish. And, it appears to be down again now! EDIT:.. and back up again... something weird going on with routing it appears.
Posted by turnkeyinternet, 06-04-2012, 07:01 PM

Quote:

Originally Posted by numeraire

We saw downtime of almost 30 minutes from start to finish. And, it appears to be down again now! EDIT:.. and back up again... something weird going on with routing it appears.

Hi Numeraire, by chance are you on a VPS service? I see a vps similar to your WHT username, as the hostname for the vps on a node (tk46)that had an experienced a DoS attack twice this afternoon (since rectified). If you have a support ticket in, shoot me the ticket number, and ill see if that is your vps or not. But there is no network issues or routing issues that would be impacting you. The VPS node did have significant packet loss while we cleaned out the issue from the vps node.
Posted by numeraire, 06-04-2012, 08:00 PM
Yes. That was me with a vps. Ticket MGJ-956-19212
Posted by cutabovehost, 06-04-2012, 08:01 PM

Quote:

Originally Posted by turnkeyinternet

Yes a carrier circuit flap, caused some dead routes briefly - most traffic re-routed right away and failed over to our backup juniper, some routes didn't properly fail over right away.

Everything was taken care of within about 5 to 10 minutes though - we are double checking while our meshed network for our juniper edge routers had large blocks of routes not properly routing out the carrier circuits (to circumvent the downed carrier line).

I was not able to get a call through to you and never saw anything about this posted on either your Facebook feed or your Twitter feed.
Posted by turnkeyinternet, 06-04-2012, 08:06 PM
Thank you for confirming with me Numeraire, your incident was resolved but revolved a VPS node with a DoS situation. Ticket should be responded to and updated as well.
Posted by cloudeh, 06-05-2012, 01:56 AM
There has been a broken shared host server for over 7 hours now at turnkey. Started off with SQL databases not being seen from within cpanel, "sql server is down" message. Now its gotten to where even static sites are no longer viewable via port 80. Even the standard "webserver##.turnkeywebspace.com"

My ticket is: #OUS-907-65903

Even for shared hosting, this amount of downtime seems rather excessive.
Posted by turnkeyinternet, 06-05-2012, 10:31 AM
Hello Cloudh

I know that webserver33 had an issue that our techs resolved by 2 AM PST (5 am EST) - which was causing mysql connections to be blocked for many users (there was basically an un-intentional user generated DoS event locally on the mysql). Our engineers got it resolved, but after extensive tracking to find the root cause and remove the issue.

If you still have an open issue, and are on web33, please be sure to either update your ticket or make sure one is open.

Web33 is not a server that has had previous issues, downtime, or otherwise complaints - this has been a solid box, but unfortunately in the world of shared/reseller there are very rare cases even where cloudlinux, and other other process accounting, monitoring and other custom items we have in place to prevent race conditions can still be over-abused to let 1 client (or a group of accounts, owned by a reseller) impact quality of service on others. Certainly not a common item for us, and our engineers are integrating some new logic into our custom code that helps avoid these situations to avoid a similar issue again in the future.

thank you!
Posted by darknessends, 06-05-2012, 10:48 AM
Hi Turnkey,

Have you not employed anything for DDOS prevention ??
What is your course of action if a DDOS act happens.
Posted by turnkeyinternet, 06-05-2012, 10:53 AM
Hello Darknessends - we do offer custom appliance driven DDoS filtered services, as a premium option. We also have our own network wide monitoring and security in place. The above mentions of a local user causing an issue (DoS) is not the same as a DDoS btw.

Depending on which product you are on and which options you want.