TailorMadeServices (TMS)

Portal Home > Knowledgebase > Articles Database > TailorMadeServices (TMS)

Posted by aingaran, 10-03-2003, 06:44 PM
Network appears to be down.
Posted by aingaran, 10-03-2003, 06:45 PM
Well, I know it's down... As my site is down too!
Posted by racksense, 10-03-2003, 07:03 PM
Just IM'ed Jose, he's already working on it.
Posted by aingaran, 10-03-2003, 07:13 PM
Do you know what the problem is?
Posted by racksense, 10-03-2003, 07:22 PM
He didn't say I think he was a bit busy I'm guessing a Cogent network problem by the looks of things.
Posted by mickmel, 10-03-2003, 08:21 PM
While I love their prices and performance, they are very bad about communicating what is going on during downtimes like these. There was a day similar to this a few months back (power issues), and they wouldn't really say what was going on. I'm losing $$ every minute that we're down, and it's driving me nuts to not know when it'll be back up!
Posted by aingaran, 10-03-2003, 08:46 PM
"...the network switch that we are currently on is down. They are currently upgrading some network equipment there and adjusting routing tables..."
Posted by Paula Ollie, 10-03-2003, 09:14 PM
Hello I have a Dual Xeon with them - since April 2003 - and I do not remember a single episode where we have experienced extended downtime. They always assisted me when I needed; I believe they do not talk much because they work too hard. As Jose wrote me earlier tonight, he cannot solve and explain the problem at once. So let him solve it first. It is a fact that the problems are solved and we have sometimes only a rough idea about what happened, after the event. I like to gather as much information as I can, about everything, so I really wish we could know more. But they'd been rock solid so far and problems if any were very rare. I trust them enough to cross fingers and go with them during this hard moment. Paula Ollie
Posted by aingaran, 10-03-2003, 09:58 PM
Well you maybe very understanding... But my clients aren't. It's been more than 4 hours.
Posted by mickmel, 10-03-2003, 11:26 PM
Anyone get any recent news from them? This downtime is rough on my nerves.
Posted by FactoryNet1, 10-03-2003, 11:43 PM
Servers down for 7 hours now... I heard from one of their support reps that Cogent cut their line and they had to get a backup line up?
Posted by WII-Aaron, 10-03-2003, 11:53 PM
Physically cut? or turned off? Aaron
Posted by FactoryNet1, 10-03-2003, 11:56 PM
No idea.. all the rep said was they got cut by Cogent and they are negotiating with another provider to get another line in.
Posted by WII-Aaron, 10-04-2003, 12:02 AM
Ouch. At 11pm on a Friday. That's not good.
Posted by mickmel, 10-04-2003, 12:07 AM
Agreed. This sucks BAD.
Posted by CLucich, 10-04-2003, 12:12 AM
Something is definitely wrong if Cogent cuts you off....
Posted by FactoryNet1, 10-04-2003, 12:15 AM
All of this has to happen on a Friday Night!
Posted by TMS - JoseQ, 10-04-2003, 12:16 AM
I'm sure you have all been awaiting for an update on the situation, as I haven't been able to update a lot of people on it via IM or e-mail. Unfortunately, we are going through a major crisis as Cogent has cut our connection without real warning. I've been on the phone non-stop all afternoon as you can imagine, thus why my Instant Messenger responses were few and far apart. As it stands, Cogent says their decision to cut us off is irreversible. I'm sure the first question will be "Why were you cut off?" so I'll try to explain. Cogent's official reason for taking us down was 'continuous AUP violations'. During the six months we've been in business we gathered 25 abuse tickets which were all inmediately addressed, in most cases resulting in server termination. Other cases include problems such as msblast, f.sobig, and other Linux worms/hacks which roam the net and took advantage of unpatched servers. However, patching servers, or terminating illicit users was not sufficient for Cogent, and they decided to terminate our connection at around 4:30pm EST. Their policy is that regardless of action, the fact that the complaints arrived, that's reason enough for termination. Having been good netizens and doing our part to keep our network clean we were totally shocked by this. I spent most of the afternoon trying to get Cogent to reconnect us to no avail. As a result, we were forced to get another provider on board, and will be getting a new connection installed. The new provider will be HE.NET. Unfortunately this is nothing that can be done easily on such short notice, so our network won't be back up until tomorrow. As a result, we will go through the painful process of re-assigning IPs. Please e-mail me at joseq@joseq.com your server 's root/Administrator password so that I can go in and re-assign the IP addresses tonight. That way the servers will be available as soon as our connectivity is re-established. We apologize for the inconvenience and are terribly sorry for making our customers go through this, but we weren't given any warning, or much of a choice. Our business will recover from this, and we will continue to take steps to improve our connectivity. I'm confident the service will be of a higher quality once the dust settles. I also appreciate all of your patience and understanding. I will be online all throughout the night and try to answer all my e-mail, IMs and posts here. JoseQ
Posted by eBoundary, 10-04-2003, 12:33 AM
Ouch, that sucks man. Sorry to hear it, If there is anything we can do to assist you just give me a yell.
Posted by inteltechs, 10-04-2003, 12:40 AM
that is really such a pain.
Posted by Paula Ollie, 10-04-2003, 12:40 AM
Dear Jose, I believe you, and accept your explanation. Most unfortunately such things happen to those who make a living out of the network. As mentioned by a fellow in a previous post, maybe my clients will not be so understanding as I am - for sure I am collecting a complaint-flood tonight, and this may grow worse tomorrow morning; yet I am still with you and am sure this nightmare will timely fade out. Good luck in the ride! Paula Ollie DNS-Secure.NET
Posted by Branzone, 10-04-2003, 01:08 AM
For what its worth I have been with TMS since February/March 2003. We have several dual xeons with TMS. This is the only problem that has occurred that has taken the servers completely down for more then an hour or two. There were two other events that were caused by power failure and a UPS. TMS moved to a new datacenter and power has not been an issue since. The cogent network which has a bad rep for not being stable on the east to west coasts.. Has been extremely stable. For it being 1 link to TMS and never going down.. I give them props for being so stable for so long. As TMS resolves these issues and persues HE.net bandwidth. I am with jose and juane. They are always around and give excellent support. Props to TMS for getting a quick replacement in such short notice. Lets hope for the best! kudos jose.
Posted by chrisbond, 10-04-2003, 03:20 AM
TMS have been great to us as a business there response times to support issues have been amazing. Hopefully, TMS will come out better when all the dust settles. Just hope my customers understand too!
Posted by RossH, 10-04-2003, 03:21 AM
And I thought my day off sucked, good luck Jose
Posted by qm8309, 10-04-2003, 03:23 AM
actually i see this as a great thing( sorry to those customers who are suffering from downtime). cogent is no match for he.net. if they can offer the same price after the switch (or slightly higher) i will be the first one to get a box there after they get reconnected.
Posted by neoshell, 10-04-2003, 03:36 AM
Cogent cant dig themselves a grave fast enough for my taste. Lets all hope whoever takes over Cogents Fiber someday will offer much better service.
Posted by FactoryNet1, 10-04-2003, 03:51 AM
I 2nd that
Posted by ENH Jonathan, 10-04-2003, 04:03 AM
TMS has always been a great provider and I do plan on sticking with them with the servers I have there. This...is just a bump in the road...and a ditch. But it can be worked past
Posted by threedee, 10-04-2003, 05:40 AM
They were good, and will be better after this ditch. Experience counts. <> Last edited by anon-e-mouse; 04-21-2006 at 09:54 PM.
Posted by Bahawolf, 10-04-2003, 05:53 AM
Would you reccomend them over, say RackShack or ServerMatrix?
Posted by chrisbond, 10-04-2003, 06:06 AM
Bahawolf - I would certainly - even know we've got downtime now. The funny thing is they where planning for the redundant line as it happened. One thing that i did like that most providers dont do is they will monitor 3 services (ping is automatic) - I choose ssh and http. If the service is down they are paged no matter what time of the day it is and without 10 minutes they see what the problem is and correct it (reboot, etc). From personal expereance i would say you are not going to get this level of service with rackshack or servermatrix (i've never dealt with servermatrix only what ive read on the forums though).
Posted by Bahawolf, 10-04-2003, 06:20 AM
That can be true.. I believe there is an "ultimate" host for everyone. Everyone does have their own needs/wants and the hope of fulfilling them. I was appealed with TMS when I first saw them.. So, I might choose to go with them.
Posted by Bendy, 10-04-2003, 07:30 AM
I believe JoseQ , and accept JoseQ 's explanation!
Posted by aingaran, 10-04-2003, 09:29 AM
Is there an ETA?
Posted by aingaran, 10-04-2003, 09:31 AM
How would you address your clients about this issue? Just curious, if anyone has a canned email for that?
Posted by Joshua, 10-04-2003, 09:47 AM
Reminds me of the situation when Cogent terminated FDC's line for continuous AUP violations... I think that Cogent needs to understand how hard it is to run a dedicated server or colo business and not run into any abuse... -Josh
Posted by aingaran, 10-04-2003, 09:50 AM
I guess the good thing about this, is that if the customers don't have a backup of their files, they can't switch to another company. They're stuck! This blows!
Posted by tandem, 10-04-2003, 09:56 AM
Sorry to hear it. Does Cogent cut off the lines just like that, without giving at least a 24 or 48 hour prior notice?
Posted by Mango, 10-04-2003, 09:59 AM
They do. I spoke with one of their abuse reps a moment ago and they basically send a mail saying "OK, you will be disconnected in 30 minutes. No discussion possible". Sad, sad business. I've lost all my faith in Cogent, even though I was a big supporter in the past. And the sad thing is that it can happen to anyone, anytime, without a warning. And then you're on your own. Being a large TMS customer, I'm personally losing hundreds of dollars an hour - which honestly is not exaggerated. It wouldn't all have been net profit of course, but now it's just a big loss. Though I'm not a direct customer of Cogent, I'm considering legal actions against them. I was talking with Jose throughout the evening and the way they treated him was SAD. fingers pointing to each others without anyone offering some decent communication. I've been on the phone with Cogent too during that timeframe, and can confirm all that. I even got some help from another well-known, large Cogent customer but they were treated exactly the same way. If you have a Cogent circuit, think twice. It could mean the end of your business any minute. Carl
Posted by racksense, 10-04-2003, 10:24 AM
Somewhat glad I didn't choose to host the core of my business on el cheapo dedicated servers in the US. For anyone who doesn't have diverse DNS and does everything on a single box/subnet they will have to get their new IPs, and then it will be +48hrs after that to get their sites/mail back up after changing DNS server IPs. Of course, you don't need diverse DNS, "it's just not required", so many people say. This is what happens when the hosting industry is dragged down to stupid prices, no-one can be bothered/afford to invest in the proper infrastructure, and then customers will whinge why their sites were down for 3 days and there was no backup. I'm afraid if people want to pay 20 quid a year for 5 gigabytes of bandwidth and a bazillion features then that's what they'll have to put up with.
Posted by aingaran, 10-04-2003, 10:31 AM
So it's another 48 hours?
Posted by racksense, 10-04-2003, 10:35 AM
That was a statement wrt DNS, not a statement on TMS ETA. Changing DNS server IPs, once you have the new ones, will take 24 to 48hrs, that's the propagation delay for changing name servers. If you have name servers outside of TMS then it'll be quicker, because your backup NS will respond once you've reconfigured them to secondary from the new IPs. Oh, and you'll have to update all your DNS zones as well.
Posted by FactoryNet1, 10-04-2003, 10:39 AM
woh.... my clients are going to hate this..
Posted by Mango, 10-04-2003, 10:41 AM
As it currently seems, it would be online gain within the next few hours. Carl
Posted by FactoryNet1, 10-04-2003, 10:45 AM
yup, eta is 6 hrs. but we're going to have to wait for our nameservers to propagate until our sites are up.
Posted by Mango, 10-04-2003, 10:47 AM
You can still set the TTL for the records to a low number (200 or so), which will save you a few hours. Carl
Posted by Mango, 10-04-2003, 10:55 AM
Just an update : all seems to go according to the schedule, and the new circuit should be online in a few hours. These are the new subnets from he.net; you may need to adjust your DNS ASAP to save time : 38.114.3.* -> 216.66.18.* 38.114.11.* -> 216.66.19.* 66.28.225.* -> 216.66.20.* 66.28.81.* -> 216.66.21.* so you preserve the last octet. Example : 38.114.3.200 would become 216.66.18.200 JoseQ and his people are extremely busy at the moment so please only contact them if you have no other options. You can as well post general questions here; I'm trying to follow up as closely as possible and will try to tell you what I know. I can only say that you're in good hands; these people are doing all they can to get your service restored. Sidenote : I'm not a TMS representative, but we thought that things might go smoother if we spread the workload. I'm just a customer like anyone else, but feel free to reply with any questions. Carl
Posted by Kattilyn, 10-04-2003, 10:58 AM
That after reading through all this I find myself contemplating a server or two at TMS at some point after their network is up is kind of amazing. They must be doing something right to have customers praising them and sticking with them during such a long downtime (even when it isn't their fault).
Posted by Mango, 10-04-2003, 11:02 AM
Exactly, Kattilyn. I honestly am just a normal customer and the downtime is hurting me. But the support I receive from these guys is fantastic; they are the victims just like we all are. Jose's become a friend of mine, because I appreciate the way he runs his business and his personality. I could have signed up for cheaper solutions months ago, but I stick to them because of their personal approach and more. I have no interest in posting this here (apart from a thank you from Jose, which is not even necessary) but I could only advise you to sign up with them after this storm... they're fantastic (and I've walked a long, long road with many experiences with lots of datacenters...) Yours, Carl
Posted by Paula Ollie, 10-04-2003, 11:08 AM
Hello Carl, Your comments are lucid and your help highly valuable. May I take this rule-of-the thumb for sure and start configuring my DNS and my resellers DNS over 38.114.11.* -> 216.66.19.* ? If so, we are at least half-a-way done. Thank you a lot, Paula ============= Paula Ollie Dns-Secure.NET ICQ 9079785
Posted by Mango, 10-04-2003, 11:11 AM
Sure, Paula, these are the official changes; I also used them to update my DNS. Jose reviewed my post for errors, so it's all clear. In your case, something like 38.114.11.50 would become 216.66.19.50. So go ahead and make the changes; also set the TTL as low as possible if you're editing anyway; can be useful in future. Jose told me that he's off to the datacenter now, working on the servers with his team (IP's need to be changed). If you have any questions, post them here. I can call Jose if necessary. The current ETA is around 5 hours from the moment of writing. Yours, Carl
Posted by Paula Ollie, 10-04-2003, 11:17 AM
Hello Carl, Thank you very much. We are seeing here an admirable example about how decent, humbler persons fix up a mess made by more powerful cold-blooded guys. Someone said that Internet grew so fastly because it is not about machines, but about people. This thread in a sense is a living example of the truth lying in this saying. Truly, Paula
Posted by Mango, 10-04-2003, 11:27 AM
Exactly, Paula. TMS is Jose's (and Juane's) dream into which they invested so much time and energy. And what's more, they gave friendship in return for their money. Now, this giant company called Cogent decided to ruin their dream in 30 minutes, without giving them the possibility to defend themselves. As said before, I spoke with many of their reps; the ones at the lowest level were humans, but the ones higher up were robots, not realising that they would keep many people up last night and ruin great things. I also have serious doubts when I think of the way they disconnected this circuit (their reasons, time of the week), and strongly believe that there might be a deeper reason. Which is exactly why I'm considering legal actions against them, and I'm convinced that Jose will consider the same. It's against all business principles... Let me quote the words of the CEO of one of the largest dedicated providers around the web (yesterday) : Cogent is a blackhole when dealing with them. He's so right... Yours, Carl
Posted by Paula Ollie, 10-04-2003, 11:54 AM
Carl, I had already decided to stick with TMS, as my previous postings will show. But now I have stronger reasons. We know the real temper of people in the bad moments. The difference between the loser and the winner is that the loser always knows what he/she WOULD do if he/she was winning. As to the winner, he/she may even be uncertain about what is to be done when winning, but for sure he/she always knows what must be done when he/she is losing. Of course we all will experience losses, most unfortunately we will, because such events are ever unkind. But I wish the best to TMS and I see that many clients are publicly supporting them, and some clients manage even to give support to other clients. This is the winners' strategy. All the best, Paula
Posted by salim, 10-04-2003, 12:55 PM
Thats a lot of abuses, I'm sorry about whats happened (particularly since we have a server with them) but maybe they need to be a bit more careful about who they take on or at least try to catch the abusers before Cogent becomes aware of them.
Posted by Mango, 10-04-2003, 01:03 PM
the problem is that most do an IP lookup and mail that abuse address, which is abuse@cogetco.com, instead of contacting TMS first... So they add a violation to the list before TMS is even aware of it... but as soon as they are reported, TMS deals with them. I can assure you that every host with that number of servers have as many or much more complaints in such a timeframe. Carl
Posted by Faggle, 10-04-2003, 01:56 PM
Any updates yet?
Posted by Mango, 10-04-2003, 01:57 PM
ETA is around 2 hours if everything keeps going as scheduled. Carl
Posted by Paula Ollie, 10-04-2003, 01:58 PM
Anyway, I believe that we have at least 7,000 years of history to teach us the civilized attitude of granting the right of defense and de benefit of doubt to those who are to be prosecuted before condemning. What has particularly shocked me on that episode was the reported one-step measure of the kind "you are disconnected", where a stepwise attitude should in my opinion be taken instead. A widely received principle in Law and Politics is blissfully ignored in business! Because my clients and I never performed a single abusive act and I believe that most of TMS clients are completely innocent -- but the massive, sudden disconnection brought a shadow over all of us. I have heard many times that it is better to take the risk of letting a guilty unpunished than to take the risk of arresting an innocent. Regards, Paula
Posted by coight, 10-04-2003, 02:03 PM
Sorry to hear about your misfortune, especially with no warning of termination. Good luck to you guys and to their clients this is the time you need to stick by them they will need you more then ever during this period.
Posted by ho247, 10-04-2003, 02:35 PM
Just wondering, but I see a lot of people using WHT to chat about their downtime. Did they send out a notice to all of their clients with servers there? We have one backup server there and we've not received anything from them.
Posted by mickmel, 10-04-2003, 02:41 PM
I don't think so. I know they haven't sent me anything, because my primary e-mail account is on my server with them, which is obviously inaccessible...
Posted by rusko, 10-04-2003, 02:44 PM
i would like to hear cogent's side of the story. a cashflow negative carrier that most dont want to touch terminated a large client for no reason and without notice. in other news, i am the pope. paul
Posted by Bahawolf, 10-04-2003, 02:47 PM
We shouldn't hold this against TMS or Cognent until both sides lay their storys down.
Posted by Mango, 10-04-2003, 02:54 PM
Take it or leave it, but I've spoken with Cogent and it's definitely not TMS' fault... it's Cogent's "blackhole" causing this. And I predict that you'll see more of these issues in the near future... Carl
Posted by Bahawolf, 10-04-2003, 03:06 PM
I don't think anyone here will have a problem with TMS.. From what I hear, this is the only "problem" and they didn't even cause it. So, I still plan on doing possible buisness with them.
Posted by Mango, 10-04-2003, 03:44 PM
Things are coming closer to an end now. Per Jose : +/- 60 minutes from now on. Carl
Posted by mickmel, 10-04-2003, 03:49 PM
Cool. However, what exactly is "to an end" mean in this case? My server needs it's IPs updated, and I use TMS's DNS server, so that needs to be updated as well. Is the 60 minutes just for the main install (leaving the little stuff), or does that cover everything but the DNS propogation?
Posted by Mango, 10-04-2003, 03:52 PM
AFAIK, that's the time by which the connectivity would be restored and the IP address on your server changed if TMS has got your root password. As for the DNS on TMS' servers, I'm sorry, I can't answer... Carl
Posted by Branzone, 10-04-2003, 03:54 PM
This seems to be my case as well. Yes I may rely on the 200 customers I have on 8 box's that are offline right now.. But in a situation as such, just stick it out tell your clients that your recrimping all of your RJ-45 connectors on each cable and they will be on a better line by this evening. Well depending if its webhosting then whenever the DNS resolves.
Posted by TMS - JoseQ, 10-04-2003, 04:05 PM
All records on our DNS servers have been updated with the new IPs so as soon as our server is back up, that's what it will be answering as. Propagation should be quick, as many DNS servers will have already flushed old entries. By the time we get back they will query and get the new IPs. I've gone through most of the servers for which I was sent a password and updated IPs in the configuration, DNS (where applicable) and Apache configuration file. So thinks may work right 'out-of-the-box' as soon as we're back in for many. I'm keeping one eye on this thread, and continuing to work to have everything back up in the next hour. JoseQ
Posted by s.h.a.zz.y, 10-04-2003, 04:13 PM
Could not of said it better myself. Good luck with getting things stable again.
Posted by Bahawolf, 10-04-2003, 04:15 PM
I will look into buying a dedicated server from you guys within a month...
Posted by Mango, 10-04-2003, 04:17 PM
Indeed. Both yours and the quoted words come from wise people. Jose and his folks have gone through a rough time, completely unexpected. Imagine that this would happen to you The best thing we can do is to wait for our servers to come back online and to give Jose some time for a good rest. I'm not sure if he even saw his family this weekend Carl
Posted by Bahawolf, 10-04-2003, 04:20 PM
Well, we certainly can not say that their host is not good... Since the actual server "crash"... Jose has been working. Not only has he been working, but hes keeping us updated. In conclusion.. this may have turned some people away.. But, for me, it showed me that TMS is a real host, with hard working citizens. I for one, not even a customer yet, will say Thank you.
Posted by Mango, 10-04-2003, 04:47 PM
Slight delay because of some complications; ETA is 30-45 minutes at this stage. Carl
Posted by Branzone, 10-04-2003, 05:09 PM
Thanks for updating. All 200 of us dont need to keep calling or messaging jose
Posted by Mango, 10-04-2003, 05:15 PM
Exactly what I'm trying to accomplish The less time we use, the faster this will be resolved Carl
Posted by Bahawolf, 10-04-2003, 05:36 PM
Expect my buisness within a week or two.. I got my new job.
Posted by Faggle, 10-04-2003, 06:11 PM
la la la la la la la................. lets go!
Posted by Mango, 10-04-2003, 06:13 PM
Spoke with Jose; it's almost ready to go alive; something like 20 minutes or so. Carl
Posted by Faggle, 10-04-2003, 06:17 PM
Yeah well... you keep saying that every 20 minutes... None of those new ips even leave new york.. you'd think they would at least be routed up to the DC by now.
Posted by Paula Ollie, 10-04-2003, 06:18 PM
*crossing fingers* ***chilly on my back**** Tks Carl
Posted by Mango, 10-04-2003, 06:21 PM
I'm only telling you what I hear. Unfortunately, in the telco world, it's hard to work with timeframes. The routing over NYC appears to be caused by the fact that TMS is the first HE.net customer in TX. Carl
Posted by Branzone, 10-04-2003, 06:37 PM
We're talking about computers and the internet here. You cant put a timestamp on anything. In times like these you have to be patient, relax I dont think jose is going to 'stop working on it' to come tell us that it will be any minute now. When its up.. Its up. And keep in mind that the router HE.net has in Dallas. Is not known to the internet. It has never been used, pinged or routed through before. So it may take some time for the interweb to recognize the router as traffic starts flowing. Again, just be patient it will be up as soon as it can be.
Posted by Mango, 10-04-2003, 06:42 PM
Right on, BrandonM, I'm talking with Jose as we speak and he's doing all he can to get things online again. There were some issues with a network engineer not getting access to the building but they are making some progress now. Carl
Posted by AKavanaugh, 10-04-2003, 06:42 PM
Personally, I'm amazed at both TMS & HE.Net - TMS for dealing with the outage in such an outstanding manor, but also HE.Net for pushing out a circuit in such a small timeframe.
Posted by Paula Ollie, 10-04-2003, 06:45 PM
Allrigth! So far I see things going very well, if we consider the starting point we were yesterday night. I am confident that Jose & staff will get us back up soon. Paula
Posted by Bahawolf, 10-04-2003, 06:46 PM
Will ordering of servers be held back because of this to?
Posted by v3mediaworks, 10-04-2003, 06:47 PM
Knowing Jose, probably only for today (and tomorrow because he'll undoubtedly be sleeping all day)
Posted by Bahawolf, 10-04-2003, 06:48 PM
He definitly deserves that.
Posted by Mango, 10-04-2003, 07:00 PM
He deserves to sleep a week... he told me that he had scheduled some things with his family (who took the plane to see him), but so far for those plans... it's sad for such a good person Carl
Posted by v3mediaworks, 10-04-2003, 07:04 PM
hey hey!! one more hop is appearing on the traceroute now!! the wagon train is coming in...
Posted by Bahawolf, 10-04-2003, 07:06 PM
Party at my house!! lol
Posted by Sasuke, 10-04-2003, 07:08 PM
I'll bring the beer.
Posted by Paula Ollie, 10-04-2003, 07:10 PM
This is beautiful. Firstly we retracted back to Washington, then we jumped to the end of the traceroute for the first time. Nicely done. ;-) We're coming back up, folks! Paula
Posted by Branzone, 10-04-2003, 07:10 PM
I CAN PING THE ROUTER!!@#!@ HF!!
Posted by Bahawolf, 10-04-2003, 07:12 PM
Has this influenced anyone else, other than me, that TMS Host does not give up until the job is done? I know many hosts would go MAYBE for 2 hours, and leave it for the morning. But, TMS has been working for 24 Hours straight.. Now, thats a real host.
Posted by Branzone, 10-04-2003, 07:13 PM
well ill be back to visit the board gotta go fix up some IP's
Posted by Potsie, 10-04-2003, 07:19 PM
Darn... there goes our little secret about TMS. Now everyone will want to host with them. I hope they're ready
Posted by FactoryNet1, 10-04-2003, 07:19 PM
Server back up folks!! Just have to wait until dns propagates.
Posted by Branzone, 10-04-2003, 07:21 PM

Posted by akuo, 10-04-2003, 08:01 PM
I don't mean to spoil your party here, but to those who are thinking of jumping onto this re-floated ship, have you considered you'll be in the same situation as those before the sinking? i.e. Relying solely on a single connection (HE.net)? What happens if *they* cut off TMS? Does TMS have new plans for a second line, or are they once again putting all their eggs in one basket? The thing about this industry is that sure, you can be screwed over by those above you, but ultimately you have to take responsibility for things yourself. TMS admitted that "for one reason or another" their second line was delayed. Interesting how quickly they got it up when they needed to. If only this had been done long ago. Isn't hindsight great Anyway, just some food for thought. I must say they do seem committed to customer service and that's always great to see. Sometimes it can mean more than uptime alone BTW, somebody mentioned in a comparison to RS and ServerMatrix that TMS monitor up to three services. Thought I should point out that ServerMatrix do this freely also, as well as 3 system parameters and 3 processes. Also, ServerMatrix is connected to 6 Tier One backbone providers. I can't comment about their customer service though, as I haven't personally used them.
Posted by Daver, 10-04-2003, 08:06 PM
Unfortunately it would appear that you do not have a recourse against Cogent. Cogent had no obligation to you if you where a customer of TMS. TMS had a contract with Cogent, it appears that Cogent said that contract was broken (AUP/TOS) and decided to sever the relationship.
Posted by Paula Ollie, 10-04-2003, 08:07 PM
Not only TMS bring us back but also truly *tailored* the entire IP shift inside the dns tables onto my server. This is an industry made by hand by people extremely concerned with a moral commitment towards their clients. This is a hand-made job that I believe we would very unlikely get from the "Big Ones". When I access my server to fix up the last things, I gladly discovered that there is almost nothing if anything left to be fixed! This should be publicly acknowledged. Thank you Jose and Juan; thank you Carl for your support online and thank you for all the others who have been working silently and very hard. Paula
Posted by racksense, 10-04-2003, 08:07 PM
They said 2 or 3 weeks ago they were investigating bringing in additional transit soon. Just one of those sods law bad timing things.
Posted by Daver, 10-04-2003, 08:13 PM
Cogents "Blackhole"? The reasons I see them on Blackhole lists is due to customers on their network not policiing their networks. Also I find it hard to believe that a carrier would disco a customer without due process of their AUP policy. I think you are hearing one side of the story, I also doubt that TMS would come onto a board of customers and potential customers and say "We messed big this time". Not saying they have but keep a open mind, unless you feel the need to believe 1 side of the story..
Posted by FactoryNet1, 10-04-2003, 08:13 PM
I was very surprised that my dns configurations were all changed. I also thank Jose and Juan for the hard work of getting the servers back up. I highly recommend them to anyone that is looking for a company which provides great customer support.
Posted by racksense, 10-04-2003, 08:18 PM
'ish.. I wouldn't call posts on WHT a good customer communication mechanism. Not all their customers will be reading here, they need some form of proper status page.
Posted by Paula Ollie, 10-04-2003, 08:24 PM
I believe that purely legal aspects will not exaust the question here. It is necessary while discussing it, to keep an eye at the concept of moral adequacy. That company may be in their right of cutting TMS line. But is it [morally] right to turn TMS down without a previous warn and without granting TMS a minimum time to arrange their clients' move? Is it [morally] right to take a sudden measure, that could be so nicely postponed by no longer than a couple of days (because TMS has shown us that they could arrange alternatives within 24 hours), and as so hardly enforcing the terms of a contract, bringing such a grief to so many small business owners, who feed their families with their daily sweat? This is something that a law-centered concern, if excluding other aspects, will not be rich enough to address. The moral side of the question should be added to achieve clarity of vision. Paula Last edited by Paula Ollie; 10-04-2003 at 08:34 PM.
Posted by Daver, 10-04-2003, 09:45 PM
it seems odd to me that Cogent would turn off someone with no warnings. I was just saying that if both sides where fully known, which will likely never happen, we are all merely guessing..
Posted by rusko, 10-04-2003, 10:02 PM
erm, read up on when cogent pulled the plug on fdc. fdc claimed they had no prior warning, which was of course bullcrap. everyone and their grandma knew it. paul
Posted by M_K, 10-04-2003, 11:59 PM
My server is still down @ TMS ! I dont see any new posts here. So, I take it as averything is OK with your servers? Or is everybody still waiting in silence when the line will be up?
Posted by Branzone, 10-05-2003, 12:28 AM
All 8 of my servers are up. I believe Jose is still binding IP's etc. Also if you didnt send him your IP /Password then he might not have done it yet. Send email to joseq@joseq.com .
Posted by ecal, 10-05-2003, 02:30 AM
My server is back online and was doing some speed tests... Upload is about ~1M/s while download is around ~840K/s Anybody else getting this on their TMS server?
Posted by Bendy, 10-05-2003, 02:59 AM
my server is still offline!!and i had send the email to joseq@joseq.com.
Posted by TMS - JoseQ, 10-05-2003, 03:03 AM
Apologies Bendy, your server is online now.
Posted by peersignal, 10-05-2003, 03:10 AM
I can't get www.tailoredservers.com to come up
Posted by Branzone, 10-05-2003, 03:34 AM
I have the same problem. Thats your ISP not refreshing often enough. Some dont refresh for a good 12-24hrs.
Posted by Bendy, 10-05-2003, 03:59 AM
MY SERVER IS BACK UP NOW!!!NICE! ALL CHANGE IS OK!
Posted by Mfjp, 10-05-2003, 06:19 AM
Agreed. Carrier will always give warning way before they pull the plug.
Posted by ozzie123, 10-05-2003, 07:33 AM
Hm... cannot connect to http://www.tailoredservers.com/ either... What's wrong with them??
Posted by rusko, 10-05-2003, 07:38 AM
the dns changes have not yet taken full effect. remember, they had to renumber. this whole situation is rather fishy though. good luck to all that have decided to stay put. paul
Posted by Paula Ollie, 10-05-2003, 08:01 AM
mfjp said: If that was the case, I am duely apologising as publicly as I complained about the declared sudden disconnection. If that was not the case, then my complaint holds. Those who read my posts please kindly pick up my attitude that best fits their respective realities. Because due to the nature of evidence when it flows from personal testimonies, I'm afraid I will never really know what happened, because I did not have myself the live interaction that TMS staff had with Cogent and Carl had both with Cogent and TMS staff. rusk said: But I still have to decide how to tune in my trust. And I decided to trust TMS because they behaved responsively after the crisis was settled (perhaps after a great personal cost), they brought my server back completely reconfigured as to IP switches (no further work was left to my doing), they restored an entire network in a pace that could be commited to a Book of Records and they behave with extreme dignity since I firstly met them. I think I have no further comments about the disconnection issue. Paula
Posted by Mango, 10-05-2003, 08:09 AM
Daver; You fon't seem to have read my posts closely enough. During the last 36 hours, I've been speaking with a LOT of people inside the Cogent structure. I know the real story (which is the one you read here on this board), and I reserve the right to believe that something's smelling big time here - someone's hands at Cogent are quite dirty, I believe. Carl EDIT : some people don't seem to get it. More than one person from Cogent ADMITTED that they just sent TMS a mail saying that they would be cut off 'immediately', which is like 30 minutes later. I spoke with them, so I do know both sides of the story... Last edited by Mango; 10-05-2003 at 08:14 AM.
Posted by ozzie123, 10-05-2003, 08:17 AM
Ok... which should I choose.... Servermatrix -- their free setup fees and affordable server EV1 -- Their low priced abundant bandwith TMS -- Their good services Which one??
Posted by akuo, 10-05-2003, 08:29 AM
So you're saying that Cogent employees admitted to cutting off a client with 30 minutes notice AND doing so without good reason? And exactly how many warnings had they given prior to the final termination? And exactly what had been done to correct the situation by TMS? I have no axe to grind anywhere here, but like many others I really don't think Cogent are in the business of throwing away customers and pissing people off. Sure they may not be the best in the world, but I'd suggest they have a few more smarts than that.
Posted by ozzie123, 10-05-2003, 08:37 AM
Hm... TMS really need to have more than 1 backbone here...
Posted by aingaran, 10-05-2003, 09:25 AM
216.66.18.91 Can someone tell me if this is up? It was up for a few minutes last night, then it went down again.
Posted by aingaran, 10-05-2003, 09:52 AM
Please? Anyone?
Posted by Gernot, 10-05-2003, 09:52 AM
Doesn't seem so: traceroute to 216.66.18.91 (216.66.18.91), 30 hops max, 38 byte packets 1 gate-209-237-241-1 (209.237.241.1) 0.589 ms 0.437 ms 0.392 ms 2 GE9-0-0-br01-200p-sfo.***********.com (209.237.224.133) 0.394 ms 0.469 ms 0.292 ms 3 GE03-br02-200p-sfo.***********.com (209.237.224.26) 0.258 ms 0.249 ms 0.226 ms 4 ge-3-2.a01.snfcca05.us.ra.verio.net (140.174.21.213) 0.416 ms 0.380 ms 0.595 ms 5 ge-6-1.a04.plalca01.us.ra.verio.net (129.250.122.64) 1.785 ms 1.758 ms 2.058 ms 6 xe-1-2-0-4.r20.plalca01.us.bb.verio.net (129.250.28.94) 2.004 ms 1.961 ms 1.751 ms 7 p16-0-0-0.r00.plalca01.us.bb.verio.net (129.250.3.79) 1.844 ms 1.895 ms 1.803 ms 8 paix.he.net (198.32.176.20) 1.944 ms 1.832 ms 1.852 ms 9 gige-g1-0.gsr12012.pao.he.net (216.218.254.34) 1.804 ms 1.800 ms 1.907 ms 10 64.62.227.50 (64.62.227.50) 10.641 ms 10.637 ms 10.449 ms 11 64.71.157.49 (64.71.157.49) 41.593 ms 41.632 ms 41.674 ms 12 216.66.24.154 (216.66.24.154) 43.841 ms 42.802 ms * 13 * * * 14 * * HTTP's not working on that IP either (in case they've blocked ICMP). Maybe they're still working on some network issues... Such a circuit is usually not intented to be put live in a couple of hours so problems may and most likely do arise.
Posted by racksense, 10-05-2003, 10:05 AM
TMS will be in a much better position once they are multi-homed.
Posted by Faggle, 10-05-2003, 10:56 AM
Hopefully it wont take to long to get stable again. 711 packets transmitted, 566 packets received, 20% packet loss
Posted by MaFunk, 10-05-2003, 11:28 AM
My host is en-host.com they are part of this whole thing with the hosting being cut-off and everyone's site going down. The guy at en-host tells me to go to my registrar and point my dns to 2#6.##.1#.1#1 and 2#6.##.1#.1#2 (of course the number signs are acutally numbers). So I did and I keep getting "invalid domain name registrar". And he WILL NOT answer my emails to tell me where to point my servers. At this point I'm totally upset, as I think that he should at least take the time to let me know where to point my dns. So, I just want to how to get a hold of my back-up files or where to point my dns. Can anyone help?
Posted by MaFunk, 10-05-2003, 11:29 AM
sorry 'bout that - mean "invalid domain name extension"
Posted by aingaran, 10-05-2003, 11:37 AM
mah funk. Change it go ns1.en-host.com - 216.66.18.101 ns2.en-host.com - 216.66.18.102
Posted by hideal, 10-05-2003, 11:40 AM
Really a black weekend!
Posted by racksense, 10-05-2003, 11:43 AM
Hey, it's an improvement over 100% loss. I've pinpointed where the loss is happening, I've just sent Jose some traceroute/ping debugging.
Posted by MaFunk, 10-05-2003, 11:49 AM
Thanks for the tip aingaran, but I"m still getting "invalid domain name extension." This is what I get: The name server is not valid: NS1.EN-HOST.COM - 216.66.18.101 The name server is not valid: NS1.EN-HOST.COM - 216.66.18.102 or this The name server is not valid: 216.66.18.101 The name server is not valid: 216.66.18.102
Posted by MaFunk, 10-05-2003, 12:04 PM
Oops again - I mean I get this The name server is not valid: NS1.EN-HOST.COM - 216.66.18.101 The name server is not valid: NS2.EN-HOST.COM - 216.66.18.102
Posted by Mike in FL, 10-05-2003, 12:06 PM
Maybe your registrar just wants the domain names, like this: NS1.EN-HOST.COM NS2.EN-HOST.COM
Posted by racksense, 10-05-2003, 12:07 PM
A domain name server has to be a name, not an IP address. Are you using your own name servers, eg. NS1.YOURDOMAIN.COM that match the name of your domain? If your nameservers are named under your own domain name then you will need to get your registrar to do a change of name server IP to the new IP. Otherwise whoever provides the DNS/registrar for your name servers will have to change them.
Posted by aingaran, 10-05-2003, 12:12 PM
You know what?! The server itself is down. So, it doesn't recognize the ip or nameserver. So, there's no point in tryiing change the ns info,as it won't be recognized. The freaking server is down. TMS's main site is down too...So, I don't know what to do..
Posted by MaFunk, 10-05-2003, 12:19 PM
Paul, This is Exactly what my host told me to do: so I tried that but it says invalid domain name extesion. Curretnly the dns are pointed to . My registrar is go-daddy.com. My sites are all still down. So, sorry to be dense, but I'm not sure what you're telling me to do. Do you mean that I need to call godaddy.com and have them change the ip address for the en-host.com dns???
Posted by mickmel, 10-05-2003, 12:19 PM
Well, my sites seem to be on their way. I can only access them via the new IPs, but some users are reporting that they can get to the site using the URL (which apparently is starting to resolve correctly to the new IP). I'm hoping I'll be able to access the sites via their URLs before much longer. We'll see...
Posted by TMS Juane, 10-05-2003, 12:22 PM
We see your server up. Please send me an email to juane@rootn.com or jose at joseq@joseq.com to discuss this further. Juane
Posted by MaFunk, 10-05-2003, 12:23 PM
This is what the godaddy domain details page says
Posted by racksense, 10-05-2003, 12:24 PM
Their site works, albeit slowly (because of the packet loss), probably your local DNS server hasn't expired the old DNS records yet. (Try Jose on his personal mail, see his previous post, if you can't get through). Are you sure your registrar won't recognise the NS details you give? Should be okay regardless of whether the server is up.
Posted by Mike in FL, 10-05-2003, 12:40 PM
I use GoDaddy, too -- all you have to do is enter the domain names like I posted (not the IP number) and it will work. Your site isn't going to instantly pop up when you set it though. It will take a while, so just set it to the proper domains and wait it out. Also, I noticed in one post you had NS & NS2 -- but in the other, you had NS1 & NS2. Those aren't the same thing, so be sure to set it exactly as your host told you (but without the IP numbers).
Posted by MaFunk, 10-05-2003, 12:46 PM
I need my files. Am I just basically screwed or is there a way to get my files from this host who refuses to answer my emails? OK - I talked to godaddy and the said that my host needs to provide me with the new domain server info. And that my host shouldn't have given me any IP info as that is something that they need to change of their level. OK - after this post I'll quite complaining, but I"m so ticked off. What am I supposed to do? My host will not answer any emails and will not provide me with any info? Have your hosts been ignoring you? If not, who are your hosts? I need to move to someone who is not going to hide out when the chips are down.
Posted by v3mediaworks, 10-05-2003, 12:51 PM
One of my larger clients uses GoDaddy as well. They updated their dns server info on Friday night and were still having propogation issues over 24 hours later while mine (which are not at GoDaddy) were resolved the minute the new link came up. Seems that GoDaddy's updating is a bit slow? Use www.dnsreport.com to check out some of this -- hopefully that tool will help a bit.
Posted by ldl, 10-05-2003, 12:54 PM
I just took a quick look and it looks like ns.en-host.com ns2.en-host.com still point to the old cogent ip's in the root servers. That's probably part of the problem As for getting at your files, you should beable to ftp in using the server's ip address.
Posted by MaFunk, 10-05-2003, 01:08 PM
Thanks I'm starting to download right now
Posted by MaFunk, 10-05-2003, 01:26 PM
Once I download all of my files I need to find a new host who is set up for automatic osc installs. A few questions: 1) After I get my new host and do an automatic osc install, I will upload my files to the new host. Will i have to reconfigure some of my files to meet the new host? 2) How do I find a GOOD host. One who will communicate what's going on should something like this happen again? What questions should I ask? And what should I look for?
Posted by v3mediaworks, 10-05-2003, 01:26 PM
Has anyone heard any updates on the packet loss issues?? Its getting dead slow and my monitoring server here is paging me with tons of false positives...
Posted by racksense, 10-05-2003, 01:33 PM
- Ask them if they are multi-homed, ie. take transit from more than one provider. - Ask them if they have their own IP space, ie. rather than some which their provider has allocated them. - Ask them how you contact them in an emergency, and if that method will work if their network/server is down. - Ask them how you find out status information about their services if their network/server is down. - Ask them if they have an SLA, and if so, what compensation is offered if it fails.
Posted by racksense, 10-05-2003, 01:36 PM
I sent Jose a mail with some traceroute/ping debugging info, not heard anything back. Juane has posted here since, maybe he is looking into it?
Posted by racksense, 10-05-2003, 01:37 PM
Ah, actually I just had some mail from Jose to say he's working on it.
Posted by GreedyCapita, 10-05-2003, 01:58 PM
En-host is still pointing to the Cogent IP. Does anyone know whether this is a configuration issue or if it's just taking a while to update?
Posted by v3mediaworks, 10-05-2003, 02:14 PM
Root servers are still responding with ns.en-host.com. [38.114.3.101] [TTL=172800] ns2.en-host.com. [38.114.3.102] [TTL=172800] As I said earlier, an update at GoDaddy didn't start hitting the root servers for nearly 24 hours...
Posted by ldl, 10-05-2003, 02:26 PM
Thats odd when I updated my domain at godaddy from the time godaddy said updates pending to complete it was changed in the root servers.
Posted by MaFunk, 10-05-2003, 02:31 PM
But, en-host doesn't use godaddy, so that can't be the issue. Their registrar is NameScout.com
Posted by mainarea, 10-05-2003, 03:04 PM
Updates can take 24-48 hours to take place with all registrars, not just GoDaddy. - Matt
Posted by v3mediaworks, 10-05-2003, 03:16 PM
I know - my point was more that experience on this situation is that it CAN take awhile.
Posted by akashik, 10-05-2003, 03:28 PM
Amazing. I just read this whole thread. Quite a dog and pony show and shows why you should never, never rely on a single provider if you're charging people for a 'service' regardless of the swift running around in circles that appears to have happened sorting out their mess.
Posted by Faggle, 10-05-2003, 03:51 PM
dun dun dun down again..
Posted by Sasuke, 10-05-2003, 03:54 PM
And I thought it was just me Fraggle.
Posted by TMS - JoseQ, 10-05-2003, 03:55 PM
We're working to resolve the issues we're seeing with the packet loss. Please pardon the inconvenience.
Posted by Bendy, 10-05-2003, 03:56 PM
down again! quick!!! quick to fix it!!!
Posted by ExaServers, 10-05-2003, 03:57 PM
We are down also Anybody has any new news? Jose and Juane are not online !
Posted by FactoryNet1, 10-05-2003, 03:57 PM
Is it down? Mines down too..
Posted by Eyal, 10-05-2003, 03:58 PM
Down Here
Posted by chrisbond, 10-05-2003, 03:58 PM
Just spoken to jose and there working on the problem - its to correct the packet loss.
Posted by Branzone, 10-05-2003, 04:08 PM
And omg.. that en-host.com person.. YOU CHANGE THE IP TO THE DNS RECORD NOT THE NS1.EN-HOST.COM. Godaddy's is VERY simple. login click nameservers click on dns It shows you Host IP NS1 216.66.19.* REMOVE NS2 216.66.19.* REMOVE ALL I had to do is click on the ip address (which was a link) And it gave me the option to change the IP address. There is nothing hard about it. Simply change the IP address to the new one whatever yours is.............. AND THEN hit save it takes maybe 5mins for godaddy to resolve this and then all you have to do is unhook your cable/dsl modem for a good 2-4minutes (And your router if you have one) Let it clear the cache and then reconnect. And OMG your site will work... what a concept.. IT is not that hard. And changing hosts wont fix your problem if you cant simply change your DNS entries. Thank you and good day.
Posted by Bendy, 10-05-2003, 04:12 PM
My Nameserver 's domain is .BIZ use REGISTERFLY.COM. About 5 hours . My Nameserver 's change is ok!
Posted by FactoryNet1, 10-05-2003, 04:17 PM
huh? whats happening.. when are our servers going to get back up?
Posted by ENH Jonathan, 10-05-2003, 04:17 PM
Yes. All the changes and such have been made with en-host.com. The nameservers are actually ns.en-host.com and ns2.en-host.com (not ns1), but that'll still work anyway. Just a matter of propogation and the packetloss resolving now.
Posted by lisllc, 10-05-2003, 04:21 PM
This is Reid from he.net, I just want to verify that we are rerunning some cabling right now to try to narrow down the packet-loss problem. You should see everything back up shortly. Reid
Posted by threedee, 10-05-2003, 04:27 PM
Back Online.
Posted by Paula Ollie, 10-05-2003, 04:30 PM
Hello Since WHT here's been the official front desk to this event - is there some ETA to this late fix? Tks Paula
Posted by Bendy, 10-05-2003, 04:31 PM
YES! back up online!
Posted by Branzone, 10-05-2003, 04:31 PM
Everything seems to be back online.. and faster
Posted by Paula Ollie, 10-05-2003, 04:32 PM
yes. The ETA is right now :}
Posted by Bendy, 10-05-2003, 04:39 PM
1
Posted by Faggle, 10-05-2003, 04:39 PM
back again... need a noc cam so we could of seen the guy who tripped over the cord...
Posted by Bendy, 10-05-2003, 04:44 PM
Hop (ms) (ms) (ms) IP Address Host name 1 0 15 0 66.46.176.3 - 2 0 0 0 216.191.97.41 pos5-3.core1-mtl.bb.allstream.net 3 0 15 0 216.191.65.173 pos2-1.core2-tor.bb.allstream.net 4 15 16 16 216.191.65.198 pos5-1.gwy1-chi.bb.allstream.net 5 16 31 16 206.220.243.189 - 6 62 63 78 216.218.254.77 pos0-0.gsr12012.sjc.he.net 7 78 62 79 216.218.132.1 gige-g0-0-2.gsr12008.pao.he.net 8 78 62 78 216.218.254.34 gige-g1-0.gsr12012.pao.he.net 9 78 Timed out 78 64.62.227.50 pos2-0.gsr12012.lax.he.net 10 109 110 109 64.71.157.49 pos2-1.gsr12012.dal.he.net 11 Timed out Timed out Timed out -
Posted by Branzone, 10-05-2003, 04:45 PM
sit tight folks im sure itll be fixed soon.. not like they arent gonna fix it.
Posted by Faggle, 10-05-2003, 04:45 PM
3 gsr12012.ash.he.net (65.19.141.229) 10.382 ms 8.781 ms 8.771 ms 4 pos2-0.gsr12012.dal.he.net (64.71.157.58) 43.854 ms 44.213 ms 43.996 ms 5 * * *
Posted by Bendy, 10-05-2003, 04:45 PM
TRACK FAIL!
Posted by threedee, 10-05-2003, 04:59 PM
Please anyone update.
Posted by GeorgeBH, 10-05-2003, 05:02 PM
I am sure TMS are aware of the problems they are experiencing and that it doesnt help that you lot are constantly trying to contact them to find out whats wrong, we have 20+ machines with TMS, and I still rate them to be the best Unmanaged Server Provider Out There. I have been purchasing servers from them since their first month of trading, and despite their current problems I have had less downtime than RackShack, Nocster over the last 7-8 months. Im sure it would help if we could stop hassling them and let them get on with their jobs.
Posted by threedee, 10-05-2003, 05:05 PM
I agree, it is the meaning of this forum existance.
Posted by FactoryNet1, 10-05-2003, 05:07 PM
servers are back up!
Posted by Eyal, 10-05-2003, 05:27 PM
its just me or there is speed problem ?
Posted by Mango, 10-05-2003, 05:28 PM
Per the posts from JoseQ and Hurricane Electric above, that's exactly the problem they are working on. Carl
Posted by FactoryNet1, 10-05-2003, 05:31 PM
ya.. its up but its very slow..
Posted by lisllc, 10-05-2003, 05:35 PM
Just to make it clear, the problem is caused by the speed at which we had to get this connection up. With proper notice of shutdown to TMS by their previous provider, this all would have been avoided. As is, both Jose and we are working hard to solve the problems.
Posted by Faggle, 10-05-2003, 05:37 PM
Yeah we know ... Where all really bored right now so we have nothing else to do atm..
Posted by FactoryNet1, 10-05-2003, 05:38 PM
Do you know about how long it would be down?
Posted by Branzone, 10-05-2003, 05:40 PM
Im just trying to get my post numbers higher
Posted by Branzone, 10-05-2003, 05:41 PM
See now I'm at 19 thats almost 15posts from me in this thread alone...
Posted by Mango, 10-05-2003, 05:49 PM
Things seem to be back to normal, not ? Carl
Posted by FactoryNet1, 10-05-2003, 05:53 PM
Its still very slow.. or is it just me?
Posted by ENH Jonathan, 10-05-2003, 05:55 PM
There are still high pings and some packetloss periodically...but I think part of that is my home connection :p Sweet thing is im now only 12 hops away from the server, before I was about 19.
Posted by Bahawolf, 10-05-2003, 06:11 PM
I still can't connect to the main site.
Posted by Potsie, 10-05-2003, 06:11 PM
Doesn't anyone on WHT watch football or baseball? This is like one of the best weekends for sports fans (Oakland fans excluded) and y'all are here instead. For shame! And both Jose and HE posted earlier about this. They know it's an issue and they are working on it. Wasn't that an update? I even got an e-mail stating the same thing. Next time your DSL or cable fails let us know how long it takes THEM to resolve it
Posted by Faggle, 10-05-2003, 06:20 PM
yeh.. watched the packers spread cream cheese all over the seahawks ass's
Posted by Paula Ollie, 10-05-2003, 06:33 PM
Greetings all For me it is looping between | 216.66.36.13 | | 216.66.24.154 | Moreover, most but not all of the rootmasters here in Brazil cannot push the trace to the end, getting timeouts at the last 2/3 hops. As a consequence some of my clients are very happy and others got the blues. Paula
Posted by Eyal, 10-05-2003, 06:37 PM
up down up down up down like a yoyo
Posted by FactoryNet1, 10-05-2003, 06:40 PM
ya its like that for me too...
Posted by Mango, 10-05-2003, 06:50 PM
Seems like everybody should have come online again Carl
Posted by ecal, 10-05-2003, 07:38 PM
Ok, seems no more packet loss but the overall speed (up/down) has been cut in half....
Posted by aingaran, 10-05-2003, 07:40 PM
I have DirecTV. I was switching from the Denver/KC, Seahawks/Packers, Saits/Panthers and A's/BoSox game. It was great. Getting ready to watch Browns/Steelers.
Posted by Mango, 10-05-2003, 07:48 PM
Quoted from JoseQ : "..., we're actually running at 33% capacity. We will turn on the other 66% up shortly." Carl
Posted by MaFunk, 10-05-2003, 10:05 PM
I realize that you're trying to be helpful, but I'm not the en-host guy. I can not change the dns entries., as I am not hosting the domain name servers. My host, en-host is. And they have changed the IP address. That's where the confusion came in. When they told to change my dns entries to 216.66.18.101 I thought that the meant (en-host.com to 216. . .) which seemed weird to me and of course was not allowed by godaddy. I'm all set on my end I'm just waiting for en-host to come back up on their end. Their name servers are still pointing to cogent.
Posted by Branzone, 10-05-2003, 11:44 PM
oh well again.. i was just trying to bump my post numbers HARHAR
Posted by ecal, 10-06-2003, 02:39 AM
Ahhh speed! 360-400KB/s on cable!
Posted by threedee, 10-06-2003, 03:16 AM
Down again?
Posted by Bendy, 10-06-2003, 03:17 AM
my server also down!
Posted by TMS - JoseQ, 10-06-2003, 03:22 AM
Still working on fixing the line... Your patience is very much appreciated. We will have the line back as soon as possible. Both HE and our engineers are working to get this resolved tonight.
Posted by chrisbond, 10-06-2003, 03:46 AM
Any ETA on a true fix for this problem as its down and its 8:50am in the uk.....
Posted by GeorgeBH, 10-06-2003, 12:04 PM
Hows This Running For Everyone Else Now? Still Pretty Bad For Me.
Posted by chrisbond, 10-06-2003, 12:19 PM
Every is working amazing for me. BTW im getting spam from - if anybody else is getting it report it as its against the boards rules i believe: sailor Web Hosting Master Registered: Dec 2001 Posts: 862 moving? how are things going? when you get back connected (so that you can transfer data) - I can cut you a deal if you are interested in moving. __________________ www.tranxactglobal.com Web hosting colocation and dedicated servers that can't be beat!
Posted by v3mediaworks, 10-06-2003, 12:21 PM
It's pretty painful... Not only is latency really harsh, but I'm getting reports of a lot of routing failures through UUnet and others...
Posted by TMS - JoseQ, 10-06-2003, 12:36 PM
Unfortunately, we are still working on the line. This means that in no way our service back in full form, or that you should expect service to continue to be as is now for the long term. Unfortunately all of our efforts for the interim solution have been frustrating, but we continue to try different things while the final solution is setup as it should be. Unfortunately we couldn't get that in place during the weekend, and the interim solution hasn't worked as designed. We won't be giving up until this is working as it should though, so be assured we're doing everything in our power to be back as it should be as soon as humanly possible. JoseQ
Posted by Paula Ollie, 10-06-2003, 12:48 PM
Hello Jose I completely understand this. So far, it has been possible for me to cope with the only problem that I face here: time-out on registrars trying to get DNS information from nameservers configured over the new IPs. But things are well under control here and I am sure you will timely get these routes/lines tamed. Good luck! Paula
Posted by MaFunk, 10-06-2003, 01:09 PM
I still have absolutely NO service. When you say that I should expect service to be as it is now for the long term, just how much longer can I expect to have no service? I'm attending the world's largest food show in Germany and need my service up before then. I'm trying to move to another host so that I'm sure to be up by then, but when I try to download my files it keeps cutting out.
Posted by TMS - JoseQ, 10-06-2003, 01:38 PM
As you are probably aware, we have finally fixed the line issues and are running at full capacity. MaFunk; I'm sorry but the DNS issues are up to your server's administrator. I can try and help you, but ultimately if you're having Name Server difficulties, only the owner of the domain can help you there. =( JoseQ
Posted by mickmel, 10-06-2003, 01:53 PM
You misunderstood what he said:
Posted by Branzone, 10-06-2003, 02:12 PM
He meant dont expect the service to be of what it was when he posted. Which was at 33% capacity. It seems that its at 100% capacity from what Jose posted in his last post. If you dont have service. a)Did you email Jose your IP/Password to get it changed. b)If not your server might not be up because of that. c)PM Jose the information. I do not know your stance on it I am only trying to help. I have 8 Box's with TMS and they are all online.
Posted by aRseNik, 10-06-2003, 05:06 PM
My server has been down since the day this stuff happened. Its still down now. The last ticket response was: Jose Quinones 5-10-2003-12:58 I will have it re-installed later today then. Didn't dare do that last night and couldn't get a hold of you by the time I finally got around to working on your server, sorry it took so long. Been a day since then, and not up. What is going on..
Posted by ecal, 10-06-2003, 05:08 PM
Upstream speed is very quick, however downstream is only around ~300K/s ...
Posted by Branzone, 10-06-2003, 07:15 PM
What is it that is being reinstalled? If its something more then just changing IP's in the configs then yes it may take longer as the primary goal is to get all the box's back online with the new IP's.
Posted by fhost, 10-08-2003, 03:27 AM
now my speed very good for donwload 00:24:06 (3.99 MB/s) - `test10m.dat' saved [10483964/10483964] and upload 07:27:03 (6.04 MB/s) - `test10m.dat.1' saved [10483964/10483964]
Posted by wheimeng, 10-09-2003, 01:39 AM
Where did you test that speed in? Anyway, I still think multi-homed connection is better. What if HE screw you guys up like how Cogent did? Probably get some cheap bandwidth for backup? Just my 2 cents.
Posted by chrisbond, 10-09-2003, 03:36 AM
UltraUnixNET: My understanding is that he.net was going to be the backup to cogentco originally. From what jose said to me there investing other alturnative providers now i believe for backups.
Posted by wheimeng, 10-09-2003, 04:17 AM
Sounds great Maybe Yipes should be the next cheap bandwidth provider.
Posted by fhost, 10-09-2003, 07:30 AM
i tested between EV1 and TMS servers
Posted by TMS - JoseQ, 10-09-2003, 10:47 AM
What was mentioned above is correct. We're still looking for a secondary provider to start doing multi-homing and offer better connections all around. Hopefully we can have something up by next week. I'm calling and meeting with all the necessary people non-stop until I have something in place. JoseQ
Posted by JKhoury, 10-11-2003, 07:42 AM
goodluck
Posted by Paula Ollie, 10-11-2003, 08:28 AM
Now that this thread is ending, I have a last remark. We in the (small) webhosting business are aways concerned with the payoff matrix between pricing and uptime. This sometimes brings us to the choice between huge providers and smaller providers. We always have a ready interface to talk with the big ones. We fear that the smaller ones will fail yet becoming non-responsive and we get very upset when the big ones have a thousand ways to be contacted but sometimes won't give us a more personal approach to our problems. Both models are a way to go and I actually like to have all of them in a combo. But for me, TMS has shown that they know how to handle a crisis very well and in a pace that levels them equal to huge networks. Untill the day of the crash last week, I trusted them but had never saw them "in action". Now I trust them because I saw them in action. Of course I hope and trust that they will not need to be in action again. Good luck, guys. Paula
Posted by chrisbond, 10-11-2003, 01:25 PM
I cant agree with Paula more - I've dealt with all the big boys in the hosting game and personally they've just made me the customer feel like im one of many that they couldnt be bothered loosing. TMS have always kept base with the customer and if you want something they will do there best to sort you out. I've seen some people on this thread starting looking else where on some of the forums, I will certainly be keeping my servers with TMS. I think once the backup link is in place there's nothing stopping these guys in future. (Who else would get up out of bed when there pager goes off to reboot a server for you!!)
Posted by akuo, 10-11-2003, 05:14 PM
I hate to say it, but of course most of the 'bigger' companies would actually have staff on 24 hours a day. Just a thought
Posted by Paula Ollie, 10-11-2003, 05:49 PM
I appreciated your reminder, yet the quality of the assistance should be regarded as so important a component as the extension. 24x7x345 with loooong average roundabout ticket time or unconclusive replies may be worse than a more limited schedule yet with staff replying to us fastly and efficiently. Yet I should mention that I have been fortunate either with my big ones and my smaller ones too. :-) Paula
Posted by akuo, 10-11-2003, 07:04 PM
Very true indeed
Posted by Mango, 10-12-2003, 04:34 PM
Correct ! I've NEVER EVER had problems contacting them fast and ALWAYS experienced a 'whatever it takes' approach from TMS. I wouldn't want to be the one sleeping with a pager next to me, with the possibility of one of their few hundreds of servers going down any moment. They're doing whatever they can to keep their customers happy, which is very hard when you also have a private life with your family... I have the uttermost respect for them, for what they provide us with and for what they invest in our good experience. They have all of my future business. Carl
Posted by TheTrance, 10-30-2003, 01:46 AM
Thats very lame of cogent