FDCServers/Denver Down ?

Portal Home > Knowledgebase > Articles Database > FDCServers/Denver Down ?

Posted by brc_csf, 04-09-2010, 03:33 PM
Hello, All our servers hosted in Denver are down. Anyone aware if it is a network or power issue?
Posted by Negizmo, 04-09-2010, 03:49 PM
Looks like it may be a routing issue. I can't ping the Denver looking glass @ lg.denver.fdcservers.net from my home computer, but I can ping it fine from a server.
Posted by brc_csf, 04-09-2010, 03:50 PM
Our servers are already back. Great .
Posted by brc_csf, 04-09-2010, 03:53 PM
Everything down again
Posted by Negizmo, 04-09-2010, 03:53 PM
Hm.. I'm still seeing an issue here though. tracert to lg.denver.fdcservers.net from home pc: From server:
Posted by brc_csf, 04-09-2010, 04:00 PM
That's where it stops here: 12. comcast01.den.fdcservers.net 14.2% 1840 297.3 390.8 183.9 1049. 146.0
Posted by brc_csf, 04-09-2010, 04:06 PM
Back again! Great
Posted by suhailc, 04-09-2010, 04:07 PM
Got this reply from FDC a short while ago. So upstream connectivity problems.
Posted by brc_csf, 04-09-2010, 04:09 PM
Down again. Clients are getting crazy.
Posted by Negizmo, 04-09-2010, 04:38 PM
Seems fine now.
Posted by GigeWeb, 04-09-2010, 04:38 PM
We're in the same boat. They don't have an ETA when the server will be backup buts its been up and down for the past hour.
Posted by GigeWeb, 04-09-2010, 04:42 PM
Servers are up.
Posted by brc_csf, 04-09-2010, 04:44 PM
It was going up/down, let's see if it is solved. FDC would be perfect if their network was more stable and if they had batteries.. Their support is awesome, fast and objective, just the way we need. In my opinion they should raise their prices and get batteries and someway to have a 100% network. I wouldn't mind paying 30% mre to have it.
Posted by vincent91326, 04-09-2010, 04:46 PM
Our network admin is currently working on the router. We don't have a precise ETA just yet, but we believe it should be back online shortly. Again, we're very sorry about the trouble this has caused. "" From fdc
Posted by brc_csf, 04-09-2010, 04:54 PM
Our servers have been online for the last 20 minutes. I believe it is solved. Are you still having problems?
Posted by vincent91326, 04-09-2010, 04:57 PM
Mine have been off for an 1+ They just started working this Moment. Well see if it goes back off.
Posted by yajur, 04-09-2010, 05:17 PM
i think there network speed is too slow now
Posted by quad3datwork, 04-09-2010, 06:16 PM
I was under the assumption @ Denver they have UPSs? No? No UPSs @ Chicago.
Posted by renski, 04-09-2010, 08:38 PM
I'm so sick of this **** at fdcservers.. there are always outages. Here's a tip for anyone considering FDC for a dedicated server, if you want something that has a reliable connection to the internet, don't go with FDC. You get what you pay for, it's cheap and nasty.
Posted by GigeWeb, 04-10-2010, 10:32 AM
Down again?
Posted by Finer - Jack, 04-10-2010, 10:35 AM
Yep, I can't access a site hosted at FDC
Posted by SeedBit, 04-10-2010, 10:37 AM
My VPS provider has nodes in FDC Denver. My Denver VPS is inaccessible.
Posted by GigeWeb, 04-10-2010, 10:39 AM
Everything was good, since we have been at the denver facility, we have had 100% uptime since August all of a sudden APrils uptime is 99.98 and dropping.
Posted by suhailc, 04-10-2010, 10:42 AM
Denver servers down again now!
Posted by yajur, 04-10-2010, 10:43 AM
fdc down once again
Posted by badboyx, 04-10-2010, 10:44 AM
maybe they are doing some network upgrades
Posted by GigeWeb, 04-10-2010, 10:44 AM
Denver's network is currently experiencing issues. Our network administrator is currently looking into the issue and is working on a resolution. We do not have ETA when the network will return to normal capacity, however we appreciate your patience in the meantime.
Posted by yajur, 04-10-2010, 10:45 AM
Denver's network is currently experiencing issues. Our network administrator is currently looking into the issue and is working on a resolution. We do not have ETA when the network will return to normal capacity, however we appreciate your patience in the meantime. this was there reply
Posted by GigeWeb, 04-10-2010, 10:45 AM
From FDC a few minutes ago. Ever since this expansion at the same DC there has ben issues.
Posted by GigeWeb, 04-10-2010, 10:46 AM
I like how they provide an automated/canned response and close the ticket.
Posted by renski, 04-10-2010, 11:00 AM
Thats ********.. they've had numerous outages since last year.
Posted by yajur, 04-10-2010, 11:05 AM
now my server is up
Posted by badboyx, 04-10-2010, 11:08 AM
its down now
Posted by strat, 04-10-2010, 11:10 AM
seems to be coming back now.
Posted by badboyx, 04-10-2010, 11:19 AM
the network is not stable its turning up/down many times right now
Posted by aeris, 04-10-2010, 11:30 AM
FDCServers have really gone down the crapper lately. I used to have six servers with them, and I've been with them for years, but after numerous issues caused by cheap desktop hardware and abysmal network performance - not just being overall slow, but also tending to drop off the planet for several minutes on a daily basis - I'm down to just one. And it's going out the window as soon as I can get the replacement up and running. Repeatedly having IPs stolen due to their poor network security ("what network security?") doesn't help either. Case in point, one of the servers I threw out were reporting high temperatures on all the disks (ranging from 58-64 degrees C). Their response, in full, was as follows: "Those errors are not indictitative of any failure, pending or otherwise. It's simply a temperature monitor on the drive." And to top it off, they're not even cheap anymore, especially compared with some of the larger European providers. Fast, Good, Cheap? Pick none.
Posted by strat, 04-10-2010, 11:37 AM
I don't know what you guys are complaining about but in May it will be 1 year that i have been with fdc and uptime in denver has been nearly 100% maybe 2 or 3 small outages nothing major since may 2009. For what im am paying and the support they provide cut them some slack im sure they are working on a fix.
Posted by renski, 04-10-2010, 11:43 AM
There were some major outages only a couple of months ago at Denver.
Posted by brc_csf, 04-10-2010, 12:11 PM
From what I know Chicago relies on its building UPS and Denver does not have any ups at all.
Posted by GigeWeb, 04-10-2010, 01:13 PM
I believe that is a matter opinion as what I can see there were only this outage and an issue with their network with speed which was resolved. Other than that the only downtime we experienced was this outage and an issue with the firewall.
Posted by DMEHosting, 04-10-2010, 01:55 PM
Started since yesterday afternoon. Yesterday it was DDoS attacks, servers going offline every other hour. Today it looks to be the same.
Posted by yajur, 04-10-2010, 02:18 PM
any one haveing low download speed in there server?
Posted by brc_csf, 04-12-2010, 09:39 AM
Am I the only one having around 30%-50% packet loss? Are we going down again ?
Posted by scooby2, 04-14-2010, 01:02 AM
No UPS at all in Chicago. They are on decent electrical feeds but if any building electrical maintenance needs done, the whole DC goes off line.
Posted by Seeyabye, 04-14-2010, 11:38 PM
May I know how are the situation for FDCServers customers right now? I'm about to purchase their server, but I'm hearing that their network isn't that good at the moment, and that's really an important factor for me.
Posted by tsj5j, 04-14-2010, 11:52 PM
Indeed, I am also looking into their services. Are the recent network issues localized to Denver or does that apply to their Chicago network as well. There are also some claims of low per-connection speeds, is this still ongoing?
Posted by brc_csf, 04-15-2010, 07:50 AM
Most of our servers are in Denver but we also have Servers in Chicago. Chicago has been more stable. Denver is having some network issues (alarms beeped three times this night - 100% loss on some IP's for some minutes - this night it was fast, nothing to worry). We have been with them for one to two years and they have been great. Support was the best we've ever seen. One of their support guys (Justing S) from Denver is really fast and objective (has replaced our memory in less than 10 minutes during the night). I think they should raise their prices a bit and make remote hands $$ so they can keep quality. With these expansions I am afraid they won't be able to keep quality. Hope I am wrong. Generators and batteries would also be great. On the past months I would give them (0 to 10): 10=support 8=network On these April month I would give network a a 4 and we are still in the middle of the month.
Posted by Seeyabye, 04-15-2010, 07:52 AM
So their network at Chicago is much more stable?
Posted by brc_csf, 04-15-2010, 08:54 AM
Yes, but Chicago is full.
Posted by elvis1, 04-15-2010, 03:32 PM
sorry for the OT: thats very good! did they charge you ( in case of being colo) or was it included"? thanks
Posted by brc_csf, 04-15-2010, 03:38 PM
We buy hardware directly from them so they give something like "1 year warranty".
Posted by DMEHosting, 04-15-2010, 04:56 PM
All of our servers in Denver keep going off/on/off/on/off/on. We keep losing connectivity for short bursts of 10-20 seconds. Is anyone else getting this in Denver?
Posted by SeedBit, 04-15-2010, 06:37 PM
Considering I'm hosted with you with a VPS in Denver, yes . Perhaps it would be a good idea to move the HyperVM system to an node not in Denver?
Posted by DMEHosting, 04-15-2010, 09:33 PM
Would rather not move the master server since it's some pretty expensive hardware and would cause problems for a lot of clients who point subdomains to the masters' main IP for logging in. FDC should simply just fix it.... :/
Posted by diegomfo, 04-16-2010, 01:34 PM
We were also experiencing these short loss of connectivity yesterday. They are easy to detect with audio streaming or VoIP going to the Denver datacenter. We have several streaming clients publishing from different locations around the world and everything going through their Comcast route was severely affected. I hope they resolve these issues for good, they have been great in the past with nothing to report for months.
Posted by stickman1982, 04-22-2010, 12:33 AM
Now they offer cross connects to one of their customers bandwidth in their denver facility. I e-mailed them and they said they would discount my server if I got a xconnect to their customer for providing bandwidth. Goto FDCservers.net and click Services - click Colocation then click Carrier Neutral then click the 2nd link. Looks like I can get a 100mbps unmetered connection for $395.95. I did some pings and it looks like they have good responses. But I was wondering if there's anyone else here that has done that and can give me feedback?
Posted by brc_csf, 04-27-2010, 11:06 PM
All Denver down again?
Posted by donbiz, 04-27-2010, 11:37 PM
Yeah, got this response back from them:
Posted by brc_csf, 04-27-2010, 11:45 PM
Hope it is just network related (and not power related).
Posted by DMEHosting, 04-27-2010, 11:52 PM
We have about 10 servers down in Denver again. Unless they are getting 200Gbps attacks in Denver, not sure how it can bring down everyone.
Posted by brc_csf, 04-28-2010, 12:00 AM
Are all your Denver servers down or just 10 of them? I just want to understand if this issue is affecting 100% of the IDC. Does anyone have a server up there ?
Posted by brc_csf, 04-28-2010, 12:01 AM
lg.denver.fdcservers.net is up now (was not before).. So I believe it is not affecting 100% of the IDC. Maybe power problem on part of it.
Posted by renski, 04-28-2010, 12:10 AM
What a wonderful company fdc is.. yet another outage, I'm moving my server soon as I can. Sick of this
Posted by brc_csf, 04-28-2010, 12:20 AM
Seems to be up. Hope it won't be up/down. Don't they need more BW to handle these kind of issues? These are happening a lot and I believe affecting everyone.
Posted by edesignway, 04-28-2010, 12:24 AM
At least some of you are up. My rack is still down...
Posted by brc_csf, 04-28-2010, 12:47 AM
Down again.
Posted by ZachMaC, 04-28-2010, 12:56 AM
yep this is getting old
Posted by Katatonic, 04-28-2010, 01:04 AM
They have said it is a DDoS this time. It must be a fairly epic DDoS for it to cause such down time. This isn't the first time they've had such network related issues (99% of ISPs always say it's DDoS) - so regardless of what it is I'm hoping they are putting in some preventative measures.
Posted by renski, 04-28-2010, 01:11 AM
These outages have been going on for months, the last month has been particularly bad. From where I'm standing they don't appear to be doing anything to prevent further attacks.
Posted by Katatonic, 04-28-2010, 01:13 AM
Yes, it has been going on for quite a while and this time it seems to be going on much longer. I was hoping they would lift their game as I'm keen to do some expanding in the area.
Posted by DMEHosting, 04-28-2010, 01:16 AM
This has been an issue for nearly 2 months.
Posted by elmdavid, 04-28-2010, 01:18 AM
Anybody have problem with FDC now?
Posted by brc_csf, 04-28-2010, 01:20 AM
Based on the time they are on market I really thought they already had lot of experience to deal with this kind of attacks (or network issues). Maybe it is time to stop expanding and start checking and fixing each point of failure, else they might throw away the name they "created" during these years.
Posted by coolnikin, 04-28-2010, 01:25 AM
fdc its time to fix the network topology at denver, a ddos shouldn't be able to take down an entire network !
Posted by brc_csf, 04-28-2010, 01:26 AM
We have been down for the last 2h26m (it came back for 10 minutes and then was down again).
Posted by brc_csf, 04-28-2010, 01:28 AM
Back again! Hope it won't go down again
Posted by Katatonic, 04-28-2010, 01:49 AM
We're back up as well:
Posted by Katatonic, 04-28-2010, 02:29 AM
Looks like they're doing some thing which is nice!
Posted by virys, 04-28-2010, 04:24 AM
come back briefly and went again ! and now is back again ! pheeeeww !
Posted by brc_csf, 04-28-2010, 05:27 AM
Down again
Posted by rnavarro, 04-28-2010, 05:43 AM
Yep down for me too, this is getting really annoying...
Posted by Katatonic, 04-28-2010, 06:00 AM
Those updates they want to make can't wait till May 1st - this is getting ridiculous.
Posted by brc_csf, 04-28-2010, 06:05 AM
Why not update spare/backup routers and have them moved to production?
Posted by Hannan, 04-28-2010, 06:21 AM
It's really getting annoying
Posted by renski, 04-28-2010, 06:25 AM
**** provider.. they are sure to lose a lot of customers over this.
Posted by Katatonic, 04-28-2010, 06:25 AM
After several hours it seems like the issue is a bit more complicated than that. As usual, what they tell the client is the tip of the iceberg. There would be many underlying factors, especially if they send out announcement saying that the service is back online - only to come down again.
Posted by DMEHosting, 04-28-2010, 07:18 AM
Quite a few of our secondary IP's no longer work even though the servers do themselves, anyone else? Ours wont even trace to their dc... EDIT: Nevermind, they just gave away 2x/24 blocks to someone else. Last edited by DMEHosting; 04-28-2010 at 07:25 AM.
Posted by brc_csf, 04-28-2010, 08:53 AM
Down again
Posted by BradQ, 04-28-2010, 02:06 PM
If you think there's a spare router there, you're kidding yourself. You're connected via a single 65xx. From what little information they've provided however, this certainly doesn't seem like a localized router issue as much as a network or capacity problem.
Posted by renski, 04-28-2010, 11:22 PM
oh yeah, thats FDC for you.. they've given my ips to another customer before also.
Posted by renski, 04-30-2010, 02:14 AM
Here we go again.. down
Posted by Katatonic, 04-30-2010, 02:53 AM
Yep, you're not the only one.
Posted by DMEHosting, 04-30-2010, 03:31 AM
Seemed to only be a very short period of packet loss, not 100% loss for me during the time.
Posted by PersonalJ, 04-30-2010, 11:24 PM
edit: Just an issue with their comcast connection.
Posted by Extremeseo, 05-03-2010, 02:14 AM
fdc will be down tonight,they had a an official announcement posted on there forum stating that they will be performing a network maintenance on there routers,so users might face packet loss problems
Posted by brc_csf, 05-11-2010, 02:06 PM
Am I the only one having issues at this moment ? 95% of the server seem down.
Posted by DMEHosting, 05-11-2010, 02:21 PM
Luckily you are the only one....lol
Posted by yajur, 05-11-2010, 02:49 PM
no iam you had the issue
Posted by Katatonic, 05-15-2010, 10:56 PM
Is anyone else seeing random network issues at Denver? I.E dropping every few days for a minute or two + packet loss and high pings?
Posted by yajur, 05-16-2010, 04:59 AM
yes i too seen this when we work on ssh it lags for a while
Posted by brc_csf, 05-16-2010, 08:55 AM
Yes, it was happening with more frequency before and now just a few times a day. It would be great if one of us could keep a public ping (or uptime monitoring system) on one of your IP's (and lg.denver.fdcservers.net) so we can know if it is happening with everyone at the same time (at least, in our case, it happens with lg.denver and our ips at the same time).
Posted by Katatonic, 05-16-2010, 10:36 AM
I've setup and reset some monitoring for my servers + the Looking Glass. Good to start with some fresh logs. We'll see what happens from here.
Posted by brc_csf, 05-16-2010, 10:45 AM
Do you know any opensource util that would keep watching ping results and build a graph ?
Posted by Katatonic, 05-16-2010, 10:54 AM
We use Pingdom (as well as in house tools) - it's good to have a 3rd party validate which is part of the reason we use their service.
Posted by ceridius, 05-16-2010, 03:05 PM
from what I have read in this thread , I am reading they have no UPS in either DC this in my opinion doesn't even qualify these places the honor of being called a "data-center" it is my opinion to be called a datacenter you need to have the following : UPS to provide conditioned power to each and every server, precision air conditioning to cool the servers, and backup generators to support the power requirements of both the servers and the environmental units. Then from a network respective they should have at a minimum of 2 providers capable of handling the entire load of all servers on both links. It seems that this is a classical case of you get what you pay for , if you want an unmetered gigabit dedicated link to the net for less than the cost of bandwidth alone , even with some margin for over selling this business model is just not pheasable without cutting some corners , in this case it seems they have a network only and that's it , no power redundancy , network redundancy , or any redundancy at all. Some have you have said you would gladly pay more for such services , but when you have as many clients as they do , to make these upgrades the cost is in the millions of dollars to provide those redundancies. This statement is not to be construed as advertising my companies services just stating the obvious , one of the biggest things budget providers (Hivelocity included ) seem to forget that the redundant unit often costs the same as the primary unit and will only be used in an emergency , and it is hard to pay that extra money for a device that will only be used in an emergency , but after you experience enough emergencies you begin to look at the emergency as a headache you will have to deal with at some point so might as well deal with it now rather than later. Even though when it does do its job no one will be there patting you on the back for not going down due to the redundant unit doing its job , you can pat yourself on the back for doing a great job of providing the best possible service you can to your clients even if you have to raise your prices in the future. Just my $.02 you get what you pay for , always have and always will. if you want great service with nothing being sacrificed you will have to pay for it , and thats it. I also wanted to mention this is only my opinion and not that of HIVELOCITY as a company only the opinion of one person working for thr company. Last edited by ceridius; 05-16-2010 at 03:10 PM. Reason: disclaimer
Posted by Matthew_B, 05-16-2010, 04:09 PM
experiancing the same issue here guys But with a differnt provider, what is happening to the world.
Posted by badboyx, 05-16-2010, 04:29 PM
i can see a huge packet loss 2 0 0 0 70.87.254.5 po101.dsr02.dllstx5.theplanet.com 3 0 0 0 70.85.127.109 po52.dsr02.dllstx3.theplanet.com 4 0 0 0 70.87.253.17 et3-2.ibr03.dllstx3.theplanet.com 5 0 0 0 75.149.228.1 be-10-405-pe01.1950stemmons.tx.ibone.comcast.net 6 1 1 1 68.86.86.153 pos-1-3-0-0-cr01.dallas.tx.ibone.comcast.net 7 16 16 16 68.86.86.209 pos-1-6-0-0-cr01.denver.co.ibone.comcast.net 8 * 488 41 75.149.229.10 comcast01.den.fdcservers.net 9 * * *
Posted by brc_csf, 05-17-2010, 10:18 AM
Huge loss happening right now. Katatonic: Please check it right now
Posted by Katatonic, 05-17-2010, 10:25 AM
It should be okay now. It lasted for about 10 minuutes. Vancouver, Canada: Packets lost (60%) 44.9 45.4 45.8 76.73.18.90 Madrid, Spain: Packets lost (20%) 157.6 160.2 162.8 76.73.18.90 Padova, Italy: Packets lost (40%) 159.6 165.4 176.8 76.73.18.90 Austin, U.S.A.: Packets lost (50%) 42.9 43.1 43.3 76.73.18.90 Shanghai, China: Packets lost (60%) 240.7 241.4 242.3 76.73.18.90 Mumbai, India: Packets lost (40%) 249.0 251.7 256.2 76.73.18.90
Posted by HD-Sam, 05-18-2010, 12:56 AM
Anyone else have issues again? [edit] back to normal [/edit] Last edited by HD-Sam; 05-18-2010 at 01:04 AM.
Posted by strat, 05-18-2010, 05:08 AM
denver dead for anyone else??
Posted by brc_csf, 05-18-2010, 05:10 AM
WE are also down.
Posted by yajur, 05-18-2010, 05:16 AM
we too all my servers are down
Posted by badboyx, 05-18-2010, 05:16 AM
what is the hell is that ? for how long we are going to wait ?
Posted by Katatonic, 05-18-2010, 05:23 AM
Yes - We are all down again! This is very bad for business indeed.
Posted by Hannan, 05-18-2010, 05:24 AM
down here!!
Posted by yajur, 05-18-2010, 05:26 AM
may i know how long it has been down? because i check before 5min when a client told about this downtime
Posted by brc_csf, 05-18-2010, 05:26 AM
we have started loosing customers and money because of these FDC outages.. I really thought that after the router's (firmware?) update we would have network fixed.
Posted by brc_csf, 05-18-2010, 05:29 AM
We just implemented ping plots yesterday. 100% Packet loss started more than 30 minutes ago.
Posted by Hannan, 05-18-2010, 05:29 AM
more than 30minutes
Posted by strat, 05-18-2010, 05:30 AM
yep just over 30min now.. so its not just me... was about to open a support ticket for a server reboot but posted here first.
Posted by Hannan, 05-18-2010, 05:34 AM
Anything from FDCservers?
Posted by tonysan, 05-18-2010, 05:34 AM
DMEHosting at Denver down, too.
Posted by coolnikin, 05-18-2010, 05:38 AM
Ah, down from last 40 min.
Posted by Katatonic, 05-18-2010, 05:46 AM
The "firmware upgrade" was just a band aid solution. It's very clear that there are some serious issues at Denver that need addressing. This is massive down time and is affecting quite a large number of clients.
Posted by brc_csf, 05-18-2010, 05:53 AM
Anyone opened a ticket? Any updates?
Posted by Katatonic, 05-18-2010, 05:54 AM
They aren't responding to tickets at this stage.
Posted by suhailc, 05-18-2010, 05:57 AM
Ticket's been open for half hour now and no reply.
Posted by ashagg, 05-18-2010, 05:59 AM
1 hour and counting
Posted by Abobo, 05-18-2010, 06:01 AM
All my Denver servers with FDC are down. It has been one hour now and not a word from support about what's going on.
Posted by renski, 05-18-2010, 06:06 AM
what a joke this company is..
Posted by badboyx, 05-18-2010, 06:07 AM
they must take our servers uptime seriously we are losing costumers Please FDC explain what is the problem exactly ? we are suffering these since a long time we can not pass a month without outage every month has
Posted by Katatonic, 05-18-2010, 06:13 AM
Yep, we're in the middle of a presentation and trying to get more contracts. This is terrible.
Posted by brc_csf, 05-18-2010, 06:14 AM
^^ What we found worst than not getting new ones is losing your old ones.
Posted by brc_csf, 05-18-2010, 06:29 AM
It seems we are back.
Posted by ashagg, 05-18-2010, 06:30 AM
It's ALIVE !!!! now wait for the explanation
Posted by coolnikin, 05-18-2010, 06:31 AM
yes back outage total duration 1 hour 32 minutes
Posted by ashagg, 05-18-2010, 06:35 AM
"We have just recovered from a large network problem. We apologize for the loss of service you have encountered. If your service remains affected for longer than 15-20 minutes, please reopen this ticket. We thank you for your patience, and will do everything in our power to prevent such events from happening in the future." I expected a bit more detailed explanation for the outage. Guess that's too much to ask for eh ?
Posted by Hannan, 05-18-2010, 06:35 AM
It seems it was a power issue, cuz all of our servers rebooted!
Posted by brc_csf, 05-18-2010, 06:37 AM
Have your servers been rebooted? All of ours were. I believe they had a POWER FAILURE this time. We don't have 1 server that was not rebooted.
Posted by coolnikin, 05-18-2010, 06:37 AM
^ yes looks like power problem guess what, some1 had posted about no ups/backup generator at fdc & we see its effect
Posted by brc_csf, 05-18-2010, 06:41 AM
The servers have been up for 1h20m. So there was probably a blackout which lead to the reboot of the routers, etc and when they came back they did not work as expected. The last time we had lot of dead PSU's. Great to see they are alive at this time As I've said before, I would be happy to pay 30% more and have a stable network and generators.
Posted by ashagg, 05-18-2010, 06:41 AM
hmm... my servers show an uptime of 1 hour 26 mins ... so if it was a power failure, why was the network down for all this time !!!
Posted by coolnikin, 05-18-2010, 06:56 AM
that is probably the reason
Posted by Katatonic, 05-18-2010, 07:00 AM
Another generic reply saying they'll fix it - but fix what; besides the obvious down time.
Posted by brc_csf, 05-18-2010, 07:19 AM
Down again..
Posted by renski, 05-18-2010, 07:19 AM
more outages as we speak.. connectivity dropping randomly
Posted by yajur, 05-18-2010, 07:21 AM
once again it down
Posted by brc_csf, 05-18-2010, 07:21 AM
At least now I have ping times/loss to lg.denver on RRDTOOL graphs with 1sec interval so I can see I am not the only one going down
Posted by coolnikin, 05-18-2010, 07:23 AM
yes, down again
Posted by yajur, 05-18-2010, 07:29 AM
now there network is back
Posted by Katatonic, 05-18-2010, 08:08 AM
We'll see what happens this time.
Posted by Hannan, 05-18-2010, 08:30 AM
anyone else experiencing slowness?
Posted by Katatonic, 05-18-2010, 08:41 AM
It seems reasonable for us now. Given this was a power issue - and our nodes cold booted 4 times; can result to physical damage.
Posted by DMEHosting, 05-18-2010, 09:19 AM
Something weird is wrong with Denver, it's like their is a power issue? Some of our servers went completely offline...
Posted by yajur, 05-18-2010, 09:33 AM
yep all uptime has been reset
Posted by jjohnw, 05-18-2010, 09:36 AM
My server is still down. Have had a ticket in for a reboot for over an hour. Ticket hasnt been assigned yet. They are flooded. Pray to god my server is ok.... lost a hard drive several months ago and am not in the mood to do a full re-build today. So kinda glad its not just me (sorry if that sound selfish lol) Still cant ping my server from anywhere in the world.
Posted by jjohnw, 05-18-2010, 09:50 AM
Anyone have an accessible server yet??? Or am I just in a long line of reboots and they havent gotten to my box yet???
Posted by DMEHosting, 05-18-2010, 10:32 AM
We keep on having random servers lose power and drop completely offline. Are they having rolling blackouts in their Denver DC? Last edited by DMEHosting; 05-18-2010 at 10:37 AM.
Posted by jjohnw, 05-18-2010, 10:49 AM
(deleted - posted to wrong thread)
Posted by strat, 05-18-2010, 11:41 AM
My server was rebooted and as soon as i had access to it the uptime showed up as 1h 20m for some reason we had access 1hour + later So far seem normal and uptime is 09:36:23 up 6:23
Posted by jjohnw, 05-18-2010, 11:50 AM
Got my server booted an hour ago, but it didnt come up. Been sitting at the end of the support ticket queue again This really sucks. Got a feeling im gonna be down all day
Posted by aeris, 05-18-2010, 12:24 PM
Welp, the last server I had with FDCServers expired yesterday. Recently it's just been one screw-up after another. So long, and thanks for all the fish~
Posted by ronaldmd, 05-18-2010, 12:44 PM
Yes, im a new costumer and i thinking seriously of leave his servers. Sure, you can really use the 100 mbps if you want, i already hit that amount 4 or 5 hours the last week, anyway, the network is really unstable, there are 3 or 4 times per day whith a 100% lost packets, this can be 1 minute or even 5 or 6, the sad thing is that is happening every day and when you open a ticket, you recieve a "Our network was under a big ddos attack". And thats happens everyday. Also, this offline times of 3 hours... are getting the limit. I know they cant provide a 99.99% uptime warranty or something like that, you are not paying for that, but this is too much. Also, is anyone still having slow times and packet lost? Attached Images 4.png (56.3 KB, 29 views) Last edited by ronaldmd; 05-18-2010 at 12:48 PM.
Posted by edesignway, 05-18-2010, 01:27 PM
10 Servers just went down @ Denver.
Posted by SeedBit, 05-18-2010, 01:29 PM
Yep, Denver seems dead again.
Posted by yajur, 05-18-2010, 01:30 PM
what the hell is this down once again
Posted by brc_csf, 05-18-2010, 01:34 PM
Going up and down all day. I am afraid the only solution is to migrate to another IDC
Posted by NQhost, 05-18-2010, 01:43 PM
It seems like today's issue is the biggest problem with FDC network and infrastructure for long time. Let's hope that they will resolve it soon... There are no other companies with the same offers anyway.
Posted by brc_csf, 05-18-2010, 01:46 PM
Now everything has been 100% down for the last 10 minutes (all our servers). I see lg.denver.fdcservers.net is UP so I am afraid this is power related now..
Posted by ronaldmd, 05-18-2010, 01:47 PM
Yes, down, almost 100 packet lost. They should give us, at least, some explanation.
Posted by ronaldmd, 05-18-2010, 01:52 PM
Oh man, and they dont even answer the tickets... Last edited by ronaldmd; 05-18-2010 at 01:57 PM.
Posted by vbgamer45, 05-18-2010, 01:55 PM
Backup for me now.
Posted by ronaldmd, 05-18-2010, 01:56 PM
Also for me, but... for how long?
Posted by edesignway, 05-18-2010, 01:56 PM
Its like they are rebooting network gear or something. Thats about how long these little outages are lasting and then my remote session starts back up where I left off.
Posted by HD-Sam, 05-18-2010, 01:56 PM
This is ridiculous. This is the 6th time we have been down in the past few weeks. I'm taking everything out of FDC this week. Know of anyone else in Denver that can provides stable colo?
Posted by coolnikin, 05-18-2010, 01:57 PM
down again ! already had 5minutes of 100% packet loss for 2 or 3 times today whats going on fdc ?
Posted by jjohnw, 05-18-2010, 01:58 PM
Apparently my server has been booting for over 2+ hours and is in fsck hell. AARRRGHHH... probably have a terabyte of data on their its checking. I have no idea how long its going to take. Im going nuts. Either that or the power has been cycling faster than I can reboot. Havent had a single ping go through since this morning.
Posted by ronaldmd, 05-18-2010, 02:02 PM
Right now seems to be (at least for my servers) fine again, but, this is annoying, it will happens again.
Posted by badboyx, 05-18-2010, 02:03 PM
sorry FDC, but this is not acceptable we are not using the service for free please fix it forever we can't handle more outages
Posted by ronaldmd, 05-18-2010, 02:07 PM
You are right, even if we pay cheap monthly rates, this is ridiculous, they should give us a explanation (credible, even a little detailed), we are clients, this is a business, after all. Anyway, even if the things are up again, I see a little slowness. Is anyone in Denver having the same issue?
Posted by jjohnw, 05-18-2010, 02:15 PM
Finally back up. Crossing fingers. Graphs show ive been down since about 5am this morning. Now its 2pm. Ouch.
Posted by HD-Sam, 05-18-2010, 02:28 PM
We are even paying for redundant power drops. Yet power was cut on our servers today. I'm thankful we only use FDC for secondary dns failovers. Does anyone know if everyone in that building (1500 Champa) was affected or is it just FDC? Last edited by HD-Sam; 05-18-2010 at 02:32 PM.
Posted by elmdavid, 05-18-2010, 02:32 PM
Down now again?
Posted by edesignway, 05-18-2010, 02:36 PM
I deal directly with another tenant in 1500 Champa and they have not had any issues.
Posted by brc_csf, 05-18-2010, 02:52 PM
Don't think FDC is that cheap. Depends on the package you have with them. If you look around you will find that the price difference to other places is not that big. As we don't host games, but business, we'd be happy to pay more and have a stable service.
Posted by ronaldmd, 05-18-2010, 04:18 PM
Down again, dont even a single packet recieved in numerous times. Is anyone having the same service right now? Time to move on, anyway.
Posted by Matthew_B, 05-18-2010, 04:49 PM
Same here
Posted by jjohnw, 05-18-2010, 05:43 PM
Just so you can compare. Mine is still up.
Posted by XFactorServers, 05-18-2010, 06:16 PM
Handy Networks but pricing is going to be like FDC.
Posted by HD-Sam, 05-18-2010, 08:09 PM
Have you had experience with them? Better than FDC I hope.
Posted by jjohnw, 05-18-2010, 08:21 PM
Handy Networks dedicated servers have a 2TB limit. I need 100mbit unmetered.
Posted by XFactorServers, 05-18-2010, 09:12 PM
Yeah, we use them for our Denver location. We are going on our 10th month and we have had 100% uptime and zero network issues.
Posted by ronaldmd, 05-18-2010, 09:13 PM
Im looking for another provider. I was checking 100tb and there fee are similars to fdcservers, not managed, basic server 200 dls or so, and some other stuff, but looking in the web, they are a little strict with the content. I have a video online site and some users usually upload videos with copyright content, and I have to remove them manually, not always a fast a I should, i hear they kick you out at the first "copyright" act, so i dont know if move on there or not. The other option is a softlayer reseller with more than 10 tb of bandwith. The last option is wait to fdcservers so they can fix his network problem.
Posted by Katatonic, 05-18-2010, 09:15 PM
Most providers are very tolerant, but if it gets to the stage where you are receiving daily complaints - obviously it's simply in their best interest to take you off their network. Companies have every right to screen their clients as they wish, as each client affects every one else on the network. You're getting away with it at FDC most likely because they have a lower "standard"; this is apparent with the consistent network issues that they are not listening to their paying clients. Their deals are no longer exclusive.
Posted by edesignway, 05-18-2010, 10:50 PM
Handy Networks is a great Denver facility. When I was with them I had zero issues. Jay and Mike run a great shop over there.
Posted by HD-Sam, 05-19-2010, 06:16 AM
servers are going in/out again
Posted by donbiz, 05-19-2010, 06:53 AM
Yeah, I had my server going up and down there yesterday..
Posted by jjohnw, 05-19-2010, 06:13 PM
Quick Chicago versus Denver hosting question. I noticed on a mtr trace that from raleigh NC I get routed like this: NC-->VA-->NY-->chicago-->Denver Seems awfully roundabout. Seems like I would get better pings if I was hosted in chicago, even though im physically a lot closer to denver. (yes - I know that doesnt matter, but I kinda assumed there would be a fat pipe available to avoid such a long route) I want a data center that has nice fat pipe right in the middle "network middle" of the country. Is that chicago? dallas maybe? Where are the data centers located that have good ping/latency between BOTH coasts???? I would be interested in an FDC alternative with close to the same pricing if I could find it. 100mbit unmetered for < $300/month in this kind of location. Suggestions???? I guess asking for 100mbit unmetered is sorta dumb, since a fully saturated 24/7 100mbit pipe = 10TB a month. So providers giving you 10TB bandwidth on a 100mbit pipe is really the same thing. Last edited by jjohnw; 05-19-2010 at 06:25 PM.
Posted by jjohnw, 05-19-2010, 06:29 PM
Crap.... scratch that last post, I got chicago/denver switched in my head. Denver is west of chicago, DOH... brain fart.
Posted by templ33, 05-19-2010, 09:00 PM
Hate to say it, but you GET what you pay for. FDCServers, has always been a cheap budget host. FDC is synonymous with horrendous downtimes, inability to manage their seemingless weekly "DDOS attacks", and cheap bandwidth providers. Nothing really has changed with this host since a few years ago. Other than, they took down the pictures of the worker, trapsing around their datacenter with pizza or a sandwich. And maybe got rid of their Cogentco bandwidth (and replaced it with equally as cheap comcast bandwidth). Honestly what do you expect from a webhost that "A: FDCservers.net does not offer any SLA however we do realize uptime is very important for our customers." Honestly, how many colo or hosting providers do you know that won't gaurantee uptime (there aren't many of them), and probably for good reason... Are you going to find a decent / reputable provider that is going to provide a 100mb unmetered connection for under <$300. I doubt it, when you factor in energy costs, datacenter costs and bandwidth you will see why. If uptime and latency are important to you, then your going to have to unfortunatly PAY for it. Otherwise, stay with FDCservers and learn to deal with your site being slow or inoperable for hours or days several times a month. Hate to say it, but these clown are not going to magically get their act together. The same weekly outages and downtime has plagued these guys from the start. Fact is, they should probably just sticky this company to the top of this section, because you know next week its going to be the same story. Sure other reputable hosts have experienced DDOS attacks, but they were not regular occurances. And they quickly, within 24 hrs, brought in the equipment or support they needed to overcome them. Let's face it, DDOS attacks while a nusance do not continue forever. It seems like they just don't have the proper filters and firewalls and bandwidth to effectively deal with the situations. And why should they? They do not have to provide any credits to their customers. If they provide connectivity to your website or a bunch of roque machines doing a DDOS attack, it doesn't effect them financially. Sure they will loose customers, but there are plenty like yourself, that want dirt cheap unmetered bandwidth and are willing to live with them.
Posted by jjohnw, 05-19-2010, 10:34 PM
FDCServers.net fills a needed niche. Like you said, you get what you pay for, so there is no reason to attack them with all of the above. There is a reason their costs are so low, and for people running sites that chew bandwidth like candy and dont require top notch SLA's they fit the bill nicely. I dont have any business critical sites, and I would not host that kind of site with FDCServers, they would be the wrong fit. My $200/month server handles crazy load (I have it tuned up nicely), and with 100mbit unmetered, its hard to beat. Im just wondering what another $100 a month would get me. 100tb.com has stuff thats basically equivalent to FDCServers, so they are not the only game in town.
Posted by Katatonic, 05-19-2010, 11:18 PM
FDC no longer have a cost advantage. As you mentioned yourself - there are providers out there with better networks for a reasonable price.
Posted by XFactorServers, 05-19-2010, 11:27 PM
yup, 100TB (SL's network) blows away FDC's network.
Posted by jjohnw, 05-19-2010, 11:37 PM
How do you evaluate a providers network? I need a resource that shows me which networks rock so I can evaluate providers in the future.
Posted by Racksurfer, 05-19-2010, 11:52 PM
John, the only thing I can say is do a bit of research on the datacenter your wanting to partner with. Essentially, it will be critical to your business and the business of your clients when selecting a DC. Like I've noticed in the past, just because multiple people have superb uptime with a DC, it does not constitute that you'll have the same experience -- differnet network node, hardware/software,etc. Not only browsing the forums to find what works, but taking it a step further and not only look at the provider, but also their up/downstream providers. Ping the DC and also some of the providers that host in the same facility. The evaluation depends on serveral factors. I look at it like a stock. It performs well all the time great, but what happens when an outage occurs -- Support Team keeping clients in constant contact regarding the outage situation, period of outage, bandwidth providers, server hardware.
Posted by Ed-Freethought, 05-20-2010, 03:25 AM
100Mbps = ~33TB per month if you run it flat out I'm not too sure about the US, but in the UK 100Mbps of decent transit will cost you about £400-500/month depending on the data centre. If you use cheap rubbish and buy it in bulk then you can get down to about £150-200/month. I've seen HE.net advertising bandwidth in the US for $1.50-2.00/Mbps and I don't doubt that Cogent would provide something similar.
Posted by badboyx, 05-21-2010, 07:45 AM
DOWN AGAIN packets transmitted 4 received 0 packet loss 100 % time 3000 ms
Posted by yajur, 05-21-2010, 07:49 AM
yep it down
Posted by Hannan, 05-21-2010, 07:49 AM
yeah down again !
Posted by brc_csf, 05-21-2010, 07:50 AM
Down Again..
Posted by Hannan, 05-21-2010, 07:53 AM
Coming up again!
Posted by badboyx, 05-21-2010, 07:53 AM
the questions that presents itself why in the hell this happen ? what is the problem ? for how long we are going to handle this ?
Posted by coolnikin, 05-21-2010, 08:00 AM
total outage duration 13 minutes 11 seconds most will move on, as they find alternative
Posted by Katatonic, 05-21-2010, 08:29 AM
Was it a network outage or power this time?
Posted by yajur, 05-21-2010, 08:31 AM
only network outage
Posted by strat, 05-21-2010, 09:27 AM
I think having problems now ??
Posted by ronaldmd, 05-21-2010, 09:54 AM
Still losing a lot of packets from Europe. The outage for me was 17 minutes for me, also, yesterday there where 2 down times for about 4 or 5 minutes. Im just waiting for adsense payments to move on. Yes, there will be people wich will remplace us and use his servers, they offer good prices, but definitively this will cause a impact to them, and they will start, hopefully, to make something to his network and prefer to hold his current costumers before try to attract new ones.
Posted by strat, 05-22-2010, 12:37 AM
No one else having problems?? I cant access my server for the past 15+ hours I monitor my traffic using a live counter and i can see my traffic has drop by over 80%
Posted by Katatonic, 05-22-2010, 01:29 AM
We're back online - you better submit a ticket and see what's up.
Posted by yajur, 05-22-2010, 04:52 AM
network down
Posted by coolnikin, 05-22-2010, 04:55 AM
This is getting worse, was 1 downtime a day; but now it has turned into 2-3 downtime a day. Lasts anywhere between 2-5 minutes. edit: looks it back on now; total duration 7 minutes 16 seconds.
Posted by brc_csf, 05-22-2010, 05:34 AM
Has anyone opened a ticket to know if they have a coming solution?
Posted by coolnikin, 05-22-2010, 05:40 AM
bummer had replied on their forum : they wouldn't acknowledge the downtime when support ticket is opened, because by the time they reply; the network is again up
Posted by brc_csf, 05-22-2010, 06:03 AM
How much does 20GBPS cost? 1.5/MBiT? If there are no other ways to handle this, maybe it would be worth spending 20*1024*1.5=$30720/month to handle it. If they have 3000 clients that would be around $10/client to have stability back. Better than losing their clients and being know as a DC that keeps going up/down, have huge packet loss and huge downtime. Don't know if this is a real solution, just wondering.
Posted by coolnikin, 05-22-2010, 06:12 AM
capacity isn't the problem (i guess) , their network topology is anyway, if they add $10 and make it stable; i am more than willing to pay that much also dont forget, no ups/power generator? in a datacentre? someone from fdc needs to read http://en.wikipedia.org/wiki/Data_center
Posted by aeris, 05-22-2010, 07:12 AM
Considering a DDoS is incoming traffic, and most server hosts have oodles of spare incoming capacity, it's usually "free" bandwidth-wise. The problem is network gear croaking under the load. (As FDCServers have a standing offer for 300 TB incoming bandwidth for $39, it's fair to assume that they aren't somehow special in this regard.)
Posted by badboyx, 05-22-2010, 07:54 AM
i think they should buy something like ( riorey, cisco guard) to protect the network/costumers angst most kinds of ddos i suggest to cut a one time fee (50$) from each costumer and buy a good hardware firewall .
Posted by brc_csf, 05-22-2010, 09:08 AM
All of us have great suggestions. It would be great to hear what are they doing to correct this. I don't think DDOS is the only (or real problem). Would a DDOS attack take the POWER down ?
Posted by coolnikin, 05-22-2010, 09:41 AM
that has happened only once this month, i didnt 'notice' any power failures before
Posted by Henrik, 05-22-2010, 09:55 AM
So, the sporadic outages seen is DDOS attacks coming towards the Denver Datacenter FDC has? Where said DDOS attacks makes network equipment connecting Denver to Chicago go belly up, or is there further information regarding this? Thanks
Posted by ronaldmd, 05-22-2010, 11:59 AM
Today my server was offline for about 20 minutes, yesterday for about 30 minutes (total time). Im just waiting to the end of the month to move on, hopefully, if they found the agressor, his network get up and stable again, at least until someone else ddosed again. I dont think this is a ramdomly attack, neither a target website attack (political, or some website they are hosting), i think the attacks target are fdcservers.
Posted by Katatonic, 05-23-2010, 12:50 AM
The power issues were related to a PDU: http://fdcservers.net/vbulletin/showthread.php?t=4673 FDC say they are working on the DDoS issue: http://fdcservers.net/vbulletin/show...?t=4657&page=3 Edit: We're down again! Last edited by Katatonic; 05-23-2010 at 12:58 AM.
Posted by badboyx, 05-23-2010, 04:46 AM
we all might be under ddos in some day , null-routing the customer is not a solution as they can target another customer so the best thing IMO to face the problem is to buy a good hardware firewall who can handle 20+ Gbps of ddos
Posted by badboyx, 05-23-2010, 04:54 AM
take a look guys i think this is our last solution : http://www.riorey.com/rg-series/ it looks great
Posted by ronaldmd, 05-23-2010, 12:53 PM
Hardware firewalls do not warranty protection agains all the ddos attacks, becouse every ddos is diferent and have to be studied, compared and teatry. They can spend 50,000 box in a speciall firewall and get a solution to this problem, or just waste all the money in nothing really useful. I think the solution is call profesionals and understand the attacks, first to all. But I see 2 things here. FDCservers.Net is well know like a cheap hosting (nothing agains this, im not being derogatory), I think they do not have the budget to get any of this (profesionals - ddos protection) This is a direct attack agains FDCServers.Net, not any costumer or specific website (if not, this specific sites were out of they servers after the second attack), so they should call U.S. authorities. And yes, we were down again for about 10-15 minutes...
Posted by badboyx, 05-23-2010, 02:49 PM
i agree but its better than nothing
Posted by diegomfo, 05-24-2010, 10:57 AM
DDoS and connectivity drops have been ridiculous so far today.. they really need to find an effective solution to this... please suggest alternatives to FDC
Posted by peruviantalk, 05-24-2010, 07:13 PM
For the price + bandwidth. There is none.
Posted by brc_csf, 05-24-2010, 07:16 PM
www.100tb.com
Posted by DMEHosting, 05-24-2010, 07:26 PM
100tb.com is not an alternative. If you dare ask for the same specs at 100tb.com, you'll be paying 2-4x more with 100tb then you would be with fdc....
Posted by brc_csf, 05-24-2010, 07:33 PM
Quad Core Xeon 3220 8GB RAM 2x500GB HD 1GBIT dedicated port with 100TB bandwidth $200 I believe with FDC you'd get a Core2Duo for this price
Posted by ronaldmd, 05-24-2010, 07:58 PM
No exactly. You will get a better cpu, more RAM, and other very IMPORTANT stuff like a pretty more stable network. Your server will be more time online and the packet lost issue will be minimum, comparing with fdcservers. Also, remember, even if they fix all the ddos matter, fdcservers.net is well know like a company with a recurrent lost-packets matter. Also, even if 100TB offer managed features like a extra-charge cost, thats another plus. Is hard to admit, but the RAID features, free cpanel, unlimited port, and the one time fee, are the best on fdcservers, but if they dont offer this features in that cheap way, maybe they can offer a better service. Also, about raid options.
Posted by Katatonic, 05-25-2010, 03:19 AM
If you compare FDC to 100TB - when you have a budget of $200+ 100T.com is definitely better value for money.
Posted by ronaldmd, 05-25-2010, 11:31 AM
Again, today my server was down for about 10 minutes. This will not change or anything. I dont have any server yet in 100TB, but i will try them and i will make a review for you after the first month. I really tired of this continues offline times. I dont really care to pay more this time. Im losing visitors and money, and this is not getting solution. We haved wait for about 1 month and still nothing.
Posted by jjohnw, 05-25-2010, 12:10 PM
My server hasnt been down since the power outage, but the network has been soooo slow at times
Posted by BradQ, 05-25-2010, 07:47 PM
LOL. You think that the same company who doesn't have redundant routing equipment or UPS systems in either location will be buying 12 $300,000 units? It's not as if this problem is wanting for a number of effective solutions if you're willing to pay for it; you're paying the price for being in a bargain basement datacenter. If you want protection against DDoSes go with a reputable provider who will quickly nullroute any abusive traffic. Should they be directed at you, a provider that specializes in such protection that actually *will* carry this type of equipment.
Posted by badboyx, 05-26-2010, 02:36 PM
Down Again
Posted by diegomfo, 05-26-2010, 02:43 PM
About 6 times so far today. I don't think they will fix anything and I don't think this has anything to do with DDoS either.
Posted by badboyx, 05-26-2010, 03:13 PM
20 gbps of ddos is not really small + ddosing in the same way 24/7 will make a global communication problem i'm wondering how the police didn't catch them till now
Posted by DMEHosting, 05-26-2010, 03:21 PM
Anything larger than 1Gbps is considered pretty big and puts a large strain on network gear.
Posted by diegomfo, 05-26-2010, 03:23 PM
I wonder how many hosts attackers are using so they are not able to add them all into a blocking table...
Posted by BradQ, 05-26-2010, 03:54 PM
Any attacker throwing 1+ Gbit at you with a botnet will almost certainly be using thousands of hosts (of course this isn't true by necessity, but it's probably 98% of attacks I see in the wild). Implementing an ACL at the core router level will put an enormous strain on your gear's CPU, and will almost never be offered if the attacker list is substantial. This goes for any non-specialized provider, and as stated before FDC has close to 100Gbit of connectivity running through a single Cisco 6500. It's barely capable of handling typical load, so no, they won't be implementing an ACL for you.
Posted by ronaldmd, 05-26-2010, 04:06 PM
Yes, today we have been down for about 40 seconds - 3 minutes seven times or so. Dont think they will change anything in a near future. About the attacks, remember, this is not that simple, you can ban 10 or 20 ips in your common server and stop a ddos, but a real ddos cant be handled with a blocking table. Remember, a 20 gbps attack could be thousands of servers and pc around the world, using ip spoofing, or another tricks. Even if you block the ip's, they are still impacting the network. This is not something you can stop with a firewall or iptables, thats a solution for a normal ddos to a normal website, not to a hosting company wich can handled high ammounts of traffic.
Posted by PeakVPN-KH, 05-26-2010, 04:43 PM
Typically there are other ways of handling attacks that large. It should never take a DC offline more than a few minutes to implement a fix. It's kind of sad if they are spending this much time offline with any size of attack. It doesn't mean they have to mitigate it but a carrier null-route can be done in a few minutes. It may kill their site or whatever it's targeting but it's worthwhile if it's knocking their entire operation down. However, a 1Gbps attack on a large DC should cause no impact to the DC. If it is then that's some seriously poor planning on the part of the datacenter. This is with our without a mitigation solution.
Posted by diegomfo, 05-26-2010, 04:59 PM
There is obviously something NOT working on their side. Every day is getting worse and worse.
Posted by DMEHosting, 05-27-2010, 02:48 AM
Is anyone have 10-30 second outages about every 1-4 hours in Denver still?
Posted by Katatonic, 05-27-2010, 03:59 AM
Name of check: FDC-Den-LGCheck resolution: 1 minuteURL/IP: lg.denver.fdcservers.netCheck type: Ping Uptime 99.03% Downtime 2h 29m 12s The average downtime length is 5m 58s Number of downtimes 25 The longest downtime was 1h 25m on 05/18/2010 5:03:27AM and the shortest was 1m on 05/17/2010 9:49:27AM Started monitoring since 05/16/2010 till today. This is the actual looking glass and not client servers.
Posted by badboyx, 05-27-2010, 05:06 AM
i feel that we are not getting any benefit from posting here the problem is still exist since more than 1 month
Posted by diegomfo, 05-27-2010, 10:03 AM
No outages so far today (8 AM - Now). Will report again later.
Posted by ronaldmd, 05-27-2010, 11:34 AM
No, theres is a problem, 40 or 50 second of slowness time, many times per day. 40 or 50 lost packets in this slowness time. A server monitoring cant note this issue, is too fast, anyway, to annoying. Theres no point in post here, neither in talk with support. Just waiting 4 more days to move on.....
Posted by diegomfo, 05-27-2010, 01:52 PM
1:51 PM EST first outage of the day, 10 seconds, all clients disconnected and pissed
Posted by diegomfo, 05-27-2010, 02:57 PM
2:56 PM EST another outage.. we are moving...
Posted by ronaldmd, 05-27-2010, 05:38 PM
Yes, i have count 5 outages since 12:01 am. Im also preparing all my data to the move on.
Posted by HD-Sam, 05-28-2010, 07:40 AM
Anyone else notice power loss about an hour ago?
Posted by coolnikin, 05-28-2010, 07:44 AM
how are you monitoring ? i didnt notice any my server looks fine, try open a ticket at fdc
Posted by donbiz, 05-28-2010, 11:15 AM
My server there is showing 47 minutes downtime at around 5-6am EDT this morning. Not very happy with the downtime happening almost everyday now..
Posted by DMEHosting, 05-29-2010, 02:04 PM
Anyone else experiencing intermittent outages today?
Posted by badboyx, 05-29-2010, 02:18 PM
it's a daily routine @ Denver
Posted by ronaldmd, 05-29-2010, 02:49 PM
Maybe you are not getting affected, maybe you should check more detailed, this is a seconds issue. Today was a really better day to me, just 2 slowness times at the 3 am or so. I think about 8 minutes with both, nothing really important at that time, becouse was a 30 or 50% of packet lost. Again, today is my best day with fdcsever, so far. About the tickets, theres no point in open a new ticket, becouse when you open the ticket the things should be fine, if in that moment the problem is not happening, theres no issue to them. Wich is understandable. Also, is hard to make a tracerout becouse everytime that happens, is something about 50 seconds or 2 minutes, not more. Obviusly, your clients and your users note that issue. Also your bandwith monitoring. Hope fdcservers continue working fine like today, at lest for me has been a pretty well day.
Posted by SeedBit, 05-29-2010, 03:01 PM
I'm monitoring with Pingdom and 1 minute intervals and according to that my current uptime is 1d 17h 53m 56s but of course if it drops for a few seconds or whatever this won't pick it up.
Posted by ronaldmd, 05-29-2010, 03:24 PM
I am with wathmouse from my pc, a friend pc, and a couple of users pc around the world. Ping every minute, sometimes notes the problem, sometimes not. But a lot of client and users are complaning, also, i see in the fdcservers forum people talking about the same issue. Finally, today really has been a nice day. You can compare a pic bandwith. Yesterday vs. Today. And yes, you can actually push a lot of bandwith with Fdcservers. Just hoping they can fix all this network issues. Attached Images bwn1.jpg (37.4 KB, 35 views) bwn2.jpg (35.7 KB, 38 views)
Posted by DMEHosting, 05-29-2010, 05:31 PM
Yep, by the time you try to do a tracert the issue is over since it is quick 2-20 second outages. By the time the tracert is completed, there is no issue and they have nothing to go off of. I'm not sure how we can convince them they have a big problem.
Posted by Katatonic, 05-29-2010, 08:50 PM
Our stuff was actually rebooted. Definitely some serious issues at Denver. They closed their thread without a half decent response: http://fdcservers.net/vbulletin/show...?t=4657&page=3 The DDoS excuse is now long gone.
Posted by ronaldmd, 05-29-2010, 09:54 PM
In my last ticket, support told me something about a ISP issue, also told me that they need a tracerout to find the rout problem. But in fact, is hard to get a tracerout in this particular problem. Today I have viewed pretty better the network, my server is more responsive and I have recieve just a couple of user complains. Anyway, im still move on in a few days. Even if now the things are ok for me, is not easy to rely again in them. Hope they can keep a good service from now. For those who still have the same issue. Best Luck.
Posted by diegomfo, 06-01-2010, 09:43 AM
Definitely a better network since sunday.. no issues. However, traceroute is showing a different route is being used from my computer to my servers. Tinet (tiscali) was showing before when all the mess was still going but today is showing TATA. So hopefully they found the problem with their ISP.
Posted by Katatonic, 06-01-2010, 09:54 AM
Tata was recently added to Chicago and Denver. They already have redundant carriers, but regardless we all hope they resolve their issues.
Posted by diegomfo, 06-01-2010, 10:04 AM
I know but what I ment was that for some reason they are using/forcing TATA as carrier instead of Tinet, which would have been used normally on my path. Perhaps Tinet was causing all this mess. Just saying but who knows.
Posted by coolnikin, 06-01-2010, 10:07 AM
hmm i dont see tata yet, still going through Tinet
Posted by ronaldmd, 06-01-2010, 07:36 PM
I really see the things getting better. Today, again, my server havent any down time. Yet, in my tracert routs i dont see comcast anymore.
Posted by badboyx, 06-02-2010, 02:58 AM
the network now is super slow
Posted by DMEHosting, 06-02-2010, 04:13 AM
Do you want uptime, or super slow? lol
Posted by diegomfo, 06-02-2010, 12:03 PM
Definitely no outages since saturday.. if they are reading this: please DO NOT change anything
Posted by HD-Sam, 06-07-2010, 08:40 PM
Anyone else lose power on their servers just now?
Posted by brc_csf, 06-07-2010, 08:41 PM
We have 90% of our servers down. Power down?
Posted by Katatonic, 06-07-2010, 08:41 PM
Short answer: Yes.
Posted by HD-Sam, 06-07-2010, 08:46 PM
The following is the response I just received from FDC: So much for UPS, generators, and redundant power drops.
Posted by jjohnw, 06-07-2010, 08:46 PM
Looks like were down again. 100% packet loss from multiple locations
Posted by brc_csf, 06-07-2010, 08:48 PM
If there were at least batteries they would avoid a lot of downtime..
Posted by brc_csf, 06-07-2010, 08:59 PM
We are still down. Anyone already back?
Posted by Katatonic, 06-07-2010, 09:03 PM
I think they're trying to make clients bring in their own UPS, instead of getting everyone to pay for a centralized system (which would be better off).
Posted by strat, 06-07-2010, 09:27 PM
Anyone back or has my server died this time ?? Hope hdd ok.
Posted by brc_csf, 06-07-2010, 09:29 PM
We have everything down and no replies from support
Posted by jjohnw, 06-07-2010, 09:41 PM
FIRST PERSON BACK UP PLEASE POST HERE! Gonna be a long night. Down during PRIME TIME. Im pissed!
Posted by edesignway, 06-07-2010, 10:01 PM
All of my servers rebooted instantly. - up 1:31 Side Note: As much as this is a pain, keep in mind there are thousands of servers to check. Be nice to the techs!
Posted by brc_csf, 06-07-2010, 10:04 PM
So you are not having any downtime? Just had reboots? I am just waiting without any response from support.. Almost 2h down..
Posted by DMEHosting, 06-07-2010, 10:05 PM
Ah...figured it was related to power. Denver DC has been having issues with power since the beginning. With as much power issues they are having, i'm surprised the fire chief allows them to run the DC as is. I hope they can get everything back up and running like they normally do.
Posted by edesignway, 06-07-2010, 10:10 PM
Correct, it appears there was a power bump about an hour and 45 minutes ago. I had a remote session into one of my Windows boxes, lost connection and it came right back after the machine booted. I have been sitting on a couple symetra UPS units, time to take them down and racked.
Posted by Katatonic, 06-07-2010, 10:16 PM
We were only down for 1 minute or two. It seems like everyone was affected - but not in the same way. It's getting to the stage where they should've overhauled everything by now and patched up these issues. This thread is a clear indication of that.
Posted by jjohnw, 06-07-2010, 10:24 PM
Still down here.
Posted by brc_csf, 06-07-2010, 10:42 PM
Anyone getting responses from support?
Posted by renski, 06-07-2010, 10:45 PM
nah no response, down here aswell
Posted by jjohnw, 06-07-2010, 10:45 PM
Quick linux question. Do network services start up such that you can ping a machine BEFORE fsck file system check finishes??? Wondering if my box is actually just going through a loooong check of all 4 hard drives possibly.
Posted by vivalaf, 06-07-2010, 10:51 PM
yes is all down
Posted by brc_csf, 06-07-2010, 10:53 PM
Not sure. If you are using ext3 I believe it won't force fsck. ext3's Journal usually handle these outages really well.
Posted by renski, 06-07-2010, 10:54 PM
no networking will not have started..
Posted by brc_csf, 06-07-2010, 10:55 PM
I really with I had remote reboot ports and KVM ..
Posted by vivalaf, 06-07-2010, 10:58 PM
last response: Your server has been rebooted. Please wait 15-20 minutes for the server to come back up. Please reopen this ticket and provide login information for this server if it does not come back online. -- -- is more then 50 minutes and still all FCD DENVER down- down and down time to move. any one suggest a good D.C. Thanks.
Posted by HD-Sam, 06-07-2010, 11:02 PM
I'd highly recommend Steadfast in Chicago. You can't get better support from a DC. We will be shipping our FDC Denver servers to Steadfast's New York facility when they open next week.
Posted by brc_csf, 06-07-2010, 11:06 PM
Is there anyone that was down and is now back? I am worried that something "worst" could be happening..
Posted by vivalaf, 06-07-2010, 11:09 PM
maybe they not pay the bill.
Posted by strat, 06-07-2010, 11:10 PM
My server still not back.. have request a reboot and check on my server no reply yet. Last power outage my server rebooted on its own so hoping nothing bad happened this time.
Posted by BigBoiJefe, 06-07-2010, 11:10 PM
I got a response from the tech an hour ago, saying they rebooted my server. Attached Images Untitled.jpg (133.3 KB, 24 views)
Posted by jjohnw, 06-07-2010, 11:12 PM
I looked it up. Networking starts VERY early, far earlier than any fsck will occur.
Posted by BigBoiJefe, 06-07-2010, 11:14 PM
To be completely honest, I am personally fed up with FDCServers. Last month their network was down two times. They have consistent network issues, and now this. I've already purchased my third server from BananaBit (www.bbtn.us), and will be glad once I can rid myself of FDC.
Posted by vivalaf, 06-07-2010, 11:18 PM
ok good for you.
Posted by jjohnw, 06-07-2010, 11:19 PM
Not impressed by their dedicated server offerings at all. Much much better out there.
Posted by jjohnw, 06-07-2010, 11:20 PM
Lucky you.... my ticket hasnt even been assigned yet. Things ARE BAD in the data center right now. Got a feeling I wont be back up until TOMORROW. Im done with FDC
Posted by brc_csf, 06-07-2010, 11:23 PM
How long has your ticket been opened?
Posted by vivalaf, 06-07-2010, 11:23 PM
is the game done? maybe they are waching the game.
Posted by BigBoiJefe, 06-07-2010, 11:24 PM
Since 6:07PM PST
Posted by BigBoiJefe, 06-07-2010, 11:25 PM
Hopefully they aren't. That would be ridiculous.
Posted by brc_csf, 06-07-2010, 11:32 PM
They said ours were rebooted (20 minutes ago). We just have 2 online (which did not go down, were just auto-rebooted when the power went down). 20 servers down Has anyone that was rebooted and did not come back with a solution?
Posted by vivalaf, 06-07-2010, 11:33 PM
maybe if you look on this you will resolve your problems rapidswitch.com
Posted by brc_csf, 06-07-2010, 11:44 PM
Don't you know any tech near Denver that could go there ? If you know someone please pvt me. We are worried about what is going on and would be happy to pay to have it fixed.
Posted by BigBoiJefe, 06-07-2010, 11:47 PM
Ill pitch in as well.
Posted by RyanD, 06-07-2010, 11:48 PM
perhaps you should offer to pay FDC? I doubt they would let someone come in off the street to touch their dedicateds. As others have said, if you are that unhappy, look elsewhere. There are plenty of other providers with better reliability with comparable pricing.
Posted by brc_csf, 06-07-2010, 11:50 PM
We have colo there (they 'manage' it). I've offered to pay before but they don't work this way. If you know someone, please let me know
Posted by jjohnw, 06-07-2010, 11:58 PM
Down 3 hours how and counting. Gonna be a long night. So angry. Why tonight of all nights.
Posted by BigBoiJefe, 06-08-2010, 12:14 AM
Same here. Three hours, and zero updates.
Posted by renski, 06-08-2010, 12:15 AM
If I was running premium services at fdc I would have got out a long time ago.. so for you guys to still be hosting your servers there was a bad move.
Posted by DMEHosting, 06-08-2010, 12:38 AM
I'm quite worried about this since there has been no communication. Does this mean this will go on until the morning? They are going to need some power specialists to come in and evaluate everything, which I don't think is possible at this time of the night.
Posted by brc_csf, 06-08-2010, 12:42 AM
I haven't got any updates. Anyone?
Posted by BigBoiJefe, 06-08-2010, 12:45 AM
I havent heard anything yet either.
Posted by DMEHosting, 06-08-2010, 12:48 AM
They aren't responding to any inquiring's...makes you wonder what is happening. Anyone know if they called in power specialists?
Posted by brc_csf, 06-08-2010, 12:49 AM
What if we open a thread on their forum? Maybe they monitor it an can give us updates.
Posted by BigBoiJefe, 06-08-2010, 12:55 AM
This is Peter's number, it's their sales number but the message is from Peter's voice: 312-423-6675
Posted by BigBoiJefe, 06-08-2010, 12:57 AM
I just opened an IRC channel, come join irc://irc.freenode.net/fdcservers
Posted by BigBoiJefe, 06-08-2010, 01:00 AM
I just replied to my ticket, saying: "Are you guys really not responding to anyone? There is an active thread on WHT, you may want to respond to it. http://www.webhostingtalk.com/showthread.php?t=940072&page=23" Hopefully we'll get some information...
Posted by coolnikin, 06-08-2010, 01:04 AM
my machine was down for 2min approx (yes power failure), atleast as per my monitoring and server looks fine
Posted by brc_csf, 06-08-2010, 01:08 AM
Hm. so your was just "rebooted" by the power outage. I mean, someone that has been "really down" (more than 10 minutes) and helpdesk reboot would get back. From what I've read reboots did not work.
Posted by strat, 06-08-2010, 01:11 AM
just got a reply that my server was rebooted and im finally online after 4hours
Posted by DMEHosting, 06-08-2010, 01:16 AM
With sudden power outages as this, don't be surprised if you have corrupted databases or if your some piece of hardware on your server got ruined....
Posted by brc_csf, 06-08-2010, 01:22 AM
Was this the first reboot after your request? Or did they reboot it before and it did not come online?
Posted by strat, 06-08-2010, 01:26 AM
My first.. did you reply to the ticket with what they normally request if the server does not come back with in 15 - 20min??
Posted by BigBoiJefe, 06-08-2010, 01:26 AM
I got this response: We are sorry for inconveniences. If your server is not online please reopen this ticket and provide login information. And I've responded with the login information. Hopefully there is some hope in sight.
Posted by renski, 06-08-2010, 01:34 AM
backup here
Posted by BigBoiJefe, 06-08-2010, 01:43 AM
I hate you lol.
Posted by BigBoiJefe, 06-08-2010, 01:58 AM
back up here as well.
Posted by CryptWizard, 06-08-2010, 02:16 AM
There seems to be a problem with some of my IPs losing ARP, and therefore becoming unusable. I fixed it by pinging the gateway from the problem IP, but I'm not sure if this is the same issue being experienced by you guys.
Posted by brc_csf, 06-08-2010, 02:40 AM
Still down here.. Waiting for an update
Posted by coolnikin, 06-08-2010, 02:45 AM
i have another server from a reseller, which isnt up yet; they replied
Posted by brc_csf, 06-08-2010, 02:50 AM
Was this response sent from your reseller or from FDC?
Posted by Katatonic, 06-08-2010, 02:50 AM
Back up but the network is terrible.
Posted by brc_csf, 06-08-2010, 02:54 AM
All our servers are on the same VLAN (same switch). Could it be netork related?
Posted by jjohnw, 06-08-2010, 02:55 AM
Still down.... ticket with credentials sitting in queue for 30 mins so far no update
Posted by Katatonic, 06-08-2010, 02:59 AM
They cleared out the outages sub-forum: http://fdcservers.net/vbulletin/forumdisplay.php?f=48
Posted by coolnikin, 06-08-2010, 03:01 AM
from reseller
Posted by coolnikin, 06-08-2010, 03:05 AM
ah now my other servers are not responding , seems like a network problem again ! edit: its back up
Posted by DMEHosting, 06-08-2010, 03:10 AM
Some of our servers are still offline. Over 6 hours now...
Posted by CryptWizard, 06-08-2010, 03:24 AM
Could be their switch's ARP table not big enough. I'm now running this script on hourly cron to keep the switch's ARP record fresh: YMMV
Posted by jjohnw, 06-08-2010, 04:14 AM
Finally - back up Pleeeaaaaaaase stay up long enough for me to migrate to my new provider
Posted by Hannan, 06-08-2010, 04:21 AM
Still down
Posted by DMEHosting, 06-08-2010, 05:15 AM
Some of our servers are still down because they wont read the ticket and keep giving auto message replies saying everything is fine and to reopen if we are still having issues. Reopened it about 10 times, and have created 5 tickets. They are giving us the same reply and wont read a single ticket. We are pushing 8-10 hours of downtime now because of the self-proclaimed illiteracy of some of the technicians.
Posted by Hannan, 06-08-2010, 06:45 AM
Yes, same issue here
Posted by ezilagel, 06-08-2010, 07:01 AM
www . denverpost . com / ci_15248225
Posted by StevenG, 06-08-2010, 07:09 AM
That news article puts things in perspective, I know having servers down isn't nice, but nicer than being blown to pieces. And for those extending this thread, just recover and get servers in a DC with UPS next time.. move on and pay more if it's that important. Otherwise, just put up with it.. quietly..
Posted by jjohnw, 06-08-2010, 08:10 AM
You dont even need to pay more to get a DC with UPS.
Posted by Hannan, 06-08-2010, 08:16 AM
Finally backup after 12hours downtime Do you know any? Thank you,
Posted by jjohnw, 06-08-2010, 08:18 AM
Are we allowed to post dedicated server providers recommendations? I know who im looking at next.
Posted by WII-Aaron, 06-08-2010, 12:58 PM
It's probably a better idea to keep the thread on the topic of the outage. If people want recommendations on other providers they can open a thread in the dedicated servers section asking for them.
Posted by edesignway, 06-08-2010, 02:04 PM
So I just assumed all of me servers rebooted yesterday... They did not. I'd say it was 50/50. In one of my racks, servers plugged into the same PDU, 4 stayed powered on and 2 powered off. On another PDU all rebooted. On a third PDU, it was only a couple. Weird. It must have been a really quick power bump / brown out and the servers with the most sensitive power supply rebooted.
Posted by DMEHosting, 06-08-2010, 03:59 PM
The outage ruined 2 of our servers... They were probably rebooting these two servers into oblivion when they were most likely doing FSCK's.
Posted by jjohnw, 06-08-2010, 04:44 PM
THAT is my worst nightmare! I have full backups, but a full recovery could take weeks just to transfer all the files to a new server
Posted by DMEHosting, 06-08-2010, 06:48 PM
The data is fine, but we can't simply move 500-700GB (not sure how much) data to a different DC at 100Mbps. It would take a long time, especially since the internet throttle 100Mbps down with all the hops.
Posted by CryptWizard, 06-09-2010, 03:39 AM
700 GB is quite do-able in a day. It would take about 16 hours at 10 MiB/s, a speed which I have quite easily achieved on many occasions within North America. (Guess I was one of the lucky ones whose server (and all the stuff down the line that provides network connectivity) didn't lose power)
Posted by DMEHosting, 06-09-2010, 04:20 AM
The problem is that if we move those 2 servers, then we have to move all the others since they are used together. Talking several TB of data now.
Posted by FastServ, 06-09-2010, 07:34 AM
It's possible to move the data at 100Mbps (or whatever your max port speed is) with multi-threaded transfer and some tweaking to sysctl. Yes, even across a bad network with packet loss. If you need help with this let me know.
Posted by ronaldmd, 06-09-2010, 09:19 AM
Wow, I just move on two days ago. Im almost in this nightmare again. And just when I was thinking on get another server with them for a small websites. Never mind, I though that they already fix all they network and power problems, becouse the things were really stable the last two weeks. I guess is too soon, Ill better wait until everything gets really stable.
Posted by edesignway, 06-09-2010, 12:30 PM
Denver down again... not even getting a response from Denver LG.
Posted by diegomfo, 06-09-2010, 12:36 PM
Down again.. it would be great if FDC decides not only to invest in getting more bandwidth but also in getting quality hardware. Redundant connectivity is something they don't have making their tons of bandwidth totally useless. We are moving and they don't deserve to be in business anymore.
Posted by edesignway, 06-09-2010, 12:42 PM
Based on what I am seeing with the pings, core router issue? Its like something keeps on rebooting. Last edited by edesignway; 06-09-2010 at 12:46 PM.
Posted by nobody24, 06-09-2010, 12:59 PM
I ordered ticket "Denver - Сhicago"
Posted by BELLonline, 06-09-2010, 01:02 PM
They do need to address the issues they're having with reliability. I was always very forgiving in the past as FDC were always cheap, but now that other providers are competing with them on price with superior uptime they need to up their game.
Posted by nobody24, 06-09-2010, 01:06 PM
URLs please
Posted by HD-Sam, 06-09-2010, 01:12 PM
Our servers at FDC Denver are down again
Posted by edesignway, 06-09-2010, 01:12 PM
However there is nowhere within 100 miles of Denver that competes on the price. (Just because there isn't much within a 100 miles isn't an excuse). If a provider could offer me something of interest, I would move my equipment in a heart beat!
Posted by BELLonline, 06-09-2010, 01:16 PM
uk2, poundhost, rapidswitch, 100tb, directspace, pooled - they all offer at least 10TB of transfer per month for similar prices to FDC.
Posted by BELLonline, 06-09-2010, 01:17 PM
Looks like we're back on now EDIT: was online for a minute anyway! Last edited by BELLonline; 06-09-2010 at 01:21 PM.
Posted by edesignway, 06-09-2010, 01:20 PM
Its been up and down for 20 minutes... its back down.
Posted by HD-Sam, 06-09-2010, 01:21 PM
and we're back [edit] said that too soon [/edit]
Posted by brc_csf, 06-09-2010, 01:25 PM
Anyone updates?
Posted by BELLonline, 06-09-2010, 01:28 PM
No, I opened a ticket about 40 mins ago and have had no replies yet. Maybe they can't get onto the helpdesk at the datacentre.
Posted by XFactorServers, 06-09-2010, 01:33 PM
Why do you guys even have servers still located at FDC when you are having issues every single day ?
Posted by donbiz, 06-09-2010, 01:34 PM
My server there is up and down still. Getting very tired of this, probably going to be moving it out of there soon.
Posted by BELLonline, 06-09-2010, 01:39 PM
I don't use them for anything that needs 100% uptime, but to be fair they don't have downtime every day - more like a couple of times a month (uptime averages about 99.8% to 99.9%).
Posted by edesignway, 06-09-2010, 01:44 PM
Well, for the past couple months it has been a lot higher! Last edited by edesignway; 06-09-2010 at 01:50 PM.
Posted by edesignway, 06-09-2010, 01:45 PM
On my budget, its the only thing within driving distance.
Posted by diegomfo, 06-09-2010, 01:49 PM
There is definitely a major hardware issue. It was back up for a minute and now packet loss is back.
Posted by vivalaf, 06-09-2010, 01:54 PM
We are moving today from this dumb server FDC Denver.
Posted by Hannan, 06-09-2010, 01:54 PM
ruining our business!! down again
Posted by jjohnw, 06-09-2010, 02:02 PM
Well..... just because I havent had time to move. Moving is PAINFUL. Moved this task higher on my TODO list. I dont need 99.99% uptime either... but I cant risk having my hard drives blown out by power blips due to a lack of a UPS.
Posted by vivalaf, 06-09-2010, 02:05 PM
FDC Denver down again. and now isssss upppppp and nowwwww is dowwwwwwwwwnnn up and down up and down make me dizzy
Posted by diegomfo, 06-09-2010, 02:10 PM
Exactly. I used to love them.. now I hate them with a passion
Posted by brc_csf, 06-09-2010, 02:24 PM
Everyone still down or just me?
Posted by diegomfo, 06-09-2010, 02:28 PM
Down again
Posted by vivalaf, 06-09-2010, 02:29 PM
Yes all is down again
Posted by suhailc, 06-09-2010, 02:33 PM
Are all your servers down or is it actually rubbish connectivity?
Posted by suhailc, 06-09-2010, 02:38 PM
Spoke too soon!
Posted by diegomfo, 06-09-2010, 02:40 PM
UP again now.. we'll see if two hours of troubleshooting are enough for the next 24 hours.
Posted by jjohnw, 06-09-2010, 03:05 PM
In this graph you can see the recent 7 hours of downtime because of power issues. You can also see that today, its difficult getting through, although the server is up. Attached Images traffic.png (33.4 KB, 50 views)
Posted by Hannan, 06-09-2010, 05:57 PM
Anyone know what was the issue?
Posted by edesignway, 06-09-2010, 06:15 PM
Unofficially I belive it was something called "Cluster F*ck"
Posted by XFactorServers, 06-10-2010, 09:17 AM
FDC has said nothing about this ?
Posted by aeris, 06-10-2010, 09:27 AM
It should be fairly obvious by now that FDCServers never says nothing about anything, outside of blaming any and all failures no matter how extensive on a "DDoS attack". And if you ask, you will be the first one to have reported it, and they will deny that there are any problems or that they ever have any problems at all. "Uhm yeah, the DDoS was so severe it flooded out of the network port and shorted the power. Be assured that we're taking all possible precautions to avoid this happening again. From now on there will be buckets placed under every network port."
Posted by Katatonic, 06-10-2010, 10:01 AM
No - FDC even cleared out the message boards as pointed out before. There is nothing positive to be said; so it's not being said by them.
Posted by edesignway, 06-10-2010, 12:40 PM
They are having up and down issues again...
Posted by HD-Sam, 06-10-2010, 12:42 PM
Down again
Posted by renski, 06-10-2010, 12:47 PM
heh yep they do that regularly, they don't like any negativity/truth on the forum.
Posted by brc_csf, 06-10-2010, 12:58 PM
Down again
Posted by fdc-downalways, 06-10-2010, 01:08 PM
Chicago datacenter is down as well ? my denver servers are all down
Posted by diegomfo, 06-10-2010, 01:08 PM
Down again during peak hours on our site.. going to uk2 net
Posted by fdc-downalways, 06-10-2010, 01:13 PM
Is chicago datacenter better than denver ?
Posted by elmdavid, 06-10-2010, 01:18 PM
We are currently working on repairing a network issue. Please be patient, we are working to repair this as quickly as we can.
Posted by yajur, 06-10-2010, 01:20 PM
down too bad on there part
Posted by elmdavid, 06-10-2010, 01:22 PM
One of my server was alived...
Posted by vivalaf, 06-10-2010, 01:32 PM
FDC Denver stay away forever i will no pay $ 1.00
Posted by fdc-downalways, 06-10-2010, 01:37 PM
fdc denver sucks =/
Posted by elmdavid, 06-10-2010, 01:45 PM
They said that its massive DDoS-attack
Posted by vivalaf, 06-10-2010, 01:52 PM
Yaya believe them they are full Of S......t
Posted by elmdavid, 06-10-2010, 02:01 PM
****... both servers is down again (((
Posted by jjohnw, 06-10-2010, 02:02 PM
80-100% packet loss, 6 second pings. Server is up... but network is basically down. GRRRR.... Last edited by jjohnw; 06-10-2010 at 02:07 PM.
Posted by diegomfo, 06-10-2010, 02:11 PM
so they are totally helpless.. all they do is reboot their stuff.. probably enter a new rule and then reboot and hope for the best.. until the next DDoS comes in (supposedly). That's all they have apparently.
Posted by vivalaf, 06-10-2010, 02:13 PM
Maybe they are using wrong tape to hold the power switch
Posted by DMEHosting, 06-10-2010, 02:23 PM
Whoever is sending the DDoS attacks must have 100% confidence that they can do whatever they want to FDCServers Denver.
Posted by vivalaf, 06-10-2010, 02:48 PM
How long does it takes to drive from Chicago to Denver?
Posted by badboyx, 06-10-2010, 03:19 PM
it's been up and down many times in the past 2 hours now. i think they should start investing some money into good protection before going out of business (i don't think they'll keep a lot of customers after this amount of downtimes).
Posted by vivalaf, 06-10-2010, 03:24 PM
What are you whait for to move?
Posted by spdfox, 06-10-2010, 03:43 PM
go, go, go to another DC
Posted by edesignway, 06-10-2010, 04:08 PM
It takes about 15 hours from Denver to Chicago land. Its not the best drive because most of it is through Nebraska...
Posted by vivalaf, 06-10-2010, 04:15 PM
Thanks because I just spoke with Chicago and they are driving there to bring the parts to fix the issues is that ridiculas?
Posted by brc_csf, 06-10-2010, 04:40 PM
Better than not having parts. But.. Why didn't they do this before?
Posted by vivalaf, 06-10-2010, 04:50 PM
Because they found out they dint have any instock in denver so they call chicago to brink some gasoline to burn the dc
Posted by edesignway, 06-10-2010, 05:05 PM
A 15 hour drive is most likely quicker and cheaper than shipping.
Posted by vivalaf, 06-10-2010, 05:10 PM
Fedex they not ship gasoline
Posted by yajur, 06-10-2010, 05:13 PM
lol they will do it soon
Posted by BELLonline, 06-10-2010, 05:57 PM
Time to get my Denver server transferred over to Chicago I think
Posted by vivalaf, 06-10-2010, 10:13 PM
As Soon as they are back from Denver they will go to burn Chicago dc with Denver Gasoline
Posted by edesignway, 06-10-2010, 10:18 PM
Makes sense to burn Chicago with Denver gas... Its cheaper in Denver by $.20 a gallon.
Posted by Amphibulus, 06-10-2010, 10:59 PM
They just have to take some BP oil on the beach to burn down Denver and take the insurance check. BP start to looks like a really good company compared to FDC. FDC with oil we will be all dead at this time...
Posted by vivalaf, 06-11-2010, 10:04 AM
The team from Chicago just arrived in Denver. They are havin breakfast, as soon as they are done they will star. To burn dc. Scheduled around lunch time.
Posted by diegomfo, 06-11-2010, 10:09 AM
Would they finish by 3 PM? That's when all the DDoS madness starts. The DDoS dudes are really well organized and have discipline apparently, they always "attack" on a certain time range. Funny.
Posted by brc_csf, 06-11-2010, 10:20 AM
Are they still driving the parts? If so, this means we are having huge downtime today, again, right?
Posted by diegomfo, 06-11-2010, 11:51 AM
I think the only thing changing is their coffee machine. They were having these issues for more than three weeks already and now they are making a big change? Nuh.
Posted by yajur, 06-11-2010, 01:55 PM
that they started to burn there DC ? still no update on this lol
Posted by Amphibulus, 06-11-2010, 01:58 PM
@diegomfo You are right, it's when they plugged their new coffee machine that the electric problem happened. It take too much power for their crappy datacenter
Posted by Naki, 06-12-2010, 06:28 AM
They have network problem very often lately. I've cancelled all my servers with them. Too bad I just ordered 2 server the last two monthly with so I lost the one time setup fee of $149 for the 1.5TB HD. I've never this kind of network problem with another hosting before. Also, the link speed of my unmetered server is always switched to 10mbps. If you have 100 unmetered with them you should check the link speed.
Posted by BELLonline, 06-12-2010, 08:50 AM
If your server is capped at 10Mbit, then just open a ticket with them and they will sort it out. I had that happen with a server I got with them recently, it took a couple of tickets but they fixed it in the end.
Posted by RReyesJR, 06-12-2010, 08:54 AM
This just in.... Anyone have a Snickers?
Posted by syang3, 06-12-2010, 12:34 PM
My two servers at Denver are so bad they can't push over 5mbps still. It's been over 48 hours now. I just requested them to be moved to different segment of the DC to see if that improve things a bit.
Posted by JonL, 06-12-2010, 07:26 PM
Is Denver down again or is it just me?
Posted by HD-Sam, 06-12-2010, 07:40 PM
I think we can rule out the "just me" 99% of the time with FDC. It's defintely down again
Posted by brc_csf, 06-12-2010, 08:10 PM
Everything down again!!
Posted by brc_csf, 06-12-2010, 08:48 PM
Almost one hour down.. How many hours this month? Or this week? This is really sad.
Posted by jackpx, 06-12-2010, 09:14 PM
Because you continue in FDC if you know the problems that they have currently?? Looking for another alternative!!!!
Posted by -OY-, 06-12-2010, 09:31 PM
A server from FDCServers Denver, http://www.pingdom.com/reports/vo5c5...yncbackup.info Luckily it's just a nameserver...
Posted by chrisdanford, 06-12-2010, 09:32 PM
This week was the last straw for me. What bugs me even more than the downtime is there's no communication about status, no warnings for planned downtime, they wipe their own forums frequently, and the needless reboots (1/mo. on average - I assume due to power because both of my servers there in Denver reboot at the same time). Does anybody have co-lo host recommendations? Burst.net seems to be popular, but the pricing is significantly higher than FDC. EDIT: Hivelocity.net seems to be a reasonably priced alternative and has people posting on these boards. Last edited by chrisdanford; 06-12-2010 at 09:39 PM.
Posted by brc_csf, 06-12-2010, 10:41 PM
Down again....
Posted by BandungHosting, 06-12-2010, 10:41 PM
up down up down... the best downtime datacenter of the year
Posted by -OY-, 06-12-2010, 10:50 PM
Yep, down again. It's driving me crazy with the amount of SMS notifications I get in the night - should turn it off for now.
Posted by Jacob Wall, 06-12-2010, 10:56 PM
Have they ever said why they are having issues in Denver?
Posted by brc_csf, 06-12-2010, 11:02 PM
Based on support response they are receiving new router on the end of the week. So we can expect the same network behavior the next days .. That's what I understood.
Posted by yajur, 06-13-2010, 04:33 AM
now few of there server is down for more than 3hrs
Posted by jjohnw, 06-13-2010, 07:59 AM
Dont care anymore... now that I know they dont have a UPS, I just cant risk having a hard drive blown out from power failures. Putting my cancel order in this week.
Posted by ronaldmd, 06-13-2010, 10:23 AM
I dont know why do you wait to long to leave them.....
Posted by techjr, 06-13-2010, 07:55 PM
I thought they added them awhile ago? Shouldn't they have spares in case something like this happens?
Posted by msmp3, 06-13-2010, 07:58 PM
Please post about this issue of DENVER in here: http://www.webhostingtalk.com/showthread.php?p=6847013 - here you can post your problems about FDC.
Posted by msmp3, 06-13-2010, 08:04 PM
I have posted details, screenshots with the ignorant support of FDC - you are all welcome to post in my thread. I encounter the same problems as you.
Posted by DMEHosting, 06-13-2010, 11:33 PM
That's what I was wondering about. All hardware fails eventually, what happens when this router goes out?
Posted by lifetalk, 06-14-2010, 06:08 AM
I was with them about 3 months back. Had 2 servers in Denver. And, throughout the time I was with them (about 2 months) I had nothing but network issues all the time. Packet drops, DDOS attacks, random outages - it's something quite common on their network. And they don't have an SLA, so they won't compensate you for these issues. My advice would be to move out of their network ASAP if your site is uptime dependent. Move to a more professional network.
Posted by HBK216, 06-14-2010, 09:59 AM
At this point, why anyone would sign up with this company is beyond me. Too many people run into the same exact issues so it can't be the users that are the problems. This company is beyond pathetic & no one with any sort of need for a server whether mission critical or not should host there.
Posted by diegomfo, 06-14-2010, 11:57 AM
Something wierd is going on right now at FDC. Our servers located in other DCs / Hosting providers are not able to reach our servers in FDC. Are they blocking them out? Are they trying to stop DDoS by blocking servers located in other DCs? Wow
Posted by edesignway, 06-14-2010, 03:07 PM
Email I received earlier... Network maintenance - Denver - 6/18/2010 maintenance window - 9PM through 3AM CST We will be performing a network maintenance to address the issues experienced last week. The maintenance will consist of - replacing a router with defective backplane - adding new core router - upgrading uplinks on our distribution switches from GigE to 10GE - adding new aggregate switches - changes to the internal network topology We do not expect any extended network downtime however there may be intermittent connectivity drops while we move some of the uplinks Thank you FDCServers
Posted by lordgoth, 06-15-2010, 09:14 PM
My vps with them seem down today. But today still just 16/06. Another random outages ?
Posted by renski, 06-19-2010, 03:41 AM
down here.............
Posted by brc_csf, 06-19-2010, 03:51 AM
Everything down here too. Would this be a power outage or network ?
Posted by syang3, 06-19-2010, 03:55 AM
I believe they are upgrading their Denver network at the moment per their announcement.
Posted by NQhost, 06-19-2010, 03:56 AM
Yes, they sent an email, today they upgrading the network and some downtimes are expected.
Posted by sharecloud, 06-19-2010, 12:00 PM
support@crm.fdcservers.net Sent To me 23:32 (24 min ago) I do not believe we still have the San Jose link online anymore. They have move the SanJose pop out off there BGP Bad connection to Asia now!!
Posted by yajur, 06-19-2010, 01:42 PM
any improvement after this upgrade?
Posted by vivalaf, 06-19-2010, 02:10 PM
Nop very slow
Posted by edesignway, 06-19-2010, 02:18 PM
And down at the moment
Posted by edesignway, 06-19-2010, 02:24 PM
When things are up.... I have seen a 20ms increase since the "upgrade" took place. I am also seeing crazy traceroutes, the route used to be different, the comcast routes seem to be new after the upgrade, so that looks like it could be a bonus... but the route it takes after hop 9 just doesn't make sense. Tracing route to 76.73.xx.xx over a maximum of 30 hops: 1 * * * Request timed out. 2 * * * Request timed out. 3 14 ms 10 ms 12 ms chywy002dr5-GE-3-0-8-U0.int.bresnan.net [72.175.110.193] 4 16 ms 12 ms 12 ms chywy001cr5-XE-5-2-0-U0.int.bresnan.net [72.175.110.130] 5 14 ms 14 ms 14 ms dencofh1tr5-XE-5-3-0-U0.int.bresnan.net [72.175.110.229] 6 87 ms * 78 ms te-9-3.car1.Denver1.Level3.net [4.53.10.97] 7 84 ms 81 ms 79 ms ae-22-54.car2.Denver1.Level3.net [4.68.107.03] 8 83 ms 80 ms 83 ms COMCAST-IP.car2.Denver1.Level3.net [4.79.82.54] 9 234 ms 215 ms 217 ms comcast01.den.fdcservers.net [75.149.229.10] 10 * * * Request timed out. 11 42 ms 79 ms 111 ms cr1.st6wa.ip.att.net [12.123.46.6] 12 113 ms 111 ms 133 ms cr2.sffca.ip.att.net [12.122.31.194] 13 113 ms 119 ms 114 ms cr2.la2ca.ip.att.net [12.122.31.133] 14 113 ms 115 ms 117 ms ggr6.la2ca.ip.att.net [12.122.129.33] 15 112 ms 120 ms 124 ms 192.205.35.130 16 114 ms 110 ms 118 ms if-1-0-0-1978.mcore5.LAA-LosAngeles.as6453.net [216.6.12.46] 17 123 ms 123 ms 123 ms if-15-0-0-933.mcore3.PDI-PaloAlto.as6453.net [216.6.29.85] 18 150 ms 170 ms 153 ms if-0-0-0.core1.DDV-Denver.as6453.net [216.6.29.2 6] 19 * * 152 ms ix-3-1-0.core1.DDV-Denver.as6453.net [209.58.57.34] 20 174 ms 153 ms 150 ms 76.73.xx.xx Trace complete. Last edited by edesignway; 06-19-2010 at 02:33 PM.
Posted by DMEHosting, 06-19-2010, 03:58 PM
All of our servers keep going on/off....
Posted by Katatonic, 06-19-2010, 08:43 PM
First we need to confirm what they've actually "upgraded". They say simply a "switch" was replaced, there is obviously more to it than that.
Posted by Hannan, 06-19-2010, 10:02 PM
Is it really upgraded? We have many complaints about speed after upgrade? Seems it was a better network before upgrade.
Posted by yajur, 06-20-2010, 01:39 AM
they told there upgrade has been finished http://fdcservers.net/vbulletin/show...3&postcount=27 but still iam getting low speed to softlayer dc and all
Posted by DMEHosting, 06-20-2010, 04:04 PM
All of our servers are offline right now.... I would say it my may just be our servers, but I doubt that is the case.
Posted by vivalaf, 06-20-2010, 05:58 PM
How this people from FDC can sleep?In a day is 50%up and 50% down , ripoff people money I hope some one blow them up. Incompetant people maybe is a bunch kids running FDC Server
Posted by TheChemist, 06-20-2010, 07:42 PM
I have sites with DMEHosting.com and they aren't offline. If all the servers were offline then how are my sites, control panel, e-mail, and everything still accessible.
Posted by SeedBit, 06-20-2010, 07:55 PM
They have servers in multiple datacentres . I recently got my Denver VPS with them moved to another location. Glad I did now.
Posted by diegomfo, 06-23-2010, 10:59 AM
Everything was great until this morning. Network issues again. That was it for us. We had it.
Posted by edesignway, 06-23-2010, 11:02 AM
What network issues? My MRTG graphs all show okay.
Posted by diegomfo, 06-23-2010, 11:10 AM
It lasted for a few minutes. Packet drops. Everything back to normal at this time though.
Posted by brc_csf, 07-05-2010, 08:55 AM
That also happened with us. They gave 5 of our blocks to another client, claiming they were not being used. We noticed it at the exact moment the other customer starting using them (we had ALL ips on production for 6+ months) and asked them to get it back.. Unfortunately the answer was "it is not possible but we can allocate new blocks for you in 24h". This is so absurd that I won't comment. If you want to avoid problems and are still with them, contact FDC and ask them to confirm which blocks are actually linked to your account.
Posted by Katatonic, 07-13-2010, 12:53 AM
Our nodes have been going down daily. This is ridiculous, definitely time to move no.
Posted by BradQ, 07-13-2010, 01:07 AM
I somewhat doubt it, but if that's actually the case, you should start another thread. Every incident they've had has been well complained about and documented; they're not without customers here and no one's posted to note a problem in close to a month. Whatever ongoing issues there are very likely localized to you. I'm as amused as anyone by a 34-page outage thread spanning 3 months of legitimate constant problems, but it's time to put this to death.
Posted by BELLonline, 07-13-2010, 07:44 AM
We're not having problems with servers going down lately, they've been a lot better recently apart from a short outage for a minute or two yesterday on most servers.
Posted by Hannan, 08-02-2010, 07:37 PM
My servers was down, any one had any downtime?
Posted by BandungHosting, 08-02-2010, 07:43 PM
down since 2 hours ago...
Posted by Hannan, 08-02-2010, 07:44 PM
One of our rack been down for 15minutes but another one is still down!
Posted by Katatonic, 08-02-2010, 08:29 PM
As you can see by the entire thread, this obviously isn't just me. Yes we were down again yesterday - but okay today.