Dnow Having Network Outage 4:20PM EST 3/10/2006 [Threads Merged]

Portal Home > Knowledgebase > Articles Database > Dnow Having Network Outage 4:20PM EST 3/10/2006 [Threads Merged]

Posted by WCSWEB, 03-05-2006, 01:56 PM
hey guys is anybody else having packetloss from dedicatednow? Pinging dedicatednow.com [69.72.253.198] with 32 bytes of data: Reply from 69.72.253.198: bytes=32 time=10ms TTL=54 Request timed out. Reply from 69.72.253.198: bytes=32 time=10ms TTL=54 Request timed out. Request timed out. Ping statistics for 69.72.253.198: Packets: Sent = 5, Received = 2, Lost = 3 (60% loss), Approximate round trip times in milli-seconds: Minimum = 10ms, Maximum = 10ms, Average = 10ms Willy
Posted by Tina J, 03-05-2006, 01:58 PM
Yup, something baaaad going on right now. Some of our Dnow servers are having a horrible time at the moment. --Tina
Posted by MrMcGoo, 03-05-2006, 02:08 PM
One of our reseller servers was offline for few minutes but then came right back up (but not rebooted)...so it may have just been a switch issue, at least for our situation. We pinged: Pinging 69.72.253.198 with 32 bytes of data: Reply from 69.72.253.198: bytes=32 time=21ms TTL=48 Reply from 69.72.253.198: bytes=32 time=29ms TTL=47 Reply from 69.72.253.198: bytes=32 time=25ms TTL=47 Reply from 69.72.253.198: bytes=32 time=21ms TTL=48 Ping statistics for 69.72.253.198: Packets: Sent = 4, Received = 4, Lost = 0 (0% loss), Approximate round trip times in milli-seconds: Minimum = 21ms, Maximum = 29ms, Average = 24ms
Posted by jayglate, 03-05-2006, 02:12 PM
There was a DoS attack which was mitigated, all should be well now.
Posted by Tina J, 03-05-2006, 03:57 PM
Not quite - still ongoing. I'm sure you guys are aware and working on it. We'll sit tight and wait for you to handle it. Thanks for your hard work! --Tina
Posted by newyorker, 03-10-2006, 05:17 PM
my 2 servers are down.
Posted by spikez202, 03-10-2006, 05:18 PM
So are mine, and so is dedicatednow.com
Posted by mynextnet, 03-10-2006, 05:18 PM
anyone having problems reaching dedicatednow's network right now?
Posted by shimmy, 03-10-2006, 05:20 PM
yeah they been down
Posted by DeltaAnime, 03-10-2006, 05:21 PM
confirmed over here
Posted by RooconHosting, 03-10-2006, 05:21 PM
everything appears down from michigan, our server as well as all of dedicatednow.com
Posted by spikez202, 03-10-2006, 05:22 PM
... And fortress itx - the parent company and datacenter of dedicatednow.
Posted by cbwass, 03-10-2006, 05:22 PM
All down for me from Europe
Posted by Jon69, 03-10-2006, 05:23 PM
All down from UK Also. Bah.
Posted by Tina J, 03-10-2006, 05:26 PM
Argh - this is starting to affect my reputation. I'm sure they're working on it and getting everything under control. --Tina
Posted by spulis, 03-10-2006, 05:27 PM
All down for us as well.
Posted by surfmanjoe, 03-10-2006, 05:28 PM
anyone may access http://www.dedicatednow.com ? thanks.
Posted by kneadingu, 03-10-2006, 05:28 PM
This better not be another planned outage I have not received notice of ...
Posted by kebirhost, 03-10-2006, 05:29 PM
Hello, Yes it is down for me too.
Posted by avythe, 03-10-2006, 05:29 PM
Also down here.
Posted by DeltaAnime, 03-10-2006, 05:30 PM
Just talked to Matt and it seems to be unplanned and he's currently trying to get more info to pass along ~Francisco
Posted by newyorker, 03-10-2006, 05:30 PM
no we haven't received any notice either.
Posted by eva2000, 03-10-2006, 05:30 PM
down here too!
Posted by noox, 03-10-2006, 05:31 PM
And my server, too. Usually dedicatednow.com is reachable even if customer servers are down.
Posted by WireNine, 03-10-2006, 05:31 PM
All down! This is unbelievable.
Posted by blakekr, 03-10-2006, 05:32 PM
Me too .... my site, panel and their site .... sure wish I knew what was going on.
Posted by DangerMouse, 03-10-2006, 05:32 PM
hmm.. subscribing.
Posted by ElrondTwg, 03-10-2006, 05:33 PM
Yup, my servers are down.
Posted by surfmanjoe, 03-10-2006, 05:33 PM
the dedicatednow.com is not reachable at my end for now. the network issue? anyone has their phone number? I want to give them a call.
Posted by RooconHosting, 03-10-2006, 05:33 PM
almost as unbelievable as the excellent uptime they've maintained for us over the last couple years. I know they are on it
Posted by all-tld, 03-10-2006, 05:33 PM
Yes, its also down from germany. The route seems no longer be propageted. I have checked it from 3 different locations; None of my routers are knowing the route to their Datacenter :-(
Posted by braysurdi, 03-10-2006, 05:33 PM
I have 2 servers there, both are down now.
Posted by gold777, 03-10-2006, 05:34 PM
All down for me as well :-(
Posted by blakekr, 03-10-2006, 05:34 PM
I got the same response; no path to server.
Posted by PhMatt, 03-10-2006, 05:34 PM
I'm going to post updates as I have them, and will try to keep people updated here as much as possible. At approx 4:10PM EST, looks like the main UPS did not switch properly indicated by early reports. Electricians and staff are working on the matter, that's all I know for now, I will post more as I have updates, and will try for estimates in about 20 minutes.
Posted by Chae, 03-10-2006, 05:35 PM
Same here in New Zealand and their phones are off the hook
Posted by 1ONE, 03-10-2006, 05:37 PM
I have 2 server with them , they are down / unreachable , must be a network issue or power failure.
Posted by kebirhost, 03-10-2006, 05:38 PM
Hello, http://www.webhostingtalk.com/showth...=1#post3728229
Posted by ManXP, 03-10-2006, 05:38 PM
Don't know if dedicatednow is related to Beachcomber, but Beach servers are down as well
Posted by QualityHost, 03-10-2006, 05:38 PM
Yes, all of our FITX machines are down Just when it was beginning to feel like they had everything under control ... too bad
Posted by Mitac, 03-10-2006, 05:39 PM
Same here, my server is down, I cannot reach any of their domains. Support center is unavailable. I was just up with them an hour ago, maybe less.
Posted by David, 03-10-2006, 05:40 PM
Appears down here -- how long has it been out? Update: Judging by the other downtime thread since 4:20PM EST
Posted by Douglas, 03-10-2006, 05:40 PM
Folks, we're aware of the situation and are working as hard as we can to get it resolved. Please do not call, we've got all available staff working on this issue right now. The more that people call, the less staff we have available to resolve this issue. Thank you. EDIT: This needs to be moved to the Outages forum.
Posted by asyrov, 03-10-2006, 05:40 PM
Do you have power in the facility? Is it possible to switch over to generator from the basement around UPS? or it would be too much risk?
Posted by PhMatt, 03-10-2006, 05:40 PM
I've reported this thread and asked that it be merged with http://www.webhostingtalk.com/showthread.php?t=494212 to split the issues. I'm going to be updating only to the thread above, as it involves an entirely different issue. Thanks,
Posted by RooconHosting, 03-10-2006, 05:42 PM
considering my electrical system is grounded with solder and duct tape to the radiator, i think ill let the electricians make the big decisions
Posted by blakekr, 03-10-2006, 05:43 PM
Thank you for posting here, Douglas, I am reassured.
Posted by PhMatt, 03-10-2006, 05:43 PM
ok, Electricians (Liebert) will be giving an ETA shortly, and then I'll post it up. Thanks,
Posted by Chae, 03-10-2006, 05:44 PM
I'm going to post updates as I have them, and will try to keep people updated here as much as possible. At approx 4:10PM EST, looks like the main UPS did not switch properly indicated by early reports. Electricians and staff are working on the matter, that's all I know for now, I will post more as I have updates, and will try for estimates in about 20 minutes. <> Last edited by anon-e-mouse; 03-11-2006 at 01:34 AM.
Posted by Odd Fact, 03-10-2006, 05:44 PM
Moved to the Outages Forum.
Posted by asyrov, 03-10-2006, 05:44 PM
Please let them work on the problem... the link was provided to http://www.webhostingtalk.com/showth...=1#post3728259
Posted by WireNine, 03-10-2006, 05:45 PM
Lets hope this gets resolved soon. Thank you keeping us up to date Matt!
Posted by ShadowMaster, 03-10-2006, 05:46 PM
Thanks for the swift updates Matt.
Posted by badawi, 03-10-2006, 05:47 PM
Please keep us informed. Not related at all, but I had a server up and down for four days last week and this is not going to help
Posted by Tina J, 03-10-2006, 05:47 PM
Subscribing ...and nervously trying not to panic! --Tina
Posted by Tina J, 03-10-2006, 05:49 PM
I'm one of Dnow's biggest fans, so take this as constructive critism please. You have people answering the phone that should/could be working on fixing this issue??!!! Please, take them off the phones and put up a recording or something. Getting everything back online should be #1 top priority. --Tina
Posted by cbwass, 03-10-2006, 05:50 PM
If power was lost, does this mean when it comes back all the servers will need to be manualy restarted?
Posted by TurbulentMedia, 03-10-2006, 05:51 PM
oddly enough, we were getting reports of extremely slow bandwidth to and from our servers at DN about 1 hour before they went completely down.. We -never- have slow bandwidth with DNow, so this is quite an odd coincidence.. Thank you Matt for the updates.. Helps me from breaking out the advil immediately
Posted by surfmanjoe, 03-10-2006, 05:53 PM
thanks for informing us of the unexpected issue. Please let us know what time our servers will be back. thanks.
Posted by 1ONE, 03-10-2006, 05:53 PM
Ok , let us hope that it will not be long downtime
Posted by music, 03-10-2006, 05:55 PM
They said they are working on it.use this time wiselygo take a walk..go play with your kid, go give your wife or girl friend a kiss.do something..it will probably be back up very shortly and you can go back to your 20 hour marathons in front of the computer.
Posted by Douglas, 03-10-2006, 05:55 PM
Tina, I'm right there with you, I was just saying that as a reminder to other people to not get upset if we don't answer the phone. I've got almost all of my servers at DNow myself, so I'm right there with the rest of the customers, waiting with baited breath that we're going to be up soon, but I'm also trying to let people know that we *are* working on this as hard as we can (see Matt's response above).
Posted by TurbulentMedia, 03-10-2006, 05:56 PM
I've also been a big supporter of DN, but telling your clients not to call you (when this is what you tell clients to do via the welcome email that has been sent out when ordering a server) isn't a very sound move.. Since you have an auto-attendant, put the DN queue into lockdown, play a recording, and let clients know you're working on the issue. I'm sure all of your clients don't know about this forum to check for updates. There are many people going blind right now that don't have access to this forum (or don't know about it..) Just my 2 cents.. edit: it helps if I don't take my sweet time in typing this, while others reply with more detailed explinations of what they said
Posted by minotauro, 03-10-2006, 05:57 PM
DedicatedNOW
Posted by mahinder, 03-10-2006, 05:57 PM
i am sure guys at dedicatednow are working hard to get this up ! thanks for wonderfull support in past.
Posted by datums, 03-10-2006, 05:59 PM
A recording is your best bet at this point. Usually the way large enterprises deal with major issues. On a positive note , I know we are in good hands.
Posted by Tina J, 03-10-2006, 05:59 PM
That's just not nice. Everyone needs to take a walk around the block and try not to stress for a bit while they get everything under control. --Tina
Posted by surfmanjoe, 03-10-2006, 05:59 PM
that's a intertesting advice and it could release yourself from being anxious and concerned. I love DN, and am hoping they will be back soon.
Posted by asyrov, 03-10-2006, 06:01 PM
This is like the first real downtime in ~3+ years ... I guess it was hard to just ify the recording equipment.... I like their service and I am sure this will be resolved very soon.
Posted by Shiboning, 03-10-2006, 06:02 PM
Since about 4:00pm EST today (March 10, 2006), DedicatedNow is down. Not just my server, the entire datacenter is down, including DedicatedNow.com website. This is still office hour, I hope the hour pass by quickly and my clients are not screaming at me. I called the datacenter, they said they would fix it as soon as possible. I am fairly new with DedicatedNow, so it is not a good impression, in spite of all the good reviews here. Shiponing.
Posted by eL-ankebut, 03-10-2006, 06:02 PM
I second that
Posted by Layershift Andrew, 03-10-2006, 06:02 PM
Thanks for the updates Matt/Douglas.
Posted by Duport, 03-10-2006, 06:03 PM
The network is a shambles
Posted by TonyB, 03-10-2006, 06:04 PM
I wanted to start primarily using DedicatedNOW for my servers and now I'm second guessing that
Posted by minotauro, 03-10-2006, 06:04 PM
Sorry... DedicatedNOW
Posted by spulis, 03-10-2006, 06:04 PM
I just wish alertra would stop calling me
Posted by JenniH, 03-10-2006, 06:04 PM
The ETA is pretty essential for us. We are lucky enough to be able to move stuff around to hot backups.... but need the ETA to make that judgement. I have a feeling this might be a long one: I really hope I'm wrong.
Posted by PhMatt, 03-10-2006, 06:04 PM
Not much more to add in here, other than Liebert guys are working on things, and before anybody reads into this too far, I am just stating this as an "also". Should the need arise for any particular components as well, a secondary unit was also dispatched to the facility with beyond normal repair components. Meaning in short, just for precaution purposes, should the standard Liebert guys not be able to fix it with their stock of parts (if parts are required) the secondary team with basically *all* the component parts is already in route on the way *again as a precaution* Thanks,
Posted by spikez202, 03-10-2006, 06:05 PM
This is quite nerve-wrecking.
Posted by ElrondTwg, 03-10-2006, 06:05 PM
Three years?? Wasn't there a time in the not too distant past where they were down for almost one long, agonizing day? I don't remember when it was but I do remember spending weeks ensuring my clients it would not happen again.
Posted by brzell, 03-10-2006, 06:06 PM
I hope my servers are back up soon as well. Really cant complain, I havnt had any down time for over a year. Even though, some clients get mad about 5 mins of down time
Posted by NocturnalGuy, 03-10-2006, 06:06 PM
Yikes. I've had a server with them for 3 months now, and this is the first time I've had trouble... pretty big trouble though, if their whole operation is down! I've only had one client screaming at me so far...
Posted by GreatDaneOwner, 03-10-2006, 06:07 PM
You seem to forget about their move from the NAC to their current DC. That was a major outage (well over a day) and everything that could go wrong did then. But this is slightly off topic so let's not discuss that issue here and now; I just wanted to correct that statement.
Posted by BrandonSCSN, 03-10-2006, 06:07 PM
I would agree with the advice of taking a break during this outage. I would imagine that some of us have been sitting in front of our desks all day, and perhaps have even eaten lunch while working. I know I can't do anything, and I doubt most of the other people of this forum can either (with the exception of their employees), so take a break, there is no point in getting stressed out over this situation. Regarding the "recording" in the PBX queue. This could work, however, recongize that FITX personal might all be busy working on this problem, with possibly the people knowning how to make changes on the PBX, already busy working on power. FITX is a large company, but nowhere near the size of 1 & 1. Thats ok with me though, I am very happy with their network.
Posted by MrMcGoo, 03-10-2006, 06:08 PM
And third.....to hit 99.98 % over the past 3 years this would have to last past 26 hours........ EDIT: NOT suggesting that this is a GOOD idea
Posted by maklely, 03-10-2006, 06:08 PM
thanks mr . Douglas dedicatednow the best alwaysssssssssssssssssss & thanks for support dedicatednow khalil ibarhem
Posted by SniperDevil, 03-10-2006, 06:08 PM
This isn't good. Let's hope they get their act together. To me, an entire datacenter going down for more than an hour is not acceptable, especially if you run a business and depend on it.
Posted by asyrov, 03-10-2006, 06:08 PM
I did not forget about that day .... I was with them that night.. LOL But time flies.... that was 2002-2003 if my memory is correct (I could be wrong).... 99.99% is usually measured on monthly basis...
Posted by BrandonSCSN, 03-10-2006, 06:09 PM
By shambles you mean what, exactly?
Posted by TurbulentMedia, 03-10-2006, 06:10 PM
yeah.. that's helpful.. I'll agree this is the first unscheduled downtime I've had with our boxes there since we started with them.. Their network is by no means a shambles.. have you don't a trace on it on a typical day? apparently not. I think we should just sit back for a bit, and they will take care of it. The support is -always- helpful, and in good spirits when contacted, once in the right direction they come up with solutions quickly, give advice on things they don't -have- to.. Instead of ranting about DN (of which this thread should not be taken to) go kiss your girlfriend/wife on the side/whatever as stated above lol and chill for a bit.. no amt of complaining is going to help them get the boxes back up any faster..
Posted by JenniH, 03-10-2006, 06:11 PM
If they are working on it, presumably they must have an idea what the problem actually is. Thus, they must be able to give some sort of ETA. Yes? If so.... can we have it?
Posted by Eng.Ahmed, 03-10-2006, 06:12 PM
Hello Dedicatednow Team . iam happy to deal with you .. but i dont know what happend to your servers now .. all my servers is down .. i hope to tell me what's the problem .. and give me the time takes to solve thise problem and servers work again .... i hope to solve any problem quiqly .. and tell us alwayes with new .. thanks Very Much Eng.Ahmed
Posted by 1ONE, 03-10-2006, 06:12 PM
This doesn't sound good
Posted by MrMcGoo, 03-10-2006, 06:13 PM
No matter what ETA they give they will be eaten alive if they miss it by 30 seconds...So I would be hesitant to give one unless I was REAL sure it could be met and it seems they do not have an ETA that can fit that criteria.
Posted by Tina J, 03-10-2006, 06:13 PM
From my experience, running our humble little datacenter for a few years...you don't want to go stop the guys who are working on fixing things so that you can get a status report. You get the basic idea of what the problem is (in this case, power) and report that bit of info to the masses and say "We'll give you updates when we get them.". If there are no updates within an hour or so...then its time to bug the guys for details. --Tina
Posted by BrandonSCSN, 03-10-2006, 06:14 PM
Yes, however, an ETA is not always possible to calculate, or accurate Something tells me you don't work on 'large' projects often.
Posted by Joomla, 03-10-2006, 06:15 PM
this is not good...
Posted by TurbulentMedia, 03-10-2006, 06:16 PM
Read the entire thread.. Power issues.. Many servers seem to be down, we don't know how many, or if it's the entire network My traces die in NJ after hitting an ATT router.. soo, looks to me like it's the entire network.. I could by all means be wrong..
Posted by MrMcGoo, 03-10-2006, 06:17 PM
A voice of reason......
Posted by JenniH, 03-10-2006, 06:18 PM
I don't expect a precise one... just a ballpark. Half an hour, 2 hours, 6 hours.... whatever. That should be possible. As for interrupting ... how long does it take to just ask and get a response? Seconds. It's not a lot to ask of them, and would be valuable to us.
Posted by JMolina, 03-10-2006, 06:20 PM
That's not the only company down Beachcomber.net is also down for about the same time. I wonder if they run out of the same DC ? [edit] spell check [/edit]
Posted by SmakDaddy, 03-10-2006, 06:21 PM
Who broke the internet? Subscribing
Posted by WireNine, 03-10-2006, 06:22 PM
Any more updates from DN/FITX?
Posted by TurbulentMedia, 03-10-2006, 06:22 PM
I'm sure a good ballpark would be within the next 72 hours (we're all out just like you..)
Posted by TurbulentMedia, 03-10-2006, 06:24 PM
I did! I did! (... runs away with very (now) dark fibers in his hands, some in pretzel knots)
Posted by Torith, 03-10-2006, 06:24 PM
If I remember correct Beachcomber.net is part of Dedicated Now or is just in the same DC.
Posted by DeltaAnime, 03-10-2006, 06:24 PM
Jay was probably acting out anime scenes again and tripped over the UPS ~Francisco
Posted by mmaaaaattt, 03-10-2006, 06:24 PM
Just posting to throw in some positive support. Patiently awaiting a resolution, thanks DN.
Posted by Tina J, 03-10-2006, 06:25 PM
I completely understand your frustration...trust me, I have about 2 dozen servers unreachable right now and customers calling and emailing me for an ETA. The thing is, imagine working on something that requires focus and being interrupted with a "So, what exactly seems to be the problem?" question. That's time that you have to stop, explain in layman's terms what the problem is, and then refocus and go back to work. It seems like a small interruption - but it delays getting us back online. Also, consider that sometimes you really don't know how bad/good a problem is until you're through it. They would do more damage if they told us "Well, it looks like about an hour" and then found more problems and it ended up taking several hours. I see it from both points of view. Its hard to sit back and 'not know'...but, personally, I would prefer they let the repair people do their jobs uninterrupted. At least we know its a power issue and they are working on it as fast as humanly possible - that's all we really need to know at this point. --Tina
Posted by DimeNocJason, 03-10-2006, 06:25 PM
I've heard two things. The guy on the phone told me that they are having power issues which should take no longer than 1 hour to resolve. I've heard from someone else that it has something to do with their Air Conditioning units...hm...
Posted by RobertMaltby, 03-10-2006, 06:25 PM
YAY!!! I've been with DNow since 2-22-06 and I still have yet to get my box set up and working properly.. There has been 2 outages both of which I Wasnt notified about.. Good Job Mr. Communication Specialist
Posted by JMolina, 03-10-2006, 06:25 PM
Just spoke with Beachcomber.net seems like the a UPS/SWITCH failed and Datacenter or line providers are working on it. This effects anyone using that switch so DedicatedNow might be part of that. They said they have electricians on it though.
Posted by BrandonSCSN, 03-10-2006, 06:26 PM
Ok, I am really going to doubt you have ever worked in a high pressure enviorment / mission critical situation. Developing a ETA takes time, and time is currently being put into getting systems backup. The techs probably modify the ETA in their heads every few minutes, depending on how something went, or how it didn't work. Recongize this, as soon as you start providing an ETA, you end up with MORE problems, not less. Not only would upper management at some companys start complaining (since you gave them a low ETA), but customers would start asking too, delaying the process even further. If you give a "general" ETA, such as "Should be up soon", then you end up with people asking "How soon is soon?". Why bother starting the loop? Most of the time, if a company is going to give an ETA, it will include additional time. And if you don't think this is practiced in real business, think again. I see this all the time with United Airlines, and I fly alot. Their ETAs for the flights are always WAY over, so they never need to worry about a small change resulting in customers questioning the "delay". Plus, they can say they have always been "on time", even though the time for the flight was 30 minutes too long to begin with. This brings up their pecentage of on time flights, improves customer / investor confidence, and improves competition. Last edited by BrandonSCSN; 03-10-2006 at 06:31 PM.
Posted by a1mint, 03-10-2006, 06:29 PM
I have one frantic client and one not so frantic client that will definitely be knocking on my door. JVDS used to be *great* when Rus was running the show. But 1 1/2 year ago dedicatednow bought out all of Rus' assets, including any know-how. About that time, they asked me to switch servers. Perhaps I'm on this virtuozo thing now instead of UML? Who knows - as long as I have a root-like environment. If things aren't back up in a few hours from now, I'm planning on transferring my clients to redwoodvirtual tonight (good thing I keep 2 accounts around...), after which I will cancel my "dedicatednow" account. Pissed me off that they *just* billed me. I will have to start shopping elsewhere for a decent VPS. Byte-something in the UK hear good things from. Anyone can recommend me anything? Anyone know where Rus is hanging out? ps. I have had trouble with jvds/dedicatednow's billing department for about 3 months now. Each month their system complains that I didn't pay yet, but both my paypal and credit card accounts clearly indicate a successful transactions. Last edited by a1mint; 03-10-2006 at 06:34 PM.
Posted by PhMatt, 03-10-2006, 06:31 PM
ok, don't have reason, cause, or anything, except things should be coming up now. It's going to take about 10 mins for BGP to reset, and all other fun routing stuff to kick in. I didn't ask for a detailed explanation, as people have things to do there to get everybody up and running ASAP, but power has been restored, and everything is coming up now. Thanks,
Posted by JenniH, 03-10-2006, 06:32 PM
That's twice now that you have repsonded specifically to my posts in condescending terms like this. You know nothing about me and never will... so don't make pathetic judgements like this armed with zero evidence. You sound like one very sad guy. As for the ETA.... the problem with not having any clue is that we have assume the worst, and kick in contingency when it may not be needed. TThis is resource intensive and costly. Hence the burning need for some data upon which to make an informed decision.
Posted by TurbulentMedia, 03-10-2006, 06:32 PM
I'm curious, How would DN notify you, when their entire -entire- netowork appears to be down? I'm a big fan of pigeon mail, but I don't think they would find my office by the time the servers came back up
Posted by Douglas, 03-10-2006, 06:32 PM
Khalil, nice to see ya here, bud! As so many people have rightfully pointed out, we cannot nor will give an ETA, as we would be roasted alive if we even miss that by 5 seconds. All we can do is provide updates as we get them. For the record, Matt and I are not on site, which is why we're both able to post here and reply. All communication is being done via cell phones right now, as our PBX system is tied into the power and network grids at DNow. I know it's a trying time, but I do want to thank you for your patience and thank all of those that have shown their support over this outtage. We'll get everyone back up as quickly as we can, trust us on that!
Posted by Mark L, 03-10-2006, 06:32 PM
http://webhostingtalk.com/forumdisplay.php?f=59
Posted by TheServerExperts, 03-10-2006, 06:33 PM
They use DN's DC. I wonder what happen Btw shouldnt this thread be in the 'Host Down?'
Posted by TurbulentMedia, 03-10-2006, 06:35 PM
just got pings back from one of my boxes.... yaye! Thanks to everyone at DN...
Posted by newyorker, 03-10-2006, 06:36 PM
we are up. thanks
Posted by Tina J, 03-10-2006, 06:36 PM
Jenni/Brandon: This is a stressful time for all...lets all take a step back and try not to make it any more stressful. If you two want to battle it out, how 'bout not doing it in this thread. I'll even rent a ring and we can all take wagers. --Tina
Posted by spulis, 03-10-2006, 06:36 PM
Were coming back online now.
Posted by ManXP, 03-10-2006, 06:37 PM
It's UP now!
Posted by DeltaAnime, 03-10-2006, 06:37 PM
Hurray! ~Francisco
Posted by neodepo, 03-10-2006, 06:37 PM
As soon the DedicatedNow Service went down I try to access DMS support page and noticed it was also down. Try to call to sales/billing numbers I had and the lines were also down, 15 minutes later they answered the phone and told me they had an electric power fail and that they will be up and running in 45 minutes (30 mins a go). Not just dedicated now was down, also Fortress IT and Pegasus Web Tech networks. I started with them last Dec 2005 and this is the first time I am down, they service and support has been really good. Lets see what will be happening now!
Posted by MrMcGoo, 03-10-2006, 06:37 PM
I am back...woo hoo
Posted by kzolk, 03-10-2006, 06:38 PM
Up here as well. Once the dust is settled, will a more detailed explanation of what went wrong be made available? My boss is probably going to want answers considering he was trying to show our web site to a new client during the outage.
Posted by SaLanHost, 03-10-2006, 06:38 PM
one box backup only
Posted by Chae, 03-10-2006, 06:38 PM
I seem to be back up again
Posted by surfmanjoe, 03-10-2006, 06:39 PM
cheers!!! Suddently I find I am very patient and very peaceful.
Posted by SmakDaddy, 03-10-2006, 06:39 PM
Who fixed the internet?
Posted by spulis, 03-10-2006, 06:40 PM
Or is he saying what most others are thinking?
Posted by Tina J, 03-10-2006, 06:42 PM
Oooh! I DID, I DID! --Tina
Posted by dudaah, 03-10-2006, 06:43 PM
Yep my box seems to be running again as well... Don't know what all people where messing about. I have been with worse hosts than this... Even had to cancel christmas because of my old provider being down for days and even lost customers on it. So 45 minutes for a major power break down issue... Well I can live with it... Just my point of view... Patrik Pitch Adjust
Posted by pcnet21, 03-10-2006, 06:43 PM
good job BeachComber..!!
Posted by DangerMouse, 03-10-2006, 06:44 PM
All bar one box back up.
Posted by minotauro, 03-10-2006, 06:44 PM
Sorry, today when I out of office, I down the power! I Regards,
Posted by JenniH, 03-10-2006, 06:44 PM
I take it you're a mate of his. Anyone normal reading the thread will see I asked for an ETA: I was jumped on 3 times from the same guy in insulting terms for doing so. Disagreements are fine, but someone with a clear problem like that is not.
Posted by TurbulentMedia, 03-10-2006, 06:45 PM
How about we all go back to our respective breadracks, and go on with life now? The-end
Posted by 1ONE, 03-10-2006, 06:45 PM
Yup , they're up.
Posted by GreatDaneOwner, 03-10-2006, 06:45 PM
Because you think so not necessarily does everybody else. The world doesn't revolve around you, you know .
Posted by schumilux, 03-10-2006, 06:46 PM
Seems they are back again....my 2 dedi are again responding
Posted by PhMatt, 03-10-2006, 06:47 PM
now, some of your boxes may be back online, others won't be *if* power was lost to any servers, and needs to be restored. I'm using a lot of * and " and ( ) here, as I don't have answers to any specific questions at this time. Once the dust settles, I will post a full explanation of things as best I can. As Douglas pointed out, we're off-site, and worked with team members on-site while still trying not to stand over anyone's shoulder asking "are you done yet, are you done yet" Now, what's going to happen from here..... Currently, DN site and ticket system appears down, so admins will be working on restoring that first for obvious reasons. Then I'm sure a huge amount of tickets will be poured in, admins may simply close those tickets which they can ping / have response from with a standard message, to help get to the tickets of real server down issues (I'm speculating here atm) From there, all staff is at the DC, nobody's going anywhere, and additional staff will be brought in to aide with any lingering problems. That's all I have for now, additional updates I'll give on a less frequent basis, as the crisis appears to be over, and order shall be restored soon. Thanks,
Posted by Douglas, 03-10-2006, 06:47 PM
Folks, we're coming back up, HOWEVER, I believe we're bringing the network back online in waves/stages, so we do not overpower the UPS again. Thank you for your patience and flying DedicatedNOW/Fortress ITX Airlines. Enjoy the rest of your flight.
Posted by TurbulentMedia, 03-10-2006, 06:49 PM
Matt, It does appear that our boxes lost power completely.. went from 7 months uptime on one, to 12 minutes So it appears that at least some servers *did* go completely down.. The moment when pings started hitting that one box, it had an uptime of 10 mins.. so it looks like everyone is doing a very good job at bringing the boxes back up over at DN
Posted by Douglas, 03-10-2006, 06:51 PM
Doggone it, Matt keeps beating me to the punch! Ahhh, but I've got the punchlines, and no, I didn't spike the punch! To everyone that has shown support, the entire DNow/FTX team thanks you.
Posted by terabyte-webhost, 03-10-2006, 06:51 PM
thanks mark glad to be back, shame about some of your tech staff never that helpfull even they work on tech dont even know linux that well well glad to see your back anyway atlest
Posted by DeltaAnime, 03-10-2006, 06:52 PM
Matt's as quick as a cat, good luck on that one ~Francisco
Posted by HammerHost, 03-10-2006, 06:52 PM
Hello guys, Looks like our site came back online. However, the times are now off by one day and 12 hours. Will their be a fix to this or is this a side affect? Regards,
Posted by mahinder, 03-10-2006, 06:53 PM
Doug, some my of boxes are still down while 80% are backup. should i email support or wait few more minutes?
Posted by spulis, 03-10-2006, 06:54 PM
And no we are not mates. I would just think you would understand we would all love to have the information you keep asking for, it's just that most of us can understand is not going to be given. So we deal with it. We dont keep asking for something that is clearly not going to be disclosed. We trust in the good intentions of the DC we host with and have faith in there ability to do what they do. That is why we choose them as our Datacenter.
Posted by SmakDaddy, 03-10-2006, 06:54 PM
Given this recent issue, how many here are considering moving their boxes from DedNOW over to FITX?
Posted by 1ONE, 03-10-2006, 06:55 PM
TurbulentMedia , I have 2 servers in DN , they didn't lose any power , when I typed uptime it says 19 days ( from last reboot I made ) , so my boxes were up but they couldn't reach internet ( or internet coudn't reache them , lol ) , they were up.
Posted by Gemhdar, 03-10-2006, 06:55 PM
Give it a few mintues as everything that was temporarily down is coming back in sections.
Posted by BrandonSCSN, 03-10-2006, 06:55 PM
I agree with this. Please recognize, my reasoning for continuing to argue on the situation is because I have worked in such a situation before myself, when I used to do more IT work for a major insurance company here in the states. I understand what it is like to have a manager breathing down your neck, constantly asking you "What does that mean", or "Does this mean it is going to take more time", when you and your team know you can get the job done faster if you are simply just left alone. Today, I am one of those managers, and when something does fail, I have employees work on it, and update me every 30 minutes. If they mess up, I'll get the heat, but I have enough trust in my team to be confident that won't happen. If a mod is questioning the validty of the thread I mentioned, here is a link: http://www.webhostingtalk.com/showth...=379461&page=5. Many people there, tried to help too. My discussion on this issue is now closed, as the servers are now backup, and I believe I have made my opinion clear.
Posted by spulis, 03-10-2006, 06:55 PM
Contact your host.
Posted by spikez202, 03-10-2006, 06:56 PM
DedNOW IS FITX.
Posted by HammerHost, 03-10-2006, 06:57 PM
You are my host
Posted by Tina J, 03-10-2006, 07:01 PM
Yeah, but this is WHT...not your host! --Tina
Posted by Douglas, 03-10-2006, 07:02 PM
mahinder, as Jason posted, give it about another half hour, if your boxes are still down, send a separate reboot ticket for each box. Some boxes lost power, while other's didn't (I need to check my own 11 boxes). SmakDaddy, FTX and DN are the same company, just different brands.
Posted by a1mint, 03-10-2006, 07:04 PM
You know what? I'm frantic too. My server isn't up yet. But I have to restrain myself, and think: stuff happens. As long as there're competent people making real efforts. Things I like: - competent people are genuinely working on the problem. - we are convinced that nobody is slacking off. - we all accept that things *can* and *will* fail, and that we are (should be) reasonable. - we get an explanation with something we can derive a summary from so we have something to say to our customers. What I don't like (ps. I do *not* know how DNow operates, so this should *not* be read as accusational): - outsourcing - the "tech guy" getting paged in from the house party at the other side of town. - company deciding that it is less costly to leave things hanging that it is to get that contractor back in to re-engineer their solution. I remember webpipe.net, if they're still around - boy what a nightmare that was. Downtime of 2+ weeks, and continued billing for 2 months after I stopped my service... It did notice that jvds.com and vpscolo.com is back up. Figures, probably something good left behind that Rus did - like an additional name server - he there's an idea... dedicatednow.com still down, the name server can't be reached.
Posted by Cirtex, 03-10-2006, 07:05 PM
Good to hear, 1 box back, waiting for others
Posted by datums, 03-10-2006, 07:07 PM
Thank you Tina, your advice worked. I went for a walk came back and the network was back up. I don't know how many more times that will work, but I hope to limit its usage. Cheers
Posted by DaveNZ, 03-10-2006, 07:07 PM
One box up, still waiting on the other. Just wanted to add my support for you guys at DN. Although I would still like to see an offsite mirror for your forums to cover this type of event I'm happy that you handled this the best way possible. DN's general support is usually fast and helpful. I don't have any problem with their track record. I have a theory that the longer you've been in this game the less upset you get when hiccups happen. Some of the angry posts in this thread remind me of myself a few years back.
Posted by webideas, 03-10-2006, 07:07 PM
Hi Douglas, I'm trying customer.dedicatednow.com and even it seems to be down at my end. Can you make it up first so that we could post reboot requests should the machines don't come online soon
Posted by Douglas, 03-10-2006, 07:10 PM
Folks, our main sites are down and we're aware of that. We'd rather spend time getting as many customer sites back up first, as quickly as possible, than to focus on our own sites. Once we're satisfied that the majority of customer sites are up, we'll get our own servers/sites up. At least that's what I've been sensing.
Posted by Paint, 03-10-2006, 07:16 PM
What about getting your servers up so we can send support tickets? This would help you out in locating which servers are down. 3 of the 4 of my servers are back, but I called about the last one (which is on the same rack one below one that is up) that is down. They told me they didn't have the system up to figure out where it was in the datacenter. I then proceeded to explain exactly where it was but it is still down. If you can, you can take a look at for me. metro.hostdome.com is down. Anyway, thanks for all your hard work and fast support team to get this issue resolved.
Posted by SmakDaddy, 03-10-2006, 07:17 PM
The says it all But that does clear up another matter I've been wondering about and it may be true considering the "different brands" theory. Has anyone heard the rumor that The Planet may be offering a new brand of services known as Uranus. Has anyone seen. or heard of Uranus? I can't seem to find anything resembling Uranus at all, anywhere. If you should happen to have a look around, and see Uranus, can you update this thread? If not .... kill_pid
Posted by TurbulentMedia, 03-10-2006, 07:17 PM
I'm thinking that the subdomain customer is located on dedicatednow.com's server, soo.. yes, that would be down, as stated in the numerous posts above.. I would think you would await your boxes to come back up, as the DN staff are going to each one that went down and booting them up.. Asking for a reboot request when it hasn't come back up in the first place isn't going to help (at least in what I'm seeing with the current issue, and the resolution that's slowly taking place) just my 1 3/4 cents
Posted by TurbulentMedia, 03-10-2006, 07:19 PM
LOL
Posted by Douglas, 03-10-2006, 07:24 PM
SmakDaddy, I have absolutely *NO* freaking comment on that. /me smacks you for posting that (even though it was HILARIOUS)!
Posted by neodepo, 03-10-2006, 07:24 PM
It feels great to know this WHT forums work so good to be able to keep us posted with the latest issues. Thanks Matt / Douglass for keeping us informed. It seems I did good choosing DN! = neodepo
Posted by SmakDaddy, 03-10-2006, 07:27 PM
Warning points can be forwarded to abuse@aol.com
Posted by BrandonSCSN, 03-10-2006, 07:30 PM
Eh, No, I never met "spulis". Perhaps I should though, he seems to live near me...
Posted by BrandonSCSN, 03-10-2006, 07:34 PM
I'll be honest, it took me a few seconds to get it....
Posted by spikez202, 03-10-2006, 07:40 PM
One server here still down
Posted by alwatan, 03-10-2006, 07:42 PM
hello about 2 years with dedicatednow hosting , i feel every thing work great now my server off i try to send to them and no reply i visit thier site and it is not reachable what is going on?
Posted by apex13, 03-10-2006, 07:43 PM
They seem to be having some network issues or something. My server is up but I can't get to DNOW's website.
Posted by Cirtex, 03-10-2006, 07:44 PM
Same, 2 servers still down, hope it will be back soon.
Posted by mahinder, 03-10-2006, 07:46 PM
my 3 servers are still down, support ticket system is offline, can anyone recommend where to ask for support? are you guys still working?
Posted by cbwass, 03-10-2006, 07:48 PM
mahinder, Try sending an email to support@dedicatednow.com with server details, IP, name, login/pass etc.
Posted by fastnoc, 03-10-2006, 07:49 PM
I show this for my monitor. Been back online for a little while. http://70.84.149.132:3828/status/69.72.253.198
Posted by SaLanHost, 03-10-2006, 07:49 PM
only one our box is back up, sent email without respond
Posted by mahinder, 03-10-2006, 07:51 PM
but support@dedicatednow.com doesn't seems to be working thats why i asked.
Posted by gold777, 03-10-2006, 07:54 PM
I still have a server down as well
Posted by Douglas, 03-10-2006, 07:57 PM
Guys, check the outtages forum, please. We've got a pretty healthy thread in there about this.
Posted by Gemhdar, 03-10-2006, 08:04 PM
Folks, If you still have issues, contact me directly via email or IM. If you have a ticket in already, please let me know the ID when we speak. Thanks.
Posted by alwatan, 03-10-2006, 08:11 PM
could u give me link to any thread that explain this issue my site alwatanyh.com with whole server is offline could u tell us what happen i dale with your company since 2 years and i do not wanna change because your support and your hosting is perfect and this is 1st time i dale with this issue thanks
Posted by legend1, 03-10-2006, 08:12 PM
You dont accept PM so how to contact you. My server is also still down
Posted by Layershift Andrew, 03-10-2006, 08:13 PM
He said IM or email, not PM. IM details are in his profile, email in his signature.
Posted by Ryan Smith, 03-10-2006, 08:19 PM
This is horrible! I went with HIV about a week ago, then moved to dedicated now yesterday, and now this? Please tell me if the network/ outage is like this allot, otherwise, I’m going have to go else where, for the 3rd time this week. (I would like a long term customer to respond)
Posted by legend1, 03-10-2006, 08:25 PM
Well I have been with them for a few years and they have been nothing less than stellar. I did just call and it turns out my 'rack' is up and running but MY server never came back so now it becomes another issue.
Posted by Layershift Andrew, 03-10-2006, 08:32 PM
It's usually very stable, don't worry you've not made a mistake, I've been with DN for about 4yrs now.
Posted by PhMatt, 03-10-2006, 08:35 PM
At this time, admins are going through tickets, working on reported downed servers, and bringing them up one by one. The majority of clients are up, but rogue servers exist and each ticket is being handled accordingly as they are opened. We'll of course move as quickly as possible to restore any individual servers and bring them back online, and we thank you for your patience and understanding during this time. Thanks,
Posted by a1mint, 03-10-2006, 08:40 PM
I held my breath, and my server is back up. Congrats on the fix. I hope others will get back up too. Is there any way to get an idea as to the state and resolve of DN, in terms of, can I continue to trust my business to DN?
Posted by WireNine, 03-10-2006, 08:45 PM
Anyone still having issues?
Posted by alwatan, 03-10-2006, 08:46 PM
any news???????????
Posted by brzell, 03-10-2006, 08:46 PM
We still have one down !
Posted by dudaah, 03-10-2006, 08:50 PM
To all who's asking about server coming up or if DN is to be trusted from now on. Don't you read other peoples posts? The DN people say over and over that they are working on it but it's a time consumoing task getting all servers up to speed... There are numerous people saying they have been with DN for years without any serious problems... What more do you want? Same questions over and over again lol. Ok I have been with DN for a week now and this happened but I'm not very conserned. They react fast and are on the case... Not like my old provider who dissapeared for weeks...
Posted by brzell, 03-10-2006, 08:56 PM
I have used DN for a few years WITHOUT any major issues. I really cant remember the last time they were down. I guess you are seeing frustration that is brought on by some highly demanding clients. If they dont like it, they will go some where else and will have more down time for sure !
Posted by PhMatt, 03-10-2006, 09:21 PM
Though under *normal* circumstances (see, still using *, and " and () here) emergency reboots are handled over the phone, however, due to a larger than normal volume of reboot requests over the telephone, we'll ask that anyone who still needs a box looked at, to open a ticket, as we'll be handling reboots first come / first serve. Please remember to include: Server name rack location IP root / admin password and any special instructions such as su - root logins This will help us to handle requests more effeciently for anyone who still has a server offline. Thank you,
Posted by gold777, 03-10-2006, 09:29 PM
I had a ticket in an hour ago, but my server is still down. Are there still a great deal of servers down? I'm not understanding what is taking so long, and I'm missing a dinner engagement because of this :-(
Posted by The3bl, 03-10-2006, 09:33 PM
I still have a sever down also and no response to the tickets. Flashes of the great midnight data center move keep going through my head.
Posted by mripguru, 03-10-2006, 09:34 PM
Here's your news.
Posted by freeva, 03-10-2006, 09:42 PM
Anyone still down? I seem to have a server still down.
Posted by apex13, 03-10-2006, 09:42 PM
Thanks Douglas. At the time I posted in this thread I was still unable to connect to the forums or pretty much any DedicatedNOW site except billing. *goes to forums* -edit, uhh..ok which outages forum do you mean? I don't see anything at http://forums.dedicatednow.com/ and I see not WHT outages forum.. Thanks
Posted by layer0, 03-10-2006, 09:44 PM
http://www.webhostingtalk.com/showthread.php?t=494212
Posted by apex13, 03-10-2006, 09:45 PM
Sweet, thanks!
Posted by eclipsewebs, 03-10-2006, 09:49 PM
A company we support still has a machine down. I have 2 tickets (about 1.5 hours ago), but haven't seen anything back on either. Wondering if I need to put a new one in since Matt's message.
Posted by host4profit, 03-10-2006, 09:54 PM
Just curious, what BR are your servers on that are still not responding? Just wondering if these are server specific or rack specific. The one server we will have not responding is on BR13F-H David
Posted by Gemhdar, 03-10-2006, 09:57 PM
Ticket ID...please email it to me.
Posted by host4profit, 03-10-2006, 10:03 PM
All back up at this time
Posted by IKillBill, 03-10-2006, 10:12 PM
It seems DN have SO MANY problems lately?
Posted by alwatan, 03-10-2006, 10:14 PM
my server still down plz fix it ,Support #792663]: plz my server is off line or not reachable
Posted by alwatan, 03-10-2006, 10:29 PM
any one have server down like me i wait DN to back it up
Posted by granal1960, 03-10-2006, 10:40 PM
my server down support ticket # 792880
Posted by cyb, 03-10-2006, 10:41 PM
One of my servers has been down for over 5 hours and no response to my ticket (ID 792769) !!
Posted by wheimeng, 03-10-2006, 10:47 PM
Looks like we are on the same boat.
Posted by eSited, 03-10-2006, 10:55 PM
I have my servers with beachcomber.net but the datacenter is FITX, server still down since 4:20PM
Posted by badawi, 03-10-2006, 11:26 PM
One of my servers still down too. I opened a ticket. Anyone else still down??
Posted by eclipsewebs, 03-10-2006, 11:27 PM
Yeah still waiting, beginning to worry now.
Posted by Tina J, 03-10-2006, 11:29 PM
We have about 2 dozen servers...all are back online except one. Ticket just in and waiting. --Tina
Posted by badawi, 03-10-2006, 11:34 PM
Is it your newer server still down? because that is the case with us. The old ones are up and the newest down not much tollerance is expected from our new customers.
Posted by avonderluft, 03-10-2006, 11:36 PM
it is my newer ones that are up, and the older one that is still down.
Posted by Tina J, 03-10-2006, 11:38 PM
Same here. --Tina
Posted by Douglas, 03-10-2006, 11:42 PM
We're still working on getting everyone up, please be patient, we can only work on so many servers at the same time. Jay and a couple other technicians are still working, and I believe Matt and Jason (as well as me) are still on, trying to help out wherever we can (see my hours, see what time I made this post). Trust us, we're doing everything we can, but due to the sheer number of reboots needed and watching servers come up, it's a slow process.
Posted by Tina J, 03-10-2006, 11:44 PM
Yup - we are being very patient. That's why I waited until now to put in the ticket because the server isn't mission critical. One thing that I was wondering about is that I didn't get an email confirming the ticket. Hoping you still get it. --Tina
Posted by freeva, 03-10-2006, 11:58 PM
So what exactly is the issue here? Network outage? Power outage?
Posted by Tina J, 03-11-2006, 12:02 AM
You mean you're too lazy to read through 15 pages of posts to find out that it was a power outage? --Tina
Posted by NexDog, 03-11-2006, 12:12 AM
Still 2 servers down here. Two out of a hundred isn't bad. But those two client are obviously pretty happy.
Posted by IGobyTerry, 03-11-2006, 12:16 AM
Bet they're feeling real lucky.
Posted by niyogi, 03-11-2006, 12:18 AM
I'm going to go ahead and chime in here since we do have a few servers at DedicatedNow as well as many VPSes with their VPScolo division. [1] It's a power outage - but the suddenness of the outage means there was no backup power or it just didn't work. If it did, then perhaps they would have had some time to notify customers *officially* one what has happened and when they expect things to be back in working order. 15-page threads like this emerge only because information isn't pro-actively delivered. It's plausible that Douglas and his crew are too busy rebooting servers to give any sort of official commentary by way of a newsletter notice. Still, I think that it should be their responsibility to let us know rather than to sift through these long snaky threads. [2] I think having the ticket system UP is important. It prevents customers from sending in multiple reboot requests (clogging up YOUR queue - unless they are savvy enough to use the same ticket subject line) and allows customers to update the ticket and check on status directly from within the ticket system. To say that you are hoping to get our servers up before your own is great but the ticket system is just as important. All that being said, these outages do not happen often but I've noticed DedicatedNow's general support quality slipping. That's too bad really. :-( Roj
Posted by badawi, 03-11-2006, 12:22 AM
I have emailed Jason and I opened a ticket. I walked arround the block 40 times, and just about tried every way of distraction. The phone is ringing and customers are swearing and still no reboots. Still down
Posted by eclipsewebs, 03-11-2006, 12:30 AM
I feel your pain, 7 hours of downtime is not good. I haven't heard anything in 2.5 hours since they said that my ticket was being escalated. At this point I don't know if they have even tried to bring the machine online of if there are problems with it.
Posted by badawi, 03-11-2006, 12:34 AM
Well at least they said they escalated your ticket. mine is just sitting there as confused as me. No answer, no reboot, no server.... life sucks, I'm getting depressed
Posted by badawi, 03-11-2006, 12:40 AM
Now, honest if that was a power issue or whatever and it is now resolved as most servers are backonline. Why are some down and obviously no ETA for when they will be back?? I'm a very understanding person (I think); but when the other servers came online hours ago I told my customers that it would be maximum another hour for the remaining servers. Now it has been a few hours and I'm not even getting a reply. Please guys, we feel with you and appreciate your hard work, please feel with us..
Posted by spikez202, 03-11-2006, 12:46 AM
Why would you give them an ETA, if you never received an ETA?
Posted by niyogi, 03-11-2006, 12:48 AM
Since I complained here. I only feel it's fair to share thanks as well. Thank you, DN. Server is back up (the one we've been waiting for). Now we just need to make sure all VPSes are up as well. The fact that our server is up after several hours of downtime gives me confidence to tell you folks that your server WILL come back up - it's just a matter of time. Roj
Posted by jferg, 03-11-2006, 12:57 AM
I have to agree with badawai - 7 hours of downtime and my patience is wearing thin. More frustrating, though, is the fact that as I'm having to go to a 3rd party forum for updates on the status. I apparently could be going to the official DirectNow forums, and the DirectNow customer service site, since they seem to be back up, but since I'm a former JVDS.com customer, I've never even been officially notified that those sites exist, and have no clue what my login to them might be. The response to my ticket, an hour and a half ago, said to let them know if it wasn't up in 45 minutes, and I have't gotten a response to my re-ping. This is starting to get silly.
Posted by Tina J, 03-11-2006, 01:20 AM
I just looked and I think the ticket I sent earlier didn't go through. It wasn't in the active or closed queue. I just resubmitted - ticket 793143 if anyone from Dnow wants to look. --Tina
Posted by jferg, 03-11-2006, 01:24 AM
Er...DedicatedNow. Guess I really should get some sleep.
Posted by freeva, 03-11-2006, 01:27 AM
This is driving me crazy. My server is still down.
Posted by RossH, 03-11-2006, 01:35 AM
Because of a single downtime your thinking of moving your servers....... Please do so you can spare the rest of us this kind of B.S. in the future. Dedicatednow is a budget dedicated hosting company so if you want perfection please head your snappy butt on over to rackspace.com where you can pay 4x the price of your current servers. With that being said and before anyone jumps on me I do believe they should have handeled this problem already and have given a full reason of this power outage [RFO] {a.k.a Reason For Outage}.
Posted by Ryan Smith, 03-11-2006, 01:35 AM
I thought the same thing, so I submitted another ticket. Still waiting. I submitted a ticket 3 1/2 hours ago... and there was no way to track it. I know things like this happen, but for a big company like DedicatedNow, this is unacceptable. Im getting crushed with emails/ phone calls, because of the one and only server I have with them is down.
Posted by Alex, 03-11-2006, 02:10 AM
My server hasn't gone down, however this has me very worried. So far I have been very happy with DedicatedNOW and the server they were able to provide me, but this amount of downtime is unacceptable.
Posted by jayglate, 03-11-2006, 02:37 AM
All downtime is unacceptable, we are working on tickets in the order recieved, there is only so much staff and so much we can do at once, in situtations like these no matter the provider there will always be backlog. We are getting to each and every server in the order they came in, some servers require more work then others.
Posted by alwatan, 03-11-2006, 02:40 AM
still not work
Posted by dudaah, 03-11-2006, 02:54 AM
Your server did not go down and you complain about down time? I think you might have missed it as it was probably down and started to work by itself after some 45 minutes or so when the power got back (like our server although I noticed the down time). But be happy instead mate that it didn't affect you more that that and don't be worried about something that didn't affect you. hehe
Posted by eclipsewebs, 03-11-2006, 03:01 AM
I agree, for all of those like me who still have a server out with no clue about it's status, this has been awful. We are progressing up on the data center move real quick.
Posted by onice, 03-11-2006, 03:24 AM
Will be any credit for all this time down?
Posted by niyogi, 03-11-2006, 04:40 AM
Can anybody get to http://support.dedicatednow.com yet or is it still only possible to submit tickets via email? Roj
Posted by schumilux, 03-11-2006, 04:43 AM
Can't open the link from my location ( Luxembourg / Europe )
Posted by NexDog, 03-11-2006, 05:49 AM
Only email works. Last of our servers just came up.
Posted by webideas, 03-11-2006, 06:34 AM
I rebooted my machine an hour back & it didn't came up, I sent a reboot request and their had been no response so far. Tried calling them however no body is answering, no response on the ticket...and nothing is happening. I hate coming to public forums for cursing my provider however this time I'm losing my patience...It looks like they have collapsed under this disaster situation..and after 5 hours of downtime last night I'm just sitting crossed fingers for the current downtime.
Posted by jayglate, 03-11-2006, 07:01 AM
Everyone is on a first come first serve basis. The oldest tickets get priority over the newest one. we arn't answering the phones because we are fixing boxes, and there will be updates on tickets, when we have something to udpate them with.
Posted by JayPee, 03-11-2006, 08:42 AM
Are you saying that you're still working on tickets submitted more than 13 hours ago? That's when mine went into the queue (#792789) and my server is still down. It's 11.30pm and I need sleep. I'll keep my fingers crossed that when I wake up this has been sorted - otherwise it'll be more than 24 hours downtime. Thanks for your hard work. Jason
Posted by Ryan Smith, 03-11-2006, 09:46 AM
Looks like my server may not come back up for another week for all I know. I just moved my servers from HIV to dedicatednow on Monday because of the power outages/ network down time, and now this? I’m getting very frustrated by the second. And I said that for a big company like DedicatedNow, should not have these type of problems, because they should ALWAYS have a backup plan, in cast if this did happen.
Posted by Ryan Smith, 03-11-2006, 11:07 AM
Im subscribing to this thread for updates. ~Ryan
Posted by eclipsewebs, 03-11-2006, 11:07 AM
18 hours soon, still no word on our server. How many servers are having problems, must be hundreds to be waiting this long?
Posted by eclipsewebs, 03-11-2006, 11:50 AM
Finally up, now to check to make sure it is ok. Thanks for your work guys.
Posted by Ryan Smith, 03-11-2006, 11:53 AM
Still down here... 18 hours so far. EDIT Is their website down? I cant get to that now.
Posted by Xpress Networks, 03-11-2006, 12:11 PM
My server was down too and it came back up with in 30 or so minutes
Posted by Ebart, 03-11-2006, 01:00 PM
still down for me too
Posted by cyb, 03-11-2006, 01:01 PM
My server has been down for 19 hours!
Posted by jferg, 03-11-2006, 01:04 PM
Mine finally came back up around 2am, almost 11 hours of outage. Will DedicatedNow be honoring the 5% of monthly charge refund per hour of downtime stated in the SLA for this outage?
Posted by Duport, 03-11-2006, 01:17 PM
But there was no way other than calling and you could not even be bothered to answer the incoming calls nevermind bring your own website up so that we could contact you. I would think that you could dedicate someone to answer the phone. We have maintenance on router software carried out once every two weeks in the past few months which lasts around 1-2 hours. Your customers are in some cases not informed of this maintenance. I have numerous times asked for a customer login to the so called DMS but each time I have been completely given an irrelevant answer. I have been informed that servers will be disconnected when paid due to billing errors. I have contacted jay by email and never received a response.
Posted by Tina J, 03-11-2006, 02:34 PM
Hardware/server issues are not covered under the SLA. The only thing you could probably collect on is the hour and a half (roughly) that their network was actually inaccessible. --Tina
Posted by Integer, 03-11-2006, 02:51 PM
What is a good estimate of the number of people affected? For example, one box may have 30 servers in it (right?) Each server might have been hosting 10-1,000 sites. Many of those might be reseller accounts and hosting 100 of their own customers. Is 1,000 boxes x 100 servers (per box) x 100 sites (per server) x 10 sub sites (from resellers) a good approximation -- 100 million? Or 100 boxes -- 10 million? It sounds like a lot, but it continues from there: each site may have a customer database on the server to whom they would need to e-mail things that day, or the customer now can't log in (non-web hosting customers--like forum users, e-mail, etc, software users who now can't access their customer area, etc.)?? Sounds like 10-100 million users affected seems to be about right. At least, we can all agree it's in the millions. Can somebody please confirm this? My server is still down and I would like to tell my customers that they aren't alone. Last edited by Integer; 03-11-2006 at 03:00 PM.
Posted by GreatDaneOwner, 03-11-2006, 02:54 PM
There is no way you can get any reliable information on this one. DNow will not tell you how many servers are still down.
Posted by jimpoz, 03-11-2006, 03:10 PM
I have been able to ping my server since last night at 8:15, but I still can't log in with SSH and all other services are not responding.
Posted by Integer, 03-11-2006, 03:10 PM
I mean, over the entire period of time.
Posted by Integer, 03-11-2006, 03:12 PM
Mines Up!!!!!!!!!!!!!!!
Posted by Integer, 03-11-2006, 03:15 PM
Yay only 22 hours exactly.
Posted by Tina J, 03-11-2006, 03:51 PM
So, what was wrong with your server that it didn't come back up until they manually rebooted it for you? --Tina
Posted by layer0, 03-11-2006, 03:56 PM
30 servers a box? Umm...what?
Posted by thefast, 03-11-2006, 04:10 PM
What i still don't understand is that there isn't more information like : - Why did the problem happen ? - How come there was no backup solution ? - How come it took so many hours for the servers to get up ? Ours took 16 hours. - What will be the refund to the customers ?
Posted by jimpoz, 03-11-2006, 04:28 PM
I'm back up and running.
Posted by Ryan Smith, 03-11-2006, 05:37 PM
24 hours and counting. Im ready to move on.
Posted by MrMcGoo, 03-11-2006, 05:53 PM
Your up...just clicked your link....(assuming that it is on the DedNow server)
Posted by Tina J, 03-11-2006, 05:54 PM
His site appears to be hosted @ the planet. --Tina
Posted by MrMcGoo, 03-11-2006, 06:15 PM
Soon as I hit submit I knew I should have looked...that is what happens when you are up till 5 am and only get a nap before your back at it......
Posted by jayglate, 03-11-2006, 07:03 PM
All tickets with downed servers in them are up except a handful with more severe hardware/software problems but those clients have been notified and we are in contact with them.
Posted by Ryan Smith, 03-11-2006, 08:29 PM
We only have 1 server at dedicatednow, and we just got it monday. Correct, the rest of our servers are at ThePlanet. Im just waiting for space to be available at theplanet, so then I can just order another server form there, and keep away form Dnow and HIV. 26 hours and still counting. No replies to anything!
Posted by jayglate, 03-11-2006, 08:57 PM
Currently, SSX we have no open tickets about downed servers, which is what i mentioned a few hours ago in my other post. So resubmit a new ticket please.
Posted by Alex, 03-11-2006, 09:04 PM
Looks like my host is down now, seems to have gone down 3/11/2006 at 4 PM EST. Tried calling them, no answers =/
Posted by Ryan Smith, 03-11-2006, 09:06 PM
Just came back up. Thanks guys, however, I still plan to move back to theplanet with my other servers, when they have more room. I'll jest see how it goes on from here. So far the uptime is 21.74% since Monday, when I got the servers.
Posted by jayglate, 03-11-2006, 09:12 PM
We will be makng a full annoucnment on what happened in OUR forums sometime moday. Would like to thank all our understanding customers and appreciate the patience you showed during this time of frustration for us all.
Posted by Alex, 03-11-2006, 09:21 PM
Nevermind, server is fine now... looks like named died, but that doesn't explain why I wasn't able to SSH to it. Oh well.
Posted by layer0, 03-11-2006, 09:37 PM
If you were using the hostname to SSH to it...then of course it won't work...if you were using the IP then I don't know..however.
Posted by Integer, 03-12-2006, 12:42 AM
My host will have to tell me when they learn from DN what happened.
Posted by jayglate, 03-12-2006, 08:58 PM
you do realize Theplanet had a whole UPS blow up and fail on them right? Which caused a simliar type of outage just that it affect a much smaller porition of their client base than our because of the size difference.
Posted by a1mint, 03-13-2006, 01:27 PM
What the (*&&#? My server was down last Friday for like 4+ hours, and now on Monday, my server is down, again? This smells like Webpipe all over again. Server goes down, and no knowledgable tech guy that undertands the particular virtual server technology. My server is one of those JVDS UML things. These days, hosting companies use things like Virtuozo and other commercial packaged solutions. I have the feeling that dedicatednow wants to screw off the existing customers that are still on UML. Please, someone, or someone from DN please convince me I'm completely off. You now have a choice: a) fix my problem, get my server back up, explain what went wrong, and how this won't happen again. b) tell me that I am on an outdated VPS solution, and give me a new IP address on the newer current flavor of VPS technology. This will still piss me off, because you weren't upfront, but at least I can recover fairly quickly. c) casually cause my server to fail over and over until I go away. Are you sure you want to p%ss off a customer? d) completely ignore everything. Are you you sure you want to go that route?
Posted by jayglate, 03-13-2006, 04:10 PM
Do u have a ticket open If so pm it to me.
Posted by a1mint, 03-13-2006, 05:21 PM
I'm pretty sure that something is up with WHT. All day, when I searched for "dedicatednow", this thread would *not* show up in the search results. Now all of a sudden it does. Am I going nuts, or what the *&^ is up around here? As for my server after Friday very long outage. Monday, today, it went down again. I had to ask them to reboot. I don't think they do even basic monitoring to see if a VM is up or not. I am right on this, until further notice.
Posted by BrandonSCSN, 03-20-2006, 11:53 PM
Does anyone know where the official announcement is posted? Is it only over on DNOW forums?
Posted by Douglas, 03-21-2006, 02:14 PM
It's on our forums under "Network Issues"
Posted by mahinder, 03-22-2006, 05:42 AM
Here is the thread. I have been with dedicatednow/pegasus since last 6 years and this has happened for the first time. Jason and dedicatednow crew is just fantastic. http://forums.dedicatednow.com/showthread.php?t=3428
Posted by greetingsc, 03-22-2006, 10:44 AM
Douglas or Jay, How do VPSColo customers get into the dedicatednow forums? ---------------- Michael Card genesisnetsolutions.com
Posted by Tina J, 03-22-2006, 10:50 AM
Log into the HelpDesk area and activate your Forums account. --Tina
Posted by greetingsc, 03-22-2006, 10:53 AM
Tina, What helpdesk area? ---------------- Michael Card genesisnetsolutions.com
Posted by Patrick, 03-22-2006, 06:29 PM
https://customer.dedicatednow.com/
Posted by BrandonSCSN, 03-22-2006, 08:43 PM
Rather suprised that FITX never made an announcement in VPSColo / JVPS customer forums, since they were affected also, and have no access to the DedicatedNOW system.