SoftLayer Dallas - Server Room 5 Power Anomolies - Knowledgebase

Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > SoftLayer Dallas - Server Room 5 Power Anomolies

SoftLayer Dallas - Server Room 5 Power Anomolies

Posted by MikeDVB, 10-03-2009, 12:59 AM
SoftLayer Dallas is experiencing power anomolies in Server Room 5 affecting two of our servers and I've seen a couple of other providers mention it.

http://www.screen-shot.net/ss/7648891299266248083.png
Posted by AquariusStorage, 10-03-2009, 01:11 AM
Two servers hit here as well
Posted by MikeDVB, 10-03-2009, 01:21 AM
All of our servers are back online, one for about 20 minutes and the other just came back online.

It was a failed PDU it seems.
Posted by hotpass105, 10-03-2009, 09:27 AM
My server apparently is in Server Room 5, but never went offline. (According to PingDom)
Posted by Speckz, 10-03-2009, 12:11 PM
Our server is still down unfortunately.
Posted by Speckz, 10-03-2009, 12:32 PM
Just came back up about 15 minutes ago.
Posted by Timothy, 10-04-2009, 11:43 AM
Our server room 5 servers are down again today....same issue.

Internal monitoring started going off about 25 minutes ago.

SL portal is showing that it's the same issue.

----
Date: 10-04-2009
Start time (CDT): 06:20
Services Affected: Dallas, TX - Public Network
Device: Other
Location: dal01
Duration: Emerging Issue
Description: [start - 10:20] SoftLayer engineers have detected power anomalies in server room #5 in Dallas (sr05.dal01). The Emergency Response Team has been notified and engineers are working to identify and resolve the issue. As the situation unfolds, more information will be available via the emergency communication center inside the public and private portal. Due to the high volume of tickets and calls that may arise during this issue, delays may occur as engineers work to quickly and efficiently communicate all information. We appreciate your patience and cooperation. Updated information will be posted as soon as it becomes available.

[update - 10:25] It would appear the same PDU (power distribution unit) that feeds several rows of servers has gone offline again. Engineers are working to bring it back online. More updates will follow when available.

Sincerely,
SoftLayer Emergency Response Team
https://status.softlayer.comDate:
-----
Posted by AquariusStorage, 10-04-2009, 01:16 PM
And its once again hit us again as well, taking out our VPS nodes... yay for the hour its going to take for it to bring all of the containers back up at least per server...

Cheers...
Posted by hotpass105, 10-04-2009, 02:13 PM
I just cancelled my Dallas, TX server and bought one in WDC. If I get downtime there I'm leaving Softlayer.
Posted by gdtechind, 10-04-2009, 03:04 PM
I would also prefer to leave Dallas.
Posted by Scott.Mc, 10-04-2009, 03:33 PM
Luckily have no systems in the dallas server room 5. Problem is though we intentionally avoid seattle as this has been very unstable in the past 12 months and also has had power and network outages (several) so now it's pretty much narrowed down to washington.

I am sure SL will correct the issue however and provide a full and detailed RFO.
Posted by MikeDVB, 10-04-2009, 03:57 PM

Quote:

Originally Posted by hotpass105

I just cancelled my Dallas, TX server and bought one in WDC. If I get downtime there I'm leaving Softlayer.

These two instances are the only instances we've experienced in Dallas over the last two years... What is irritating is that the same PDU failed twice in three days...

It needs to be fixed the first time so that it doesn't fail again imho.

http://www.screen-shot.net/ss/457528539749499144.png
Posted by Moonster, 10-04-2009, 04:04 PM
wow, all of this is crazy. best luck getting everything running again guys.