BURSTNET: Electrical Maintenance - 7/27/2007 - Knowledgebase

Portal Home > Knowledgebase > Articles Database > BURSTNET: Electrical Maintenance - 7/27/2007

BURSTNET: Electrical Maintenance - 7/27/2007

Posted by HostJedi, 07-27-2007, 06:55 AM
AS WAS NOTIFIED TO OUR CLIENTELE: BurstNET Maintenance Staff is nearing completion of installing additional power capacity in the BurstNET facility. The additional capacity includes the following equipment; Powerware 225KVA UPS, Detroit Diesel 580KW Generator, Russelectric 800AMP Automatic Transfer Panel, and MGE & Liebert 225KVA PDUs. IMPORTANT: Due to the initial electrical service installation/layout in the facility completed 4-5 years ago, which was never expected to grow/expand to such a level as required today, it will be necessary for BurstNET to shut off power to a large portion of the BurstNET facility to rewire the power system. BurstNET is scheduling this outage to occur during a maintenance window of 7AM to 11AM EST on Friday July 27th 2007. The outage is expected to occur sometime after at 7:00AM EST, and last 2-3 hours, however a 4-hour maintenance window has been allotted in case of delays or issues. The outage is not expected to affect the BurstNET Core Network, Virtual/Shared Hosting, VPS Hosting, Backup Services, or Wireless/Dedicated/Dial-Up Service. A portion of BurstNET Co-location and Dedicated Server clientele will be affected, which are utilizing the majority of the capacity on the portion of the facility power which is undergoing maintenance. BurstNET will have extra staff on hand to handle reboots following the maintenance. This maintenance window has been scheduled at a time of day to have the least affect on the operations of the overall BurstNET client base. A weekend procedure was not an option due to outside parties involved in performing such maintenance. On Thursday July 26th 2007, prior to this maintenance window, BurstNET will be performing load/transfer testing on the new equipment. It is expected that the tests will all clear, however, should something fail that cannot be remedied immediately, the maintenance window for the following day of Friday July 27th 2007 will be postponed. Final notification will be sent out Thursday afternoon confirming or postponing Friday's maintenance window, after final testing has been performed. We thank you for your patience and understanding, as well as for your continued business. . .
Posted by John[H4Y], 07-27-2007, 08:32 AM
If anyone who is affected by this would like to report when they come back online, that would be helpful to us so we know when to start bugging the Burst.net staff
Posted by HostJedi, 07-27-2007, 08:43 AM
We'll be updating this thread, as well our own forums, so you know the power is back online, and when to issue reboot tickets :-) . .
Posted by WhiteBear, 07-27-2007, 10:01 AM
forum is downtime.
Posted by nofz, 07-27-2007, 10:44 AM
still offline here.
Posted by sebby, 07-27-2007, 11:01 AM
Well, its 11:00am and yet everything is down despite the announced maintenance window... Can we get an update?
Posted by WhiteBear, 07-27-2007, 11:03 AM
Already 195 minutes had occurred. Please, Burst how much time still must delay to decide the problem? Thanks,
Posted by John[H4Y], 07-27-2007, 11:09 AM
My associate was told they were still on schedule about 8 minutes before 11am, but they said it may be 11am - 11:15am when power is restored at this point. Hopefully 11:15am does not come and go as well.
Posted by glace, 07-27-2007, 11:17 AM
11:15...still down. Most likely when it comes back on some servers will not come back online and it will take another 3 or 4 hours for them to reboot all those servers.
Posted by sebby, 07-27-2007, 11:28 AM
Now would be a good time!
Posted by cbwass, 07-27-2007, 11:33 AM
I have a server back up 1min. ago.
Posted by glace, 07-27-2007, 11:35 AM
One of my servers came back for thirty seconds but went down right afterwards. Seems to be going up and down right now...
Posted by HostJedi, 07-27-2007, 11:36 AM
Power was restored and equipment has been rebooting for a bit now. Give it a little time, and if your service is not restored, please open a reboot ticket. . .
Posted by matrafox, 07-27-2007, 11:37 AM
one server up and running
Posted by sebby, 07-27-2007, 11:47 AM
Still off-line here !
Posted by John[H4Y], 07-27-2007, 12:15 PM
We are back online. I must admit, network performance for the past month or two has been acceptable and this upgrade was done CLOSE to as well as it could be, with proper notification, and they ALMOST even hit the deadline of 11am. Knowing how nothing ever goes as planned when it comes to technology, I was really expecting to have issues all day long *knock on wood*. I am hoping this is a sign that Burst.net has turned the page towards really being able to have a reliable and valueable service. Thank you Burst.net!
Posted by sebby, 07-27-2007, 12:18 PM
Still down here... How much time can it take to manually reboot all machines?
Posted by HostJedi, 07-27-2007, 12:22 PM
<< and they ALMOST even hit the deadline of 11am. >> Yes, it was close...but we actually started about 30-45 minutes late...so outage was the same amount of time expected overall, just a little off schedule... :-) . .
Posted by sebby, 07-27-2007, 12:24 PM
Is anyone still down?
Posted by HostJedi, 07-27-2007, 12:55 PM
Staff is currently going thru and checking machines manually that did not come back online yet. System shows only 35 or so left to go. Definitely open reboot ticket if not back up yet, if you have not done so already... . .
Posted by Kran, 07-27-2007, 02:20 PM
My server 66.96.219.117 still down. Sadly good customer just moved out 11 sites from our server
Posted by Mekhu, 07-27-2007, 09:16 PM
ummm.... anyone else still offline? My techs have been trying to call and submit tickets for almost 4 hours now.
Posted by Mekhu, 07-27-2007, 09:31 PM
I'm just confirming that we are indeed still offline. Our box is unpingable. Helpdesk tickets have been ignored for almost 4 hours now and phone calls/voicemails seem to be ignored as well.
Posted by HostJedi, 07-27-2007, 09:36 PM
Mekhu, Your ticket was opened in the Windows Support dept, not as a Reboot ticket. I've transferred it to the proper dept and that should be attended to you promptly. . .
Posted by Mekhu, 07-27-2007, 09:43 PM
I will accept that as my fault, but regardless, 4 hours? Last edited by Mekhu; 07-27-2007 at 09:52 PM.