3z Canada Etobicoke Location Power outrage

Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > 3z Canada Etobicoke Location Power outrage

Posted by amlife, 07-09-2013, 09:00 AM
Hello everyone

This is just to note that 3z Canada Etobicoke Location is currently out of power, they ran out of fuel! building has been without power for the past 12 hours or so.

2 major outages in 1 month!

I'm taking my stuff out of there!
Posted by MooreAdmin, 07-09-2013, 12:45 PM
It was pretty much mayhem all over the GTA last night with the storm. We had outages at 3 of the 4 data centers we host at in Toronto.

Outages in Cologix @ 151 Front when the cooling took a dump. Plus the outage this morning at 3z Etobicoke (4 hours) and another at ***** Host (still no info).

Attempting to drive to Etobicoke last night was pretty crazy, the 427 was pretty much a river, a few cars floating around. Turned back and failed equipment over to another location just incase.

Fun day for sysadmins, good luck to all in the aftermath!
Posted by Coolraul, 07-09-2013, 01:19 PM
Ya it was crazy in Toronto. We literally tripled the record for rainfail in a day for the region. I can't comment on other outages but this one hit several providers.
Posted by lonea, 07-09-2013, 01:44 PM
You can't fault them for this one.

Quote:

Originally Posted by amlife

Hello everyone

This is just to note that 3z Canada Etobicoke Location is currently out of power, they ran out of fuel! building has been without power for the past 12 hours or so.

2 major outages in 1 month!

I'm taking my stuff out of there!

Posted by NetDepot - Terrence, 07-09-2013, 02:20 PM
Seem like a huge hydro one issue, the city is currently asking residents to reduce power usage until they can get a major sub station back on-line because of flooding. This ever hit Pearson intl airport last night and they had to switch to backup power.
Posted by Adam-AEC, 07-09-2013, 02:24 PM
3z @ 151 Front recovered fairly quickly. I had barely sent out the notice that we were on generator power when we were switched back onto utility.

I didn't record any service interruption, and with the cooling failure we saw a minimal increase in temperatures.

Hope everybody is able to recover from the flooding - I'm just over an hour away from downtown Toronto (without traffic) and I was bbq'ing/sitting on the patio while this was happening. Very strange.
Posted by NetDepot - Terrence, 07-09-2013, 05:20 PM

Quote:

Originally Posted by Adam-AEC

3z @ 151 Front recovered fairly quickly. I had barely sent out the notice that we were on generator power when we were switched back onto utility.

I didn't record any service interruption, and with the cooling failure we saw a minimal increase in temperatures.

Hope everybody is able to recover from the flooding - I'm just over an hour away from downtown Toronto (without traffic) and I was bbq'ing/sitting on the patio while this was happening. Very strange.

I'm also about the same distance west of Toronto, no rain in my area but Mississauga was a totally different story. Not even Environment Canada seen this coming. very strange indeed.
Posted by Kevin, 07-09-2013, 06:17 PM
on one hand there is an argument to be more forgiving due to the circumstances, but at the same time was this really so extreme as to explain being unable to fuel the tanks? I recently watched the video peer1 put up on how they fueled their facility during hurricane sandy.

I colo with multiple companies at 151front, and they all had cooling issues due to the enwave problem, enough that I had some servers shutdown due to thermal thresholds.

it makes me consider moving everything from 151Front to 20 Pullman court if I had a better solution for bandwidth. I put a cogeco wave in between the sites, but it would be too scary to depend on that, and it just keeps becoming more costly to maintain a switching pop in cologix.
Posted by NetDepot - Terrence, 07-09-2013, 08:18 PM

Quote:

Originally Posted by Kevin

on one hand there is an argument to be more forgiving due to the circumstances, but at the same time was this really so extreme as to explain being unable to fuel the tanks? I recently watched the video peer1 put up on how they fueled their facility during hurricane sandy.

I colo with multiple companies at 151front, and they all had cooling issues due to the enwave problem, enough that I had some servers shutdown due to thermal thresholds.

it makes me consider moving everything from 151Front to 20 Pullman court if I had a better solution for bandwidth. I put a cogeco wave in between the sites, but it would be too scary to depend on that, and it just keeps becoming more costly to maintain a switching pop in cologix.

If your running mission critical systems its not a good idea to have your stuff with these guys if storm knocks everything off line including backup power.