opensrs / tucows [merged]

Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > opensrs / tucows [merged]

Posted by SickNTired, 06-13-2010, 02:41 PM
is completely dead. with absolutely no information provided to customers and resellers. anyone know what's up? it's been this way since at least 9am this morning central time. horible.
Posted by allsimple, 06-13-2010, 02:43 PM
I cant connect to the management or reseller site either, I was logged into the domain management site earlier.
Posted by SickNTired, 06-13-2010, 02:46 PM
the entire operation has been offline since this AM including email hosting & DNS services for its related customers. even the "network status" page is down. does anyone know what's up? did the datacenter get bombed?
Posted by allsimple, 06-13-2010, 02:48 PM
I've just looked on twitter it says:
We're currently experiencing network issues that are affecting OpenSRS Domains, SSL, and Storefront. We've continuing to investigate.

I've also just received an email from them.
Posted by SickNTired, 06-13-2010, 02:50 PM
can you post the email? i didnt get it. probably because my email is routed through the (Down) tucows servers
Posted by allsimple, 06-13-2010, 02:52 PM
Here you go:

Quote:

Hi there -

OpenSRS services are currently unavailable. We have been experiencing a high traffic load for approximately 2 hours. All of our technical teams are fully engaged and investigating.

Services affected include:

Domains Provisioning and Management
Managed DNS
SSL
Storefront
http://opensrs.com
http://status.opensrs.com
Email Cluster A

If you are using our DNS for your email services, you may experience degraded services. Provisioning may also be affected. Email Cluster B is unaffected.

Our senior executive team is engaged and working to obtain details. We apologize for the inconvenience to you and your customers.

PLEASE NOTE: As our main communication channels, including http://status.opensrs.com are also affected, we will be providing messages via email and our twitter account http://twitter.com/@opensrsstatus will have regular updates.

The OpenSRS Team

Posted by ben_lucier, 06-13-2010, 03:04 PM
Hi folks... Ben Lucier here from Tucows / OpenSRS. We're working on it and will have an update shortly. For realtime updates, you can see our Twitter account at http://www.twitter.com/opensrsstatus

Thanks folks, sorry for the inconvenience.

-B
Posted by allsimple, 06-13-2010, 03:54 PM
Hey SickNTired,
I've just had another email,

Core part:

Quote:

We continue to experience network-related issues that have led to offline and degraded services.

However, the OpenSRS System Status portal has been restored and we are again providing real-time service availability updates via OpenSRS System Status.

Posted by allin1, 06-13-2010, 04:17 PM
Seems that they have some trouble, all info is welcome.
Posted by ben_lucier, 06-13-2010, 04:24 PM
You've probably noticed that services are beginning to respond normally. Mail services on cluster A have been restored to online status, and we're leaving domains service status in degraded while our engineers continue to probe and test.

Sorry if this has caused any inconvenience folks.

-Ben
Posted by SickNTired, 06-13-2010, 08:52 PM

Quote:

Originally Posted by ben_lucier

Sorry if this has caused any inconvenience folks.

-Ben

Ben,

with all due respect... IF? the entire operation was offline for half a day. what happened to back ups???
Posted by ben_lucier, 06-13-2010, 09:03 PM

Quote:

Originally Posted by SickNTired

Ben,

with all due respect... IF? the entire operation was offline for half a day. what happened to back ups???

A fair comment, Sick. I really just wanted to keep you in the loop as much as I was able during the incident. But I should have been more mindful of the words I chose.

We're compiling an incident report that covers the event that should be completed by tomorrow end of day. If you email me at blucier-at-opensrs-dot-com, along with your reseller name, I'll make sure you get a copy.

I'm also happy to arrange a phone call where we can have a follow-up discussion too.

Very sorry for the inconvenience this has caused you (and everybody else on this thread).

Warm regards,
-Ben