limestonenetworks down

Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > limestonenetworks down

Posted by wirefusemedia, 02-24-2012, 10:56 PM
Their primary website seems to be loading but their rockware portal is not loading and neither are half of my servers. I tried calling their number 877.586.0555 and it just keeps ringing and then goes to a busy signal.

Tried going on live chat, somebody said "hello" and didn't respond after that. Seems limestone is currently unreachable in every available method at their moment and their network seems to be down
Posted by Finer - Tommy, 02-24-2012, 11:01 PM
Downtime sucks, but it sucks a lot worse when there is no good communication (twitter, email, network status on website, etc).

My account specialist left me a voicemail telling me they have engineers looking into it right now, but didn't provide any insights into ETA or actual problem. Tried calling him back, but he didn't answer.

*sigh*
Posted by Lawrence Wright, 02-24-2012, 11:01 PM
Doesn't seem like they're down now. Perhaps a short maintenance?
Posted by Finer - Tommy, 02-24-2012, 11:02 PM

Quote:

Originally Posted by Lawrence Wright

Doesn't seem like they're down now. Perhaps a short maintenance?

They're definitely down. Their portal doesn't work, and half of my servers don't either.
Posted by wirefusemedia, 02-24-2012, 11:03 PM
Its still down, just their main site works Rockware down = https://rw.limestonenetworks.com/

Receiving "Ticket Created Monitoring Service LSN-Server# Offline" tickets by the boatload from them
Posted by 24shells, 02-24-2012, 11:04 PM
Partial network outage, not all servers are down but more than half are. Although their is no update on what went wrong.
Posted by kensmithzzz, 02-24-2012, 11:07 PM
The problem started approximately 8 pm to 8:10 pm Central, because I was in the middle of shell work. Hope they're back up soon.
Posted by Lawrence Wright, 02-24-2012, 11:08 PM

Quote:

Originally Posted by Finer - Tommy

They're definitely down. Their portal doesn't work, and half of my servers don't either.

My apologies, I've only checked their main website. Their CP is down.
Posted by Mike - Limestone, 02-24-2012, 11:15 PM
There is some network slowness impacting a portion of our customers. Our network engineers are working on a resolution.

I do not yet an ETA on the resolution. Thank you for your patience!

Please feel free to PM me if you prefer.

-mike
Posted by Finer - Tommy, 02-24-2012, 11:23 PM
Portal is loading for me now. Anyone having any luck with servers coming back online?
Posted by Dustin Cisneros, 02-24-2012, 11:26 PM
Same here, any ETA?

Portal finally loads for me now as well.
Posted by Kevin Hillstrand, 02-24-2012, 11:26 PM
Just got off the phone with them, they did state that this issue should be resolved within a few minutes and they have all of there engineers actively working on this.
Posted by Mike - Limestone, 02-24-2012, 11:28 PM

Quote:

Originally Posted by semoweb

Same here, any ETA?

Portal finally loads for me now as well.

It should be completely resolved very shortly. A number of the impacted customers are now reporting that everything is normal. There is still a segment of customers with the network slowness, and our engineers are working on those remaining cases now.

-mike
Posted by Dustin Cisneros, 02-24-2012, 11:38 PM

Quote:

Originally Posted by Mike - Limestone

It should be completely resolved very shortly. A number of the impacted customers are now reporting that everything is normal. There is still a segment of customers with the network slowness, and our engineers are working on those remaining cases now.

-mike

Hi Mike,

Thanks, still down from here, hope it gets sorted.
Posted by Kevin Hillstrand, 02-24-2012, 11:38 PM
Our servers with LSN still appear to be inaccessible. Please provide a more in-depth ETA.

I appreciate your time

Best,
Kevin
Posted by Finer - Tommy, 02-24-2012, 11:47 PM
Just got off the phone with them. Said they should have everything up within the next 10 to 15 minutes.
Posted by wirefusemedia, 02-25-2012, 12:04 AM
Servers seem to be coming back up 1 by 1
Posted by Mike - Limestone, 02-25-2012, 12:06 AM
The issue now seems to be completely resolved. Thank you to all impacted clients for their patience!

-mike
Posted by wirefusemedia, 02-25-2012, 12:08 AM
Why did it go down
Posted by Mike - Limestone, 02-25-2012, 12:10 AM

Quote:

Originally Posted by NanoCow

Why did it go down

Our network engineers have advised clients to open up a ticket, and we can provide an RFO once it is prepared. That should provide a full explanation.

-mike
Posted by Dustin Cisneros, 02-25-2012, 12:18 AM
Anyone having issues getting into SSH?
Posted by Mike - Limestone, 02-25-2012, 12:20 AM

Quote:

Originally Posted by semoweb

Anyone having issues getting into SSH?

I just checked with the network engineers, who are not aware of any SSH-specific issues. Please open a ticket, and Support can take a look.

-mike
Posted by Kevin Hillstrand, 02-25-2012, 12:20 AM

Quote:

Originally Posted by semoweb

Anyone having issues getting into SSH?

Yes, it appears that one of our server is hanging up after inputting password due with failure to resolve the rDNS.

Best,
Kevin
Posted by RSS-Artie, 02-25-2012, 12:21 AM
It looks like my server was not affected.
Posted by 123Andrew, 02-25-2012, 01:08 AM
FWIW we have numerous servers with LSN and none of them were affected so it seems that it may have only been a small portion of people.
Posted by Kevin Hillstrand, 02-25-2012, 01:52 AM
Everything appears to be normalized and the corrective actions have been taken by the Limestone Networks' engineers to rectify the outstanding issues we have seen

Thank you for the continued updates, LSN never fails to please

Best,
Kevin
Posted by wirefusemedia, 02-25-2012, 01:13 PM
It seems that at around 7:30AM PST this morning another partial network outage occurred which lasted for about 40 minutes
Posted by snJohn, 02-26-2012, 03:16 AM
Does anyone have an explanation for the downtime yet?

John
Posted by Ryan G - Limestone, 02-27-2012, 12:45 AM
@NanoCow
There were no further outages after 02/24/2012. Any further issues were likely isolated to your server. If you are still having issues please open a support ticket with us.

@snJohn
A RFO will be provided to clients Monday or Tuesday at the latest.
Posted by Kevin Hillstrand, 02-27-2012, 12:50 AM

Quote:

Originally Posted by Ryan G - Limestone

@NanoCow
There were no further outages after 02/24/2012. Any further issues were likely isolated to your server. If you are still having issues please open a support ticket with us.

@snJohn
A RFO will be provided to clients Monday or Tuesday at the latest.

Hi Ryan, why does it take so long to provide a simple explanation of what happened and what measures will be taken in the future to prevent this from happening in the foreseeable future?

Customers shouldn't have to wait 72 hours for an explanation of why the outage has occurred. Thank you for your time.

Best,
Kevin
Posted by bqinternet, 02-27-2012, 04:17 AM

Quote:

Originally Posted by FTN-Kevin

Customers shouldn't have to wait 72 hours for an explanation of why the outage has occurred. Thank you for your time.

I would say that up to a week is a reasonable amount of time for an official RFO, especially when a weekend is involved. The important things are that they were responsive during the issue, and that they resolved it quickly.
Posted by snJohn, 02-28-2012, 03:40 AM
Regardless of how long it should take to 'prepare an official RFO' a simple explanation would be nice so we at least have a clue what is going on with the servers. I don't care if it's the weekend or not.

John
Posted by Kevin Hillstrand, 02-28-2012, 03:49 AM

Quote:

Originally Posted by snJohn

Regardless of how long it should take to 'prepare an official RFO' a simple explanation would be nice so we at least have a clue what is going on with the servers. I don't care if it's the weekend or not.

John

I agree, it's OK to take some time for an official RFO, but at least a brief explanation of what happened would be acceptable. When it comes to issues like this weekend is irrelevant.

Best,
Kevin