BlackLotus 100% Down.

Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > BlackLotus 100% Down.

Posted by MAXZEUS, 04-02-2013, 06:35 PM
At 2013/03/31, they've had a downtime due to a 100 Gbps DoS/DDoS they reiceved in their whole network.

Here we are at 2013/04/02, and you can see, the http://www.blacklotus.net website is not even working.

If you try to access the support area : http://support.blacklotus.net you will also notice that it is not working.

Not only that, all our dedicated servers are offline again.

Is anyone else noticing this ? I am asking, because the quality is very poor the last days.

They make an offer saying they protect you against any attack without limits, but as we can see, there are limits and they are being shown right now.
Posted by (Stephen), 04-02-2013, 06:46 PM
Are you sure you are not blocked by their firewalls? They are both up here.
Posted by CGotzmann, 04-02-2013, 06:47 PM
What exactly do you expect?
Nothing is 100% impervious to a DDoS. When you deal with DDoS, expect to have service impact at times.

Also, yes, the site is loading fine for me.
Posted by Dedispec, 04-02-2013, 06:56 PM
I haven't seen any issues yesterday or today on my end.
Posted by pleydesigns, 04-02-2013, 07:10 PM
From my understanding of that GEO Graphical DDOS attack the other day most of the west coast was impacted. Even video game servers at Blizzard Entertainment where affected by it. They had notices posted on the World of Warcraft login screens stating that they where dealing with poor internet weather outside of their networks which was impacting play for many users. Blizzard wasn't even in the data center that was hit, but every where around the attack was affected. Even I had issues making any connection to my servers on that side of the country from Arizona.

So for the short time that Black Lotus went down, versus how large the attack was, I think they did very well on minimizing downtime.
Posted by Flapadar, 04-02-2013, 07:29 PM

Quote:

Originally Posted by pleydesigns

From my understanding of that GEO Graphical DDOS attack the other day most of the west coast was impacted. Even video game servers at Blizzard Entertainment where affected by it. They had notices posted on the World of Warcraft login screens stating that they where dealing with poor internet weather outside of their networks which was impacting play for many users. Blizzard wasn't even in the data center that was hit, but every where around the attack was affected. Even I had issues making any connection to my servers on that side of the country from Arizona.

So for the short time that Black Lotus went down, versus how large the attack was, I think they did very well on minimizing downtime.

That's more likely a large list of fibre cuts on the west coast of the US in recent weeks. Re-routing traffic round cuts while they're being fixed can easily cause unexpected saturation in otherwise normally ok links.

Blacklotus's panel loads for me - slowly, but it loads. Their mitigation system is probably under strain if they're getting an attack that big; a few seconds delay in a web page load shouldn't be a huge surprise when looking at 100Gbps
Posted by IRCCo Jeff, 04-02-2013, 07:32 PM
We are actively investigating a serious network incident and will provide more details once root cause is firmly established.
Posted by YDomer, 04-02-2013, 07:46 PM
I'll agree with OP when he says they seemed 100% down just earlier today, I couldn't reach anything of theirs. It seemed to only last about 10 minutes though.

Overall I haven't really had many reliability issues with their service though.

Will wait for them to post more information.
Posted by MAXZEUS, 04-02-2013, 08:31 PM
Hello,

Yeah now the services are back, hope on the issue being solved !
Posted by Jcink, 04-02-2013, 10:00 PM
You can't really fault them too hard for the 100Gbps attack on all their users either. "Without limits" is obviously within reason, come on now, taking it a little too literally.

I have cloud service with Blacklotus and generally for me the uptime and service has been stellar. I've been with other providers that don't even care to post an update or announcement for 10 to 30 minutes of downtime. While this incident was annoying, at least open about it and are trying to address it.
Posted by IRCCo Jeff, 04-02-2013, 10:04 PM
This fault has been isolated to an edge router that was malfunctioning. This same edge was carrying our nLayer transit, so any customer coming into our network from nLayer was impacted by severe packet loss or effectively an outage.

The problematic router has been quarantined from our network and we are opening a case with JTAC to investigate.

We will be making a formal announcement with our preliminary findings.
Posted by MAXZEUS, 04-02-2013, 10:25 PM

Quote:

Originally Posted by Jcink

You can't really fault them too hard for the 100Gbps attack on all their users either. "Without limits" is obviously within reason, come on now, taking it a little too literally.

I have cloud service with Blacklotus and generally for me the uptime and service has been stellar. I've been with other providers that don't even care to post an update or announcement for 10 to 30 minutes of downtime. While this incident was annoying, at least open about it and are trying to address it.

Hello,

I don't disagree on the service quality or anything.

But come on, when advertising something, just advertise it in a reasonable way, because most 'newbies' on this market, will just believe on this 'as is', and it is not too good, when their expectatives face a 'come on, it is not this way, it is too literally'.
Posted by IRCCo Jeff, 04-02-2013, 10:34 PM
Advertised limits are theoretical, naturally all networks has discrete capacities and the amount of capacity that a customer has access to will depend on the account and contract.
Posted by MAXZEUS, 04-02-2013, 10:48 PM

Quote:

Originally Posted by IRCCo Jeff

Advertised limits are theoretical, naturally all networks has discrete capacities and the amount of capacity that a customer has access to will depend on the account and contract.

Sure, but why this has to be said only when the customer questionate it ?

Do you see what i mean ? You know how marketing works, people buy from what they see, most of them won't questionate anything.

We know majority companies like to play this type of game, although considering the amount of reputation the brand 'Black Lotus' represent, it would be nice, seeing it having a 'plus' and not depending on this type of 'strategy'.
Posted by IRCCo Jeff, 04-02-2013, 10:49 PM
I understand your point. We try to make this clear by labeling the individual packages to a specific protection level. When a customer requests something higher, contractually, it is spelled out in black and white.
Posted by YDomer, 04-03-2013, 12:07 AM
Everything was working good for a bit but I'm experiencing some really high load times for support.blacklotus.net pages, and my cloud server is pretty much unusable. Seems like a SAN issue... Tons of errors being barfed out about file system operations taking too long
Posted by IRCCo Jeff, 04-03-2013, 06:08 AM

Quote:

Originally Posted by YDomer

Everything was working good for a bit but I'm experiencing some really high load times for support.blacklotus.net pages, and my cloud server is pretty much unusable. Seems like a SAN issue... Tons of errors being barfed out about file system operations taking too long

We had to resyncronize the cloud SANs several hours ago. This was a separate issue from the router outage.

Please open a ticket if you are still having trouble with your VM.
Posted by Jcink, 04-03-2013, 08:01 AM
I had problems as well last night, but my VM is running fine this morning, so thanks.