LeaseWeb (Wuppertal) third time DOWN - in 2 days - Knowledgebase

Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > LeaseWeb (Wuppertal) third time DOWN - in 2 days

LeaseWeb (Wuppertal) third time DOWN - in 2 days

Posted by xeno007, 05-24-2012, 01:54 PM
It seems like LeaseWeb (their Wuppertal datacenter, old NetDirekt) has again connectivity issues. This one is third downtime in 2 days, one was planned, two not planned. Each of the downtimes were around 1 hour, the current downtime already passed 1 hour and still counting.
Anyone has more info what is going on? They are not sharing anything, except for their comments like this:
At the moment we experience an outage in (part of) our network. We are currently investigating and taking appropriate steps.
which doesn't say much.
Posted by xeno007, 05-24-2012, 02:37 PM
They are finally back and their reason for the downtime is same as the previous time: The reason for outage was bgp sessions dropping caused by overload of the router most probably by an attack.

Although I think they messed something up during the firmware upgrade of the router (the scheduled downtime).
Posted by F-DNS, 05-24-2012, 04:39 PM
Why the sarcasm overload? Obviously LeaseWeb cannot tell you what's wrong until they investigate, and then when they do they put it down to an incoming attack. Hardly something they can predict and, fortunately, something they corrected as quickly as they could. LeaseWeb aren't exactly shy to admit if they have something wrong with their equipment or are performing maintenance (see http://leasewebnoc.com/en/maintenance) and always send out a notify as soon as they detect a problem, so why try to make it into something it wasn't?

And, for info, the outage was partial. Our nodes at LeaseWeb DE have been fine today. So I guess it was an attack on a part of their network, and not something more sinister like you want to suggest
Posted by xeno007, 05-24-2012, 05:08 PM
Sarcasm? Nah. Angry a bit? Yes I am, 3 downtimes in 2 days of 1 hour each who wouldn't make angry? I get it, someone that isn't influenced at all by the downtimes ))
Seriously, I am angry because they started to happen way often, and me and my customers towards me are losing the patience.
Concerning the attack... it's copy-paste from here: http://leasewebnoc.com/en/networkstatus/804
They aren't sure at all if it was an attack. Just say probably.
Anyway, one more such downtime and I "most probably" will move all of my servers elsewhere. I have to, my customers are expecting actions from me, just as I expect actions from LeaseWeb.
Posted by F-DNS, 05-24-2012, 05:19 PM

Quote:

Originally Posted by xeno007

I get it, someone that isn't influenced at all by the downtimes ))

I would be if we'd been affected - I guess we got lucky today.
I only mentioned that we weren't affected so that you could see it was something on part of the network, like an attack, rather than a "global" outage if the router had burped like you were hinting at.

Quote:

Originally Posted by xeno007

They aren't sure at all if it was an attack. Just say probably.

So you could pop a ticket in to support@ and ask them to bump it to the network guys in the morning with a request for a fuller explanation.

Quote:

Originally Posted by xeno007

Anyway, one more such downtime and I "most probably" will move all of my servers elsewhere. I have to, my customers are expecting actions from me, just as I expect actions from LeaseWeb.

Everywhere gets attacked sometime or other. At least with LeaseWeb they get the notifies out quickly and the remedy as soon as they can. Works for me
Posted by xeno007, 05-24-2012, 06:29 PM
Here we go again, another downtime, "most probably" another attack.
This is not fun at all.
Posted by F-DNS, 05-24-2012, 06:40 PM
No problems at all here, I just happened to be logged into a node in Atlanta when your post came through so I pinged our stuff straight away...

Quote:

Node 1:

25 packets transmitted, 25 received, 0% packet loss, time 24005ms
rtt min/avg/max/mdev = 107.636/108.005/111.214/0.831 ms
[root@atlanta ~]#

Node 2:

26 packets transmitted, 26 received, 0% packet loss, time 25002ms
rtt min/avg/max/mdev = 110.008/110.112/110.548/0.422 ms
[root@atlanta ~]#

Got a ticket in?

Edit: If you want me to ping your IP(s) just in case it's specific to you feel free to post it or PM me and I'll let you know
Posted by xeno007, 05-24-2012, 07:07 PM

Quote:

Originally Posted by F-DNS

No problems at all here, I just happened to be logged into a node in Atlanta when your post came through so I pinged our stuff straight away...

It came back 15 minutes after the previous post.

Quote:

Originally Posted by F-DNS

Got a ticket in?

Nope, I want to let them work on the problem. Why would I need a ticket when they publicly aknowledge their problem: http://leasewebnoc.com/en/networkstatus

Quote:

Originally Posted by F-DNS

If you want me to ping your IP(s) just in case it's specific to you feel free to post it or PM me and I'll let you know

No need for that, Pingdom notifies me, my customers notify me, I verify the problem myself... It's not specific to me at all
Posted by F-DNS, 05-24-2012, 07:44 PM
I apologise but I'm not really following your logic

Quote:

Originally Posted by xeno007

It came back 15 minutes after the previous post.

My reply with the pings is timestamped 11 minutes after your post. I probably did those pings around 6 or 7 minutes after your post - On the way here I did a quick check of our 6 monitoring systems to make sure they also said Frankfurt was fine, and a quick ping from Leaseweb Amsterdam in case it was on their DC to DC link - All fine.

Quote:

Originally Posted by xeno007

Nope, I want to let them work on the problem. Why would I need a ticket when they publicly aknowledge their problem: http://leasewebnoc.com/en/networkstatus

That was last updated 6 hours ago with an "all clear". You don't want to put a ticket in and I don't see a bunch of other people here saying "we're down too" but you're happy to assume they're working on a problem which may be specific to you, the switch you're on, or a small segment of their customer base who aren't reporting a problem?

Quote:

Originally Posted by xeno007

No need for that, Pingdom notifies me, my customers notify me, I verify the problem myself... It's not specific to me at all

At the moment it appears (to me anyway) that it's specific to you as no-one else is chiming in saying they also have an issue. But I respect your opinion and bid you good night - hope it all works out for you
Posted by xeno007, 05-24-2012, 07:52 PM
Dude, chill. I don't see the logic in defending them when they acknowledge the problem.

(Part of us) we are having a problem. If you're not in that group, I don't get it why you must take part in this thread.
Posted by F-DNS, 05-24-2012, 08:06 PM

Quote:

Originally Posted by xeno007

(Part of us) we are having a problem. If you're not in that group, I don't get it why you must take part in this thread.

Because your first post said this...

Quote:

Originally Posted by xeno007

It seems like LeaseWeb (their Wuppertal datacenter, old NetDirekt) has again connectivity issues.

The "Node 2" I posted a ping to above is ex Netdirekt (Wuppertal) and it's not had a problem all day. Add to that that it's also got one of our monitoring scripts on it and it's monitoring 35+ locations worldwide and not gone into sudden meltdown saying it can't connect to them.

So whilst LeaseWeb are confirming they had some sort of issue there earlier today, it certainly wasn't Wuppertal-wide, it's not apparently ongoing, yet you seem to think that it is in some way and they're still working on it?

Fair enough