Linode Connectivity Issues - London

eva2000 · Dec 31, 2015

Dec 31, 12:32 UTC
Identified - We've detected a large DoS attack targeting our London datacenter and are working with our upstream provider to mitigate the attack. Users will likely experience packet loss and problems with connectivity to Linodes in London.

Continue reading...

eva2000 · Dec 31, 2015

ouch @Matt not fun !

I think Fremont, CA for this forum is feeling some of it too !

Xon · Dec 31, 2015

Another round of the attackers slamming Dallas (and thus Linode automation/website) and a pile of their other data centres. IMO, this looks like someone is attacking a particular website and then ensuring the primary target can't then migrate/spin up new VMs on Linod by attacking massive amounts of Linode infrastructure.

eva2000 said: ↑

I think Fremont, CA for this forum is feeling some of it too !
Click to expand...

Linode Status - Connectivity Issues - Fremont

Fremont is also being hit.

eva2000 · Dec 31, 2015

yeah and timing during the holidays doesn't help

Xon said: ↑

Linode Status - Connectivity Issues - Fremont

Fremont is also being hit.
Click to expand...

ah explains it

If they want to survive, it's a when not if Linode and it's upstream provider(s) roll out DDOS protection across their networks

Skippy · Dec 31, 2015

Linode have been getting hit pretty hard they really need to look into some form of DDOS protection.

I have not been able to load their main website for the past 24 hours at least the linode manager loads hahaha.

Matt · Jan 1, 2016

I'm configuring a public cloud instance with OVH and I'm going to migrate away from Linode once I have access again

ModeltogTossen · Jan 1, 2016

Yeah - Some of my own task first thing in the new year, was to switch over to linode.. Because of all of @eva2000 post about this disruption in services - I'm not so sure for now.. Maybe I just should stay at Vultr, DigitalOcean and own dedicated server at Ovh.. My wish was to terminate Vultr and DO and have 1-2 linode instead..

Thanks for your info, @eva2000, about the Linode disuption on various DCs..

eva2000 · Jan 1, 2016

from Linode http://status.linode.com/incidents/mmdbljlglnfd

I’d like to share some updates about the recent DDoS attacks.

I am one of several network engineers at Linode. All of us have been working around the clock on DDoS mitigation. While things are stable, I would like to take a moment to publicly address the large and frequent DDoS attacks that we have been receiving since Christmas Day.

It has become evident in the past two days that a bad actor is purchasing large amounts of botnet capacity in an attempt to significantly damage Linode’s business. The following is a partial list of attacks we have received in no particular order:

- Multiple volumetric attacks simultaneously directed toward all of our authoritative nameservers, causing DNS hosting outages
- Multiple volumetric attacks simultaneously directed toward all of our public-facing websites, causing Linode Manager outages
- Layer 7 (“400 bad request”) attacks toward our web and application servers, causing Linode Manager outages
- Large volumetric attacks toward our colocation provider’s upstream interconnection points, overwhelming the router control planes and causing significant congestion/packet loss
- Large volumetric attacks toward Linode network infrastructure, overwhelming the router control planes and causing significant congestion/packet loss

All of these attacks have occurred multiple times. Over the course of the last week, we have seen over 30 attacks of significant duration and impact. As we have found ways to mitigate these attacks, the vectors used inevitably change.

As of this afternoon, we have mostly hardened ourselves against the above attack vectors, but we expect more to come. We are working extremely closely with all of our technical partners, including our network equipment vendors and our colocation providers, to prevent future attacks.

Once these attacks stop, we plan to share a complete technical explanation about what has been happening. Additionally, we will be announcing the details of an ongoing project to significantly improve our internet connectivity and resiliency.

We would like to apologize for the lack of detail in some of our recent status-page updates. Please know that we are dedicating all resources from multiple departments to stopping these attacks. We acknowledge the amount of downtime we’ve been experiencing is completely unacceptable, and we appreciate the understanding and support we have received over the past several days. We will share more information as our investigation continues.

Alex Forster
Network Engineer at Linode
Posted on Dec 31, 22:23 UTC
Click to expand...

Xon · Jan 1, 2016

They had to post something publically, this has been too large of an outage.

eva2000 · Jan 1, 2016

Indeed they probably already lost many customers confidence in them already and that is hard to regain. For me, a web host is only as good as after their last incident. So if they take measures to prevent this in future, they'll only get better

Additionally, we will be announcing the details of an ongoing project to significantly improve our internet connectivity and resiliency.
Click to expand...

This will be interesting I just hope it isn't something like isolating and hardening just their management, api and site's network from customers.

eva2000 · Jan 1, 2016

Linode ain't only one attacked - probably different folks Powerful DDoS Attack Shuts Down All BBC Websites - DigitalMunition ?

Log in / Register

Forums

Welcome to Centmin Mod Community

Linode Connectivity Issues - London

eva2000 Administrator Staff Member

eva2000 Administrator Staff Member

Xon Active Member

eva2000 Administrator Staff Member

Skippy New Member

Matt Well-Known Member

ModeltogTossen I wish I could??

eva2000 Administrator Staff Member

Xon Active Member

eva2000 Administrator Staff Member

eva2000 Administrator Staff Member

.

Log in / Register

Useful Searches

Welcome to Centmin Mod Community

Linode Connectivity Issues - London

eva2000 Administrator Staff Member

eva2000 Administrator Staff Member

Xon Active Member

eva2000 Administrator Staff Member

Skippy New Member

Matt Well-Known Member

ModeltogTossen I wish I could??

eva2000 Administrator Staff Member

Xon Active Member

eva2000 Administrator Staff Member

eva2000 Administrator Staff Member

.