[NL-AMS1]: Networking issue
Incident Report for UpCloud
Postmortem

We want to elaborate on the challenges we had with networking in our Amsterdam data centre last weekend. 

We unfortunately were the victim of multiple, extremely large distributed denial of service (DDoS) attacks which affected networking availability in the NL-AMS1 data centre. This attack began on Friday afternoon UTC and lasted until Monday morning with intermittent pauses.

This attack was unprecendented in size and breadth as it targeted hundreds of different IPv4 addresses in the data centre. We monitored and mitigated this attack with our upstream connectivity providers.

We worked through the weekend in mitigating these attacks, as our previous approaches were ineffective due to sheer size and breadth of the attack. While we can’t publicly comment on the exact size, we can say it was in the hundreds of Gbps. 

We have communicated in detail to the customers in the NL-AMS1 data centre about the incident, but do not want to highlight specific details in public.  

Please note, we take these attacks as a form of cyber terrorism and we will also be reporting them to the Dutch and Finnish cyber security officials. We are taking more steps with our partners in building resilience to mitigate these attacks in a technical manner.

We sincerely apologise for the issues in network connectivity and thank you for your understanding.

Posted Nov 11, 2022 - 14:19 UTC

Resolved
This incident has been resolved.
Posted Nov 07, 2022 - 11:27 UTC
Identified
We have identified an issue with network connectivity in our NL-AMS1 data centre. The affected cloud servers may experience slow connections or become unreachable.
We are working to restore connectivity and resolve the situation as soon as possible.
Posted Nov 06, 2022 - 08:21 UTC
Monitoring
We have restored normal network connectivity to all affected cloud servers and will continue to monitor the situation.
If you are still unable to connect to your server(s), please contact our support via live chat or email support@upcloud.com.
We sincerely apologise for any inconveniences caused as a result of this incident.
Posted Nov 06, 2022 - 07:21 UTC
Identified
We have identified an issue with network connectivity in our NL-AMS data centre. The affected cloud servers may experience slow connections or become unreachable.
We are working to restore connectivity and resolve the situation as soon as possible.
Posted Nov 06, 2022 - 06:43 UTC
Monitoring
We have restored normal network connectivity to all affected cloud servers and will continue to monitor the situation.
If you are still unable to connect to your server, please contact our support via live chat or email at support@upcloud.com.
We deeply regret and sincerely apologise for any inconveniences caused as a result of this incident.
Posted Nov 05, 2022 - 09:04 UTC
Identified
We have identified an issue with network connectivity in our Amsterdam data centre. The affected cloud servers may experience slow connections or become unreachable.
We are working to restore connectivity and resolve the situation as soon as possible.
Posted Nov 04, 2022 - 13:38 UTC
Monitoring
We have restored normal network connectivity to all affected cloud servers and continue to monitor the situation.
If you are still unable to connect to your server, please contact our support at support@upcloud.com.
We apologise for the incident.
Posted Nov 04, 2022 - 13:31 UTC
Identified
We have identified an issue with network connectivity in our Amsterdam data centre. The affected cloud servers may experience slow connections or become unreachable.
We are working to restore connectivity and resolve the situation as soon as possible.
Posted Nov 04, 2022 - 12:37 UTC
This incident affected: NL-AMS1 - Netherlands (NL-AMS1: Network Connections).