Outage on EU-4

Incident Report for Platform.sh

Postmortem

Overview

On June 20th, at 20:11 UTC, an incident was declared for the (eu-4) region. There was scheduled maintenance being performed that included a brief outage for every project however this outage lasted longer than expected.

Maintenance announcement: https://status.platform.sh/incidents/scsm9yy84sdy

What Happened

At 19:01 UTC, scheduled maintenance commenced on the region as planned. By 19:50 UTC reports of outages began to arrive. The central coordination layer on the region was affected and as a result several components had to be restarted to bring the services in the region back online.

Further actions and procedural changes are being made to prevent maintenances from affecting the coordination layer.

Impact

The incident impacted all projects on the region. By 21:15 UTC most projects had returned to normal operating levels. The longest observed outage lasted for 1 hour and 30 minutes.

Posted Jul 01, 2022 - 14:34 UTC

Resolved

This incident has been resolved.

Posted Jun 20, 2022 - 22:48 UTC

Monitoring

A fix has been implemented and we are monitoring the results.

Posted Jun 20, 2022 - 21:38 UTC

Identified

The issue has been identified and a fix is being implemented.

Posted Jun 20, 2022 - 20:44 UTC

Update

We are continuing to investigate this issue.

Posted Jun 20, 2022 - 20:27 UTC

Investigating

We have detected an issue affecting service for production sites on the EU-4 region. We are currently working to restore service.

Posted Jun 20, 2022 - 20:11 UTC

This incident affected: Europe (West 4) (eu-4.platform.sh).