Cornerstone Status - Minor Issue - Latency

Minor Issue - Latency - UK-SL1 PROD

Incident Report for Cornerstone

Postmortem

On June 5th, 2022 Cornerstone engineers were alerted by internal monitoring tools for portal latency and availability issues. . Clients hosted in UK Prod swimlane experienced latency and portal availability issues intermittently for a brief time.

Cornerstone engineers were engaged for investigation and troubleshooting and issues pointed to the storage availability. This was temporarily resolved by adding additional nodes and reducing the workload on servers.

To mitigate this situation from occurring in the future and to reduce the risk of a future impact Cornerstone is actively working internally to review the incident with the vendor. Internal teams are working with our third-party vendors to establish the issue and conducting a thorough investigation and creating remediation plans and capacity planning to avoid the recurrence of this incident.

Posted Jun 12, 2022 - 22:51 PDT

Resolved

The CSOD Technology Team observed a performance degradation affecting this swimlane. The problem began at 6.30pm Pacific Time and was resolved at 7.02pm Pacific Time. During this time, clients with portals on this swimlane may have experienced slow performance or intermittent errors while accessing the application.

Posted Jun 05, 2022 - 19:29 PDT

Update

The CSOD Technology Team observed a performance degradation affecting this swimlane. The problem began at 6.30 pm Pacific Time and was resolved at 7.02 pm Pacific Time. During this time, clients with portals on this swimlane may have experienced slow performance or intermittent errors while accessing the application.

Posted Jun 05, 2022 - 19:27 PDT

Investigating

The swimlane is experiencing some latency issues. Clients with portals in this swimlane may experience delays or issues accessing certain pages in the application. This is our top priority and we are working to resolve the problem as soon as possible. Please check back periodically for additional updates, which will be posted as they become available.

Posted Jun 05, 2022 - 19:03 PDT

This incident affected: UK SL1 (AWS) (Uptime).