Minor Issue - Edge Functionality - LAX Production (not SL4)

Incident Report for Cornerstone

Postmortem

On October 7th, 2024 Cornerstone engineers were alerted by internal monitoring tools for errors across for Edge services. Customers hosted across LAX SL1,SL2,SL3 & SL5 PRD were having intermittent issue while accessing Edge Import feature on their portal.

Cornerstone engineers were immediately paged to respond to the issue. To remediate the latency, engineers recycled application pools and reset underlying application servers to resume normal operation.

To mitigate this situation from occurring in the future and to reduce the risk of a future impact Cornerstone is actively working internally to review the incident. Internal discussions have been held with the appropriate teams to avoid the recurrence of this incident.

Posted 7 months ago. Oct 16, 2024 - 16:21 PDT

Resolved

The CSOD Technology Team observed a performance degradation affecting this swimlane. The problem began at 11:01 am Pacific Time and was resolved at 12:35 Pacific Time. During this time, clients with portals on this swimlane may have experienced intermittent errors while accessing the Edge Functionality within the application.

Posted 8 months ago. Oct 07, 2024 - 13:14 PDT

Monitoring

A fix has been implemented and we are monitoring the results.

Posted 8 months ago. Oct 07, 2024 - 12:27 PDT

Investigating

LAX Production (not SL4) swimlanes are experiencing some functional issues with Edge. Clients with portals in this swimlane may experience errors accessing "Edge Import and Feeds", delays, or issues executing some tasks. This is our top priority and we are working to resolve the problem as soon as possible. Please check back periodically for additional updates, which will be posted as they become available.

Posted 8 months ago. Oct 07, 2024 - 11:25 PDT

This incident affected: LAX-SL1 (Uptime), LAX-SL2 (Uptime), LAX-SL3 (Uptime), and LAX-SL5 (Uptime).