Seeing increased latencies in event triggered campaigns

Incident Report for Blueshift

Resolved

The latencies have been stabilized, event-processing, and campaigns are functional again. We are looking at additional long-term strategies to mitigate the risk of related latencies.

Posted Oct 21, 2022 - 21:43 PDT

Monitoring

We have slowly ramped traffic back up and are monitoring the fix, latencies have reduced and stabilized.

Posted Oct 21, 2022 - 20:01 PDT

Identified

We have identified the latency issue and are working to recover our systems.

Posted Oct 21, 2022 - 19:30 PDT

Investigating

We have paused event-triggered and segment-triggered campaigns

Posted Oct 21, 2022 - 17:34 PDT

This incident affected: Event processing & API and Segment-Triggered Campaigns.