This incident has been resolved. All flows have been successfully recovered.
Posted Dec 19, 2022 - 23:48 UTC
Monitoring
At 5:31PM EST a fix for the infrastructure that executes campaigns was implemented. The new infrastructure is now live and processing jobs in a normal, stable state. We expect all campaign sends that were delayed to be recovered in say an hour.
Newly sent flows are processing normally as expected
Posted Dec 19, 2022 - 22:59 UTC
Identified
At 3:13PM EST the infrastructure that executes campaigns began experiencing degradation impacting flows, data feed exports, and our legacy journeys product. Our team identified the symptom and addressed it, but there was a subsequent recurrence which is now being addressed via a deeper infrastructural remediation.
We expect delays of messaging to be not longer than 3 hours in total before all campaigns are back on track.
Posted Dec 19, 2022 - 22:03 UTC
This incident affected: Simon Event Trigger Flows and Simon Data Syncs.