Ongoing intermittent issues with message sends

Incident Report for Discord

Resolved

This incident has been resolved.

Posted Sep 01, 2021 - 00:45 PDT

Monitoring

Search APIs have been re-enabled, however we are still processing a backlog of messages. We expect full recovery in roughly 1 hour.

Posted Sep 01, 2021 - 00:32 PDT

Update

Message sending is stable, however we are still working on recovering our search workloads.

Posted Sep 01, 2021 - 00:03 PDT

Update

We have temporarily disabled Message Search to relieve pressure from impacted services.

Posted Aug 31, 2021 - 23:35 PDT

Identified

We have identified an upstream issue with our provider that is causing impact to our storage systems. We have a war room spun up and are engaging with them to identify the issue and remediate.

Posted Aug 31, 2021 - 23:21 PDT

This incident affected: Search.