The root cause upstream has been fixed and the secondary incident on our end (our Envoy cluster got into a permanently "circuit broken" state and needed a reboot) has been mitigated, so we are declaring this incident to be resolved.
We will continue to work to understand the degenerate behavior in our load balancing layer and implement a more permanent fix so that this does't recur.
Posted Nov 07, 2020 - 06:34 PST
Monitoring
We have rolled out a fix to the issue that arose after the initial connectivity issue was fixed. Traffic looks to be stabilizing, and we are seeing things return to normal.
Posted Nov 07, 2020 - 06:16 PST
Investigating
Hello, the outage has escalated and is now affecting more users. The team is online and working the incident.
Posted Nov 07, 2020 - 06:03 PST
Identified
We have identified an issue between two of our upstream providers and are working to understand the problem. Both providers are online and joining the investigation, but it appears to be a connectivity issue between them.
Posted Nov 07, 2020 - 05:54 PST
Investigating
We are aware of some anomalies in user traffic right now that appear to be affecting a small percentage of user traffic (i.e., some small percent of users are unable to access Discord right now). We are online and investigating.