Impact:
5 - Very high
Description & Scope of incident
All outgoing traffic was not passing through after a network/route preventing transactions from being processed in the timeframe 14:40 - 15:20
Analysis of Incident
A planned network change was implemented in the network infrastructure. This caused all outgoing traffic to the internet and 3rd party connections to fail while all incoming traffic was working as expected.
Our monitoring system was not set up to trigger an alarm on this exact scenario which caused a delay in detecting the issue.
Remedial Action
As soon as the root cause was identified the network change was reverted.
Mitigation plan: