The Cloud Service Provider experienced elevated packet loss in US-East and US-Northeast for a duration of 1 hour, 10 minutes. The analysis of the root cause and trigger for this incident was a problematic device which failed to forward certain flows correctly. This resulted in the blackholing of traffic for flows through this device. The Cloud engineers were alerted to the issue through a monitoring alert on Monday, 26 July 2021 07:40 US/Pacific and immediately started an investigation. The appropriate engineering team was engaged at 08:24 and the impact was mitigated at 08:35 by redirecting traffic to alternate devices.
Posted Jul 29, 2021 - 22:29 UTC
Monitoring
Performance degradation was observed between 7:30AM PST - 8:45AM PST today with one of our cloud providers. This resulted in intermittent connectivity issues and packet drops. The issue was identified and fixed. We will continue to monitor and work with the cloud provider to provide the root cause.
Posted Jul 27, 2021 - 00:23 UTC
This incident affected: Prisma Access (Americas-US East, Americas-US Northeast).