AWS - US East (N. Virginia): SI-20210210
Incident Report for Snowflake
Postmortem

Dear Customer,
Snowflake Engineering has completed the postmortem of this service incident. A detailed Root Cause Analysis is made available on the Snowflake Community site.

https://community.snowflake.com/s/article/SI-20210210

We apologize for the service incident and the impact on your applications.

If you have any questions or difficulty accessing the Snowflake community site, please send feedback by submitting a support case or calling Snowflake Technical Support.

Thank you,
Snowflake Support

Posted Mar 02, 2021 - 13:57 PST

Resolved
The Service Incident is now closed.

A Root Cause Analysis (RCA) will be posted within the next ten business days.

We apologize for the inconvenience caused by this incident.

If you have any questions or experience any related issues, please open a support case via the Snowflake Community Site.
Posted Feb 10, 2021 - 17:52 PST
Monitoring
Our Cloud Service Provider AWS has rolled-out the fix to resolve the issue with Private Link connectivity.

Symptom(s): Cannot Connect to Snowflake using Private Link
Incident Start Time: 12:00 PT February 10, 2021
Incident End Time: 16:45 PT February 10, 2021

Snowflake engineering is now monitoring the system for any further recurrence of the problem. We will remain in this state for 60 minutes.

If you have any questions or experience any related issues, please open a support case via the Snowflake Community Site.
Posted Feb 10, 2021 - 16:50 PST
Update
Our Cloud Service Provider AWS continues to rollout the fix to resolve the issue. Snowflake engineering continues to see a steady increase in traffic via the Private Link.

Symptom(s): Cannot Connect to Snowflake using Private Link
Incident Start Time: 12:00 PT February 10, 2021

We will update the status as soon as the issue is resolved or provide an update within 60 minutes.
Posted Feb 10, 2021 - 15:47 PST
Update
Our Cloud Service Provider AWS continues to rollout the fix to resolve the issue. Snowflake engineering continues to see a steady increase in traffic via the Private Link.

Symptom(s): Cannot Connect to Snowflake using Private Link
Incident Start Time: 12:00 PT February 10, 2021

We will update the status as soon as the issue is resolved or provide an update within 30 minutes.
Posted Feb 10, 2021 - 15:18 PST
Update
Our Cloud Service Provider AWS continues to rollout the fix to resolve the issue. Snowflake engineering continues to see a steady increase in traffic via the Private Link.

Symptom(s): Cannot Connect to Snowflake using Private Link
Incident Start Time: 12:00 PT February 10, 2021

We will update the status as soon as the issue is resolved or provide an update within 30 minutes.
Posted Feb 10, 2021 - 14:52 PST
Update
Our Cloud Service Provider AWS has applied a fix to resolve the issue, and the rollout of the fix is underway. Snowflake engineering observed a steady increase in traffic via the Private Link and expect to see a full recovery soon.

Symptom(s): Cannot Connect to Snowflake using Private Link
Incident Start Time: 12:00 PT February 10, 2021

We will update the status as soon as the issue is resolved or provide an update within 30 minutes.
Posted Feb 10, 2021 - 14:24 PST
Update
AWS has confirmed that the fix to resolve the issue is working as expected and it is currently being deployed. We expect to see recovery as they progress through the affected Availability Zones.

Symptom(s): Cannot Connect to Snowflake using Private Link
Incident Start Time: 12:00 PT February 10, 2021

We will update the status as soon as the issue is resolved or provide an update within 30 minutes.
Posted Feb 10, 2021 - 13:56 PST
Update
Our Cloud Service Provider AWS has identified the issue with Network Load Balancers impacting Snowflake Private Link connectivity and is in the process of testing a fix to resolve the issue.

Symptom(s): Cannot Connect to Snowflake using Private Link
Incident Start Time: 12:00 PT February 10, 2021

We are working on mitigating the problem. We will update the status as soon as the issue is resolved or provide an update within 30 minutes.
Posted Feb 10, 2021 - 13:24 PST
Identified
We have identified the issue with Private Link connectivity issue caused by a Network Load Balancers problem within our Cloud Service Provider AWS environment. Snowflake engineering is working with AWS to mitigate the issue.

Symptom(s): Cannot Connect to Snowflake using Private Link
Incident Start Time: 12:00 PT February 10, 2021

We are working on mitigating the problem. We will update the status as soon as the issue is resolved or provide an update within 30 minutes.
Posted Feb 10, 2021 - 13:00 PST
Investigating
We are investigating an issue with one of the Snowflake services.

Symptom(s): Cannot Connect to Snowflake using Private Link
Incident Start Time: 12:00 PT February 10, 2021

We will provide more information on the problem investigation status as soon as we have identified the problem or provide an update within 30 minutes.
Posted Feb 10, 2021 - 12:33 PST
This incident affected: AWS - US East (N. Virginia) (Snowflake Data Warehouse (Database)).