Authentication issues affecting all products
Incident Report for Tink
Postmortem

Introduction

On May 30th 2022, Tink experienced an outage between 12:21 and 13:05 (CET) affecting the availability of the components responsible for end-user authentication. Successively, these components continued to experience degraded performance affecting usage intermittently until 14:15 (CET)

Root Cause Analysis

The root cause of this outage was a change deployed by one of our engineering teams which affected several underlying services responsible for end-user authentication.

Remediation

After the changes were deployed, monitoring alerts for the underlying failing services were triggered and our engineering teams started investigating the issue. 

To bring the service back to an operational state, the team rolled back to a previous working version and restored the availability of our products at 13:05. At 14:15 service was fully restored after the faulty changes were identified and reverted.

Follow-up actions

As a consequence of this incident we will focus on the following actions to prevent similar scenarios from occurring again:

  • Introducing additional stages of verification before a service is deployed into production
  • Additional verification routines for changes where multiple services will be deployed as a consequence of changes to shared functionality
Posted Jun 03, 2022 - 15:56 CEST

Resolved
This issue has been resolved. We apologize for this inconvenience.
Posted May 30, 2022 - 14:19 CEST
Monitoring
The issue has been identified and we have applied a solution.

The service is currently recovering and we are actively monitoring the situation.
Posted May 30, 2022 - 13:05 CEST
Investigating
We are currently investigating an issue while authenticating. All products are affected.
Posted May 30, 2022 - 12:39 CEST
This incident affected: Payments, Account Check, Transactions, Business Account Check, Business Transactions, Income Check, Risk Insights, Money Manager, Business Manager, and Other.