[Piano Analytics] Delays for some scheduled reports

Incident Report for Piano Software

Postmortem

Incident explanation:

An "out of memory" issue on some services caused a delay in the sending of DQ2 exports.

Actions performed:

Services have been restarted.

Actions to come:

No more action needed.

Posted Oct 03, 2022 - 14:51 UTC

Resolved

The issue has been resolved and all exports have been sent.

Posted Oct 03, 2022 - 14:51 UTC

Investigating

We are currently experiencing delays in the generation of some Dataquery 2 scheduled exports.
Our technical teams are working to resolve this issue so that these exports may be sent as soon as possible.
We apologise for any inconvenience caused.

Affected customers - Less than 1%

Posted Oct 03, 2022 - 08:27 UTC