Issues with background jobs
Incident Report for AlexisHR
Postmortem

This error was connected to a background service called RabbitMQ. The services effected by this error where mainly connected to messaging (Slack and emails) resulting in missed notifications and errors.

Known errors:

  • Slack app returning errors even though requests went through
  • Slack notifications not being sent
  • Time off requests not being confirmed but still being sent

Closer and more thorough monitoring is being implemented to this service to prevent this from effecting any services in the future.

Posted Mar 21, 2022 - 14:01 CET

Resolved
This incident has been resolved.
Posted Mar 21, 2022 - 11:36 CET
Monitoring
A fix has been implemented and we are monitoring the results.
Posted Mar 21, 2022 - 09:42 CET
Identified
The issue has been identified and a fix is being implemented.
Posted Mar 21, 2022 - 09:35 CET
This incident affected: Public API and Slackbot.