The issue has been fully resolved and this incident will be updated with a postmortem in the next few days.
Posted Apr 29, 2022 - 12:35 UTC
Monitoring
A fix has been implemented, processing times have resided to normal levels and we are monitoring the results.
Posted Apr 28, 2022 - 22:34 UTC
Investigating
While we were able to resolve the initial conflict causing the slowdown to all queues, we are currently at all hands investigating a new problem with the data parsing queue moving slower than usual for all new and old documents. We will post further updates as soon as they become available.
Posted Apr 28, 2022 - 14:36 UTC
Identified
The issue has been identified and our engineers are working towards a solution.
Posted Apr 28, 2022 - 02:10 UTC
Investigating
We are investigating an issue with documents taking a longer than usual time to process through import, data parsing and integration queues, starting around 0900EDT this morning. All documents in queues will be automatically processed when the queues have died down, though this is not happening as quickly as we would like, even with updates to our server counts. We are still investigating and will update this page with any changes.
Posted Apr 27, 2022 - 21:17 UTC
This incident affected: Docparser Application, Webhook Integrations, and AWS sqs-us-east-1.