Degradation Partial on BLiP
Incident
Report for Blip
Resolved
This incident has been resolved.
Investigating
Fault identified:
During our monitoring we identified that there was a sudden increase in the number of requests in the database that stores message contexts trafficked in all bots.
This environment underwent an update in a cleaning routine, it had a processing bottleneck that increased the number of requests, causing slow sending of messages in Bots.
Please validate, and if you identify any failure scenario, please give us a feedback.
Impact:
Customers noticed bots slow and failed when exchanging messages.
Solution:
The cleaning routine that was running was suspended. I emphasize that our team acted quickly to circumvent the scenario and consumption was fully normalized. We continue to monitor the system.
Note: The information is now being placed on our Status Page. As identification was quick as well as resolution, the update on the page will be available soon.
Yours sincerely,
Start date/time: 16/09/2021 2:45 PM
End date/time: 16/09/2021 3:03 PM
During our monitoring we identified that there was a sudden increase in the number of requests in the database that stores message contexts trafficked in all bots.
This environment underwent an update in a cleaning routine, it had a processing bottleneck that increased the number of requests, causing slow sending of messages in Bots.
Please validate, and if you identify any failure scenario, please give us a feedback.
Impact:
Customers noticed bots slow and failed when exchanging messages.
Solution:
The cleaning routine that was running was suspended. I emphasize that our team acted quickly to circumvent the scenario and consumption was fully normalized. We continue to monitor the system.
Note: The information is now being placed on our Status Page. As identification was quick as well as resolution, the update on the page will be available soon.
Yours sincerely,
Start date/time: 16/09/2021 2:45 PM
End date/time: 16/09/2021 3:03 PM
This incident affected: Channels (WhatsApp, Telegram, Messenger, BlipChat, Workplace Chat, BusinessChat, Skype, E-mail), Hosting Business (Bot Builder, Bot Router), Blip Platform (CRM, Core, Analytics, Artificial Intelligence, Portal, Cloud Infrastructure), Desk, and Hosting Enterprise (Bot Builder, Bot Router).