Amazon Aws have announced that the issue is now resolved.
via https://status.aws.amazon.com/ 4:00 AM PST: We have restored all traffic to Kinesis Data Streams via all endpoints, and have resolved the error rates invoking CloudWatch APIs. All services are now operating normally. We have identified the root cause of the Kinesis Data Streams event, and have completed immediate actions to prevent recurrence.
Posted Nov 26, 2020 - 14:08 CET
Update
We are continuing to monitor for any further issues.
Posted Nov 26, 2020 - 11:55 CET
Monitoring
Update on the AWS outage:
VideoAsk is now able to process (transcode) video/audio through AWS, although high volume customers may experience some level of throttling. This throttling will also affect the speed at which we can process the backlogged queue of video answers and replies that are currently waiting to get transferred to accounts. As for new answers and replies, this seems to be operating normally, however, we will continue monitoring closely.
Update from https://status.aws.amazon.com/ : Previous Update (6:23 PM PST): We’d like to provide an update on the issue affecting the Kinesis Data Streams API, and other dependent services, within the US-EAST-1 Region. We have now fully mitigated the impact to the subsystem within Kinesis that is responsible for the processing of incoming requests and are no longer seeing increased error rates or latencies. However, we are not yet taking the full traffic load and are working to relax request throttles on the service. Over the next few hours, we expect to relax these throttles to previous levels. We expect customers to begin seeing recovery as these throttles are relaxed over this timeframe.
Posted Nov 26, 2020 - 07:05 CET
Update
We are continuing to await a resolution on the AWS outage.
Rest assured, we have all the video response data that is continually being collected. We just can't transcode videos for return delivery. Video replies are also held up in the same queue at the moment.
Here is an update from AWS:
10:47 AM PST: We continue to work towards recovery of the issue affecting the Kinesis Data Streams API in the US-EAST-1 Region. For Kinesis Data Streams, the issue is affecting the subsystem that is responsible for handling incoming requests. The team has identified the root cause and is working on resolving the issue affecting this subsystem.
The issue also affects other services, or parts of these services, that utilize Kinesis Data Streams within their workflows. While features of multiple services are impacted, some services have seen broader impact and service-specific impact details are below.
Updated information on the AWS outage: We're still waiting for AWS to bring back up the part of their service affecting VideoAsk. At the moment we are not able to transcode videos. We are however still collecting RAW video and will be able to reprocess (and send into your accounts) once the outage is over.
Posted Nov 25, 2020 - 16:46 CET
Identified
The incident has been identified and is unfortunately related to an outage on Amazon AWS. AWS have annouced that the issue has been escalated to the highest possible priority.
Posted Nov 25, 2020 - 16:15 CET
Update
We are continuing to investigate this issue.
Posted Nov 25, 2020 - 16:10 CET
Update
We are continuing to investigate this issue.
Posted Nov 25, 2020 - 16:04 CET
Investigating
Currently investigating an issue affecting the API and webhooks
Posted Nov 25, 2020 - 15:56 CET
This incident affected: API and Website, Web App and videoasks.