The incident has been resolved. We have verified content is restored in a sample of client accounts that reported issues. If you have any further issues, please flag them to support.
Posted May 02, 2020 - 07:03 EDT
Monitoring
A fix has been implemented and we are monitoring results. Clients should begin to see all missing content in galleries, and within their content dashboard.
Posted May 02, 2020 - 06:36 EDT
Update
We are continuing to work with Amazon on resolution of the issue. They have completed their analysis and have specific recommendations, which we are reviewing and will implement over the next 12-18 hours.
Posted May 01, 2020 - 21:20 EDT
Update
We are continuing to work with Amazon Web Services tech support, who manages our ElasticSearch cluster, to resolve the problem.
Posted May 01, 2020 - 16:56 EDT
Update
We have verified the issue is due to a replication problem between nodes of our Elastic Search cluster. We are working with Amazon Web Services tech support, who manages that system for us, to resolve the problem. In the interim, some clients may see missing content restored, but that may be intermittent, until the underlying issue is resolved.
Posted May 01, 2020 - 14:37 EDT
Identified
We are continuing to investigate, but have identified a potential cause in our Elastic Search cluster.
Posted May 01, 2020 - 13:20 EDT
Update
We have verified all the missing content is in our database. The problem is in the API layer. We are continuing to investigate.
Posted May 01, 2020 - 11:35 EDT
Investigating
Some user generated content is not being displayed in galleries, and in the content management dashboard. This is affecting multiple clients. We are investigating.
Posted May 01, 2020 - 11:07 EDT
This incident affected: Experiences and Platform (Content Management).