RiskLens has completed a Root Cause Analysis (RCA) related to an unplanned service outage of the RiskLens platform during the period of October 19th, 2021 and October 20th, 2021. Please contact Customer Success for a copy (success@risklens.com).
Posted Oct 24, 2021 - 18:08 PDT
Monitoring
Our platform continues to be fully operational without limitation, however, we are still in the process of restoring data for a portion of customers that had certain analyses that were conducted in the few days prior to the outage. This process should continue throughout the weekend until it is resolved. If you are an impacted customer, we will be sending further communication.
Posted Oct 22, 2021 - 15:49 PDT
Update
Our teams have been working tirelessly to bring this outage incident to full resolution. - Our platform continues to be fully accessible for new analysis work since our prior communication yesterday. You can continue to resume new analyses if you had put them on hold. - We are still in the process of restoring data for certain analyses conducted in the few days prior to the outage. That process should be completed today for customers that have reported loss of access to that data. We apologize once again for this disruption and thank you for your patience.
Posted Oct 22, 2021 - 08:32 PDT
Update
92% Complete Base restoration Verified to OCT 15th Date Time Stamp, We will be iterating through the remaining days in succession, the 16th, 17th, 18th, 19th, 20th, and today 21 Oct 2021. Time to Completion TBD
Posted Oct 21, 2021 - 14:00 PDT
Identified
The issue has been identified and a fix is being implemented.
Posted Oct 21, 2021 - 09:02 PDT
Update
We are currently in the process of restoring the data to the last backup state taken on October 19 before the outage. The engine service has been restored and new analyses can be run again. For analyses and work that existed before the outage or that were in process when the outage occurred, we recommend waiting for the full restoration of the database.
Posted Oct 21, 2021 - 09:01 PDT
Update
Full Data integrity validation is at 51%
Posted Oct 21, 2021 - 06:43 PDT
Update
Full Data integrity validation is at 38%
Posted Oct 21, 2021 - 03:13 PDT
Update
We are currently cutting off the engine API, and we are working on the restoration of the remaining databases
Posted Oct 20, 2021 - 17:43 PDT
Update
We are at a Fully operational State of functionality, over the next several hour's data from Mon and Tuesday will be populated with any data input today and any data input in the near term. We will maintain the status of Degraded Performace until all data has been synchronized and validated.
Posted Oct 20, 2021 - 14:49 PDT
Update
We are still continuing the process of RESTORING all data and databases to the most recent and current Tuesday 1900 PDT timeframe, a discrepancy in expected data and current data will continue to appear is to be expected until the full restoration of service is complete. THE FUNCTIONALITY OF THE APPLICATION IS BACK TO OPERATIONAL.
Posted Oct 20, 2021 - 14:31 PDT
Update
We are still continuing the process of updating and validating all data and databases to the most recent and current Tuesday 1900 PDT timeframe, a discrepancy in expected data and current data will continue to appear is to be expected until the full restoration of service is complete.
Posted Oct 20, 2021 - 13:34 PDT
Update
We are continuing the process of updating and validating all data and databases to the most recent and current Tuesday 1900 PDT timeframe, a discrepancy in expected data and current data will continue to appear is to be expected until the full restoration of service is complete.
Posted Oct 20, 2021 - 12:37 PDT
Update
We are in the process of updating and validating all data and databases to the most recent and current backup states, a discrepancy in expected data and current data is to be expected until the full restoration of service is complete.
Posted Oct 20, 2021 - 11:38 PDT
Update
Login Functionality fully restored, Engine functions are still offline as the integrity check is still in progress, this affects scenarios and assessments from running. Another update will be provided within the hour.
Posted Oct 20, 2021 - 10:33 PDT
Update
Login Functionality restored - Operational State verification in progress.
Posted Oct 20, 2021 - 10:09 PDT
Update
Database Integrity Check still in progress - Next steps is AAG rebuild. We will continue to update on the hour until full operational capability is restored.
Posted Oct 20, 2021 - 09:27 PDT
Update
We are doing a continuity check on all data and Databases the RTO is approx 1-2 hours.
Posted Oct 20, 2021 - 08:32 PDT
Investigating
We are currently investigating this issue.
Posted Oct 20, 2021 - 07:15 PDT
This incident affected: RiskLens 3 (RiskLens Platform).