Overnight data warehouse rebuild incomplete
Incident Report for PowerSchool Products
Resolved
Data warehouses are confirmed to be completing as expected and we continue to monitor the nightly uploading of data.
Posted Oct 04, 2021 - 17:58 PDT
Update
The data warehouse did not complete the refresh for most districts last night. We did not restart the refresh of the data warehouse as the process takes several hours to complete and would make your warehouse unavailable for most of today. If you require the warehouse to be updated today, please submit a support case to atrieve.technology@powerschool.com and we will begin the process.
Posted Sep 28, 2021 - 09:18 PDT
Update
We are continuing to monitor for any further issues.
Posted Sep 22, 2021 - 16:54 PDT
Monitoring
We continue to monitor the nightly warehouse updates.
Posted Sep 22, 2021 - 16:53 PDT
Investigating
Not all of the data warehouses completed their automatic build process last night (Tuesday night/Wednesday morning). We are currently running the process for each affected district this morning.

Although we have identified the symptoms causing the problem, we continue to investigate and work to resolve the root cause impacting the data warehouses' ability to complete overnight.
Posted Sep 22, 2021 - 07:23 PDT
Monitoring
We have identified a potential root cause that impacted the warehouse build process last night. We will be completing an emergency change at 3:00PM Pacific and do not anticipate any disruptions.

At this time, all Finance and HR warehouses are accessible and some Payroll warehouses are available. We will review the results of the upcoming change and monitor the warehouse build process scheduled for tonight.
Posted Sep 21, 2021 - 14:44 PDT
Update
We are continuing to investigate the root cause for the data warehouse incident. The majority of warehouses are rebuilt and available, and we are continuing to rebuild the incomplete ones. Due to the amount of data that needs to be refreshed for the incomplete warehouses, this process will continue to run through the day and warehouse data will come online as completed.
Posted Sep 21, 2021 - 11:02 PDT
Update
We are continuing to investigate this issue.
Posted Sep 21, 2021 - 09:41 PDT
Investigating
If you are a district that subscribes to our warehouse application, the data warehouse build last night has not been completed for some districts. We are actively investigating the root cause and working to rebuild the warehouses at this time. Due to the volume of data that needs to be transferred to the warehouses, the process to complete the rebuilds will take several hours. We will provide more information as our investigation continues.
Posted Sep 21, 2021 - 09:40 PDT
This incident affected: Atrieve (HOST02, HOST03, HOST04, HOST05, HOST06, HOST07, HOST08, HOST11, HOST12, HOST13, ADS03, ADS04, ADS05, ADS06, ADS07, ADS08).