Portal Usage Reports Not Showing Complete Usage Data

Incident Report for PubNub

Postmortem

Problem Description, Impact, and Resolution

Our underlying data processing infrastructure provider made an unexpected configuration change which caused delays displaying customer usage data on our Admin Portal. The issue was quickly identified and fixed, and data started to be processed normally. However, the error resulted in a backlog of data processing, and to catch up on that amount of data required building more parallelization which caused further delay. By 21:12 UTC on July 16th, the data was processed and Admin Portal usage data was brought up-to-date.

This was only a data reporting issue, and there was no data loss. There was no negative effect on any other part of the PubNub platform due to this issue.

Posted Jul 22, 2021 - 16:14 UTC

Resolved

Update: We are actively processing data and the portal usage reports will now be updated by Monday evening (UTC).

The issue was fixed at 15:00 UTC. However, the Data processing is proceeding, and portal reports should be updated over the course of the next 24 hours. Therefore, we are resolving the incident but will leave the component marked as degraded and remove this designation once we have all data available in the portal.

Posted Jul 14, 2021 - 20:37 UTC

Identified

We are currently experiencing issues with our analytics data pipeline. As a result, some customers may see no or incorrect Usage Data in the Administration Portal. We are actively working on the issue and will update this page with information as we have it. Please note that no actual usage data has been lost as this only affects Admin Portal and does not affect the use of any PubNub services.

Posted Jul 14, 2021 - 18:28 UTC

This incident affected: Website and Portals (Administration Portal).