We have monitored services for 30 minutes post incident resolution and have confirmed systems are back at normal operational capability and are closing this incident.
Our banking partner has confirmed they experienced a degradation in a compute node associated with PayId registration and de-registration when bringing NPP services back up post planned maintenance which affected service resumption between 12:28AM and 12:54AM, and caused a degradation in our ability to process queued de-registration events due to a prolonged backlog of requests. We were able to fully process this backlog and resume services by 1:13AM.
This issue occurring within the planned maintenance window of 12:00 am to 5:00 am but outside of our planned outage window between 12:15AM and 12:30 communicated in https://status.azupay.com.au/incidents/6jkvwk9p4q53.
Thank you for your patience as we worked on resolving this issue.
Regards, the Azupay Team.
Posted Mar 14, 2024 - 02:01 AEDT
Monitoring
The PayId de-registration queue has been cleared and payId registration has been re-enabled. We are now monitoring to confirm normal system operations.
Posted Mar 14, 2024 - 01:14 AEDT
Identified
The issue causing errors has been resolved and a backlog of payment de-registrations are being processed.
During this process we have paused registration of new PayIds and expect to be able to re-enable PayId registrations by 1:20.
Posted Mar 14, 2024 - 01:06 AEDT
Investigating
Post planned outage we are experiencing issues with De-registration of PayId aliases and have delayed re-enabling alias registrations for new PayIds. We have now enabled PayId registration and are investigating with our banking partner regarding the degradation of De-registrations of PayIds.