Our metrics indicate that the agent report rate has recovered to the level before the incident. We believe most customer agents have resumed normal reporting and the issue has been resolved. If you continue to encounter issues, please email support@skylight.io for assistance. Unfortunately, if your agent was "locked out" from an expired authentication and was unable to report data during the outage, that unreported data will not be available to view on the dashboard. We are truly sorry about this.
Posted Jan 02, 2022 - 09:57 PST
Monitoring
We have manually uploaded a new cert, have completed the migration and are monitoring the situation.
The Skylight dashboard (skylight.io) should be immediately accessible. If you are still unable to access the site, please email support@skylight.io for assistance.
Your Skylight agents should resume reporting data once it retries the previously failed authentication request. If this does not occur, you can try restarting your app, which would force the agent to restart and authenticate again. If that still doesn't work, please email support@skylight.io for further help.
We are very sorry for the trouble.
Posted Jan 02, 2022 - 09:40 PST
Identified
The Skylight dashboard is inaccessible currently due to a configuration issue. This outage also impacted agent authentication – new authentications from agents will not succeed at the moment. Agents that are already authenticated can continue to report data until the authentication session expires.
The data processing pipeline is technically unaffected by this outage as it is hosted on a different provider. However, given that agents are failing to authenticate (and therefore failing to submit traces), we expect this to cause lapses in Skylight data during the outage period.
Posted Jan 02, 2022 - 09:37 PST
This incident affected: Website (Application, Hosting).