Waitlist Partner APIs are experiencing infrastructure degradation

Incident Report for Yelp Developer APIs and Services

Postmortem

On 6/7, 2022, some partners started experiencing occasional errors and increased latency while using Waitlist Partner APIs.

This incident is mainly caused by the internal infrastructure degradation that affected our service. During this time, our service received 54206 requests. Based on the evaluation, this incident was categorized as a major impact due to a high percentage of the requests were affected by this incident. That is 2386 of the total incoming requests.

By 16:06 pm PST, the fix was implemented to this particular issue and we started seeing the status of our service going back to the normal position.

The actual duration of this incident is between 13:15 pm and 16:06 pm PST.

We are truly sorry for the inconvenience and thank you very much for bearing with us! Now Waitlist Partner APIs is fully operational. Please feel free to reach out waitlist-api-support@yelp.com for any concerns or questions.

Posted 3 years ago. Jun 07, 2022 - 17:01 PDT

Resolved

The incident has been resolved. The total time span of this incident is from 13:25 pm PST to 16:55 pm PST today.

A postmortem is on its way to provide detailed information about this incident.

Posted 3 years ago. Jun 07, 2022 - 16:56 PDT

Update

The error has been mitigated and we are seeing the performance is going back to normal. Will keep monitoring to make sure this is clear. Next update is expected within 30 mins.

Posted 3 years ago. Jun 07, 2022 - 16:36 PDT

Update

The error has been mitigated and we are seeing the performance is going back to normal. Will keep monitoring to make sure this is clear. Next update is expected within 30 mins.

Posted 3 years ago. Jun 07, 2022 - 15:59 PDT

Monitoring

The error has been mitigated and we are seeing the performance is going back to normal. Will keep monitoring to make sure this is clear. Next update is expected within 30 mins.

Posted 3 years ago. Jun 07, 2022 - 15:32 PDT

Identified

The root cause of this incident has been identified and a fix is under implementation. Next update is expected within 30 mins.

Posted 3 years ago. Jun 07, 2022 - 15:07 PDT

Update

We are still investigating the root cause and will have update in 30 mins.

Posted 3 years ago. Jun 07, 2022 - 15:01 PDT

Investigating

Beginning around 14:00 pm PST, we identified our service is having an increasing number of operation failures across all functionalities. All APIs are expected to be affected by this incident. We are on it! Next update is expected within 30 mins.

Posted 3 years ago. Jun 07, 2022 - 14:39 PDT

This incident affected: Waitlist Partner APIs (Waitlist APIs, On My Way APIs, Loyalty APIs, Reservation APIs).