Google Sync errors

Incident Report for Cronofy

Resolved

Google API calls began to error at abnormally high rates from 17:49 UTC.
Upon investigation, we did not find a common factor or pattern behind the failures but kept investigating and engages some fallback mechanisms to keep the platform stable.

We began to find other reports of Google API issues, ultimately having this confirmed by Google:
- Google Workspace incident: https://www.google.com/appsstatus/dashboard/incidents/Eab7zGLWSaUJyh9c9R9L
- Google Cloud incident: https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW#2c2sBHWU84yPDJ8y1ar4

We continued to monitor the system and confirmed that calendars were still syncing, albeit with occasional delays when syncs failed and had to be retried.

At 18:48 UTC, API errors dropped drastically and returned to normal operational levels.

We kept monitoring until we saw Google report the issue was resolved at 19:53 UTC.
Posted Jun 12, 2025 - 20:02 UTC

Update

We continue to see healthy syncs with Google.
However the Google incident remains open, citing that some areas have recovered but a full mitigation has not taken place yet. We are leaving this incident open to reflect that disruption may still be possible until Google confirm the issue is fully mitigated or resolved.

Google Cloud incident: https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW#2c2sBHWU84yPDJ8y1ar4
Posted Jun 12, 2025 - 19:30 UTC

Monitoring

Google API calls have recovered and most are now succeeding. We are continuing to monitor the system to ensure this pattern continues.
This issue is due to the following Google incident: https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW#2c2sBHWU84yPDJ8y1ar4
Posted Jun 12, 2025 - 18:58 UTC

Identified

Google errors are remaining elevated. We have seen reports of other services also encountering issues with Google APIs and believe this to be related. We are continuing to investigate and monitor our services to be sure. We will update in ~30 minutes time if nothing substantial changes.
Posted Jun 12, 2025 - 18:46 UTC

Update

Since 17:49 UTC we are receiving a greatly increased rate of API errors from Google. Many syncs are completing after retrying but customers may observe events taking slightly longer to appear in their calendars.
Posted Jun 12, 2025 - 18:23 UTC

Investigating

We are seeing an elevated number of errors from Google and we are investigating
Posted Jun 12, 2025 - 18:07 UTC
This incident affected: Major Calendar Providers (Google).