Dashboard, API and status pages unreachable
Major outage Resolved · Dashboard
Started · Ended · Duration 44m
Updates
-
Investigating
Automatically detected — monitoring checks are failing.
-
Resolved
Automatically resolved — monitoring checks have recovered.
Postmortem
On November 9 from 03:35 to 04:19 UTC, Uptimepage did not serve any requests. The dashboard, API, MCP server and every hosted status page timed out, and heartbeat pings could not reach us. Service recovered once we restarted the affected service.
One of our services ran out of memory and stopped answering requests. Restarting it brought everything back within a minute.
- The dashboard, API, MCP server and all hosted status pages were unreachable for 44 minutes.
- Heartbeat pings sent during that time never arrived. Some heartbeat monitors opened incidents and sent alerts even though the jobs behind them were running fine.
- Some check results from that window were lost or delayed, so charts may show gaps.
- A few checks reported failures that were not real.
- Accounts, monitors, status pages and settings were not affected.
- Add safeguards so one service running out of memory can't affect the rest.
- Catch resource problems earlier.
- Fix the cause of the memory growth.
- Keep heartbeat monitors from alerting when the problem is on our side.
- Keep check results from being lost during an outage.
Published