GitHub header
All Systems Operational
Git Operations ? Operational
API Requests ? Operational
Webhooks ? Operational
Visit www.githubstatus.com for more information Operational
Issues ? Operational
Pull Requests ? Operational
Actions ? Operational
Packages ? Operational
Pages ? Operational
Codespaces ? Operational
Copilot Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Past Incidents
Jan 24, 2024

No incidents reported today.

Jan 23, 2024
We are investigating reports of degraded performance.
Resolved - On January 23, 2024 at 14:36 UTC, our internal metrics began showing an increase in exceptions originating from our live update service. Live updates to Issues, PRs, Actions, and Projects were failing, but refreshing the page successfully updated page content. We resolved the issue by rolling back a problematic dependency update and reenabled live updates at 18:53 UTC.

We are working to improve alerting and monitoring of our live update service to reduce our time to detection and mitigation.
Jan 23, 18:53 UTC
Update - Live updates have been restored and the system is operating normally.
Jan 23, 18:53 UTC
Update - We have identified and are beginning to roll out a potential fix for issues with live updates to our Web UI that power automatic page updates such as the merge box on Pull Requests and updates to Projects.
Users will see actions spinning on the PR merge box for example. As a work around, please refresh the page to get the page updated while we work to fix the issue. We will provide further updates as we continue resolving the issue.
Jan 23, 18:14 UTC
Update - We are continuing to investigate issues with live updates to our Web UI that power automatic page updates such as the merge box on Pull Requests and updates to Projects.
Users will see actions spinning on the PR merge box for example. As a work around, please refresh the page to get the page updated while we work to fix the issue. We will provide further updates as we continue resolving the issue.
Jan 23, 17:17 UTC
Update - We are continuing to investigate intermittent issues with live updates to our Web UI that power automatic page updates such as the merge box on Pull Requests and updates to Projects. Users will see actions spinning on the PR merge box for example. As a work around, please refresh the page to get the page updated while we work to fix the issue. We will provide further updates as we continue resolving the issue.
Jan 23, 16:37 UTC
Update - We are investigating intermittent issues with live updates to our Web UI that power automatic page updates such as the merge box on Pull Requests. Users will intermittently see actions spinning on the PR merge box for example. As a work around, please refresh the page to get the page updated while we work to fix the issue. We will provide further updates as we continue resolving the issue.
Jan 23, 15:59 UTC
Investigating - We are currently investigating this issue.
Jan 23, 15:50 UTC
Jan 22, 2024

No incidents reported.

Jan 21, 2024
Incident with Codespaces
Resolved - This incident has been resolved.
Jan 21, 09:34 UTC
Update - We continue to work on mitigating the issues with Codespace resumes in West Europe.
Jan 21, 09:32 UTC
Update - We continue to work on mitigating the issues with Codespace resumes in West Europe.
Jan 21, 08:58 UTC
Update - We continue to work on mitigating the issues with Codespace resumes in West Europe.
Jan 21, 08:27 UTC
Update - Codespace creation has fully recovered in all regions. We are still mitigating issues with Codespace resumes in West Europe.
Jan 21, 07:55 UTC
Update - We continue to see recovery in most regions. We are still working on mitigating the issue impacting customers in West Europe.
Jan 21, 07:24 UTC
Update - We are continuing to monitor recovery in the affected regions.
Jan 21, 06:50 UTC
Update - We are seeing signs of recovery in the affected regions.
Jan 21, 06:15 UTC
Update - Codespaces is experiencing degraded performance. We are continuing to investigate.
Jan 21, 06:15 UTC
Update - We continue to work on mitigating the underlying the issue impacting Codespaces customers.
Jan 21, 06:00 UTC
Update - We continue to work on mitigating the underlying the issue impacting Codespaces customers.
Jan 21, 05:24 UTC
Update - Around 15% of Codespaces customers are unable to create or resume their codespaces. We are continuing efforts to mitigate the issue.
Jan 21, 04:50 UTC
Update - Codespaces is experiencing degraded availability. We are continuing to investigate.
Jan 21, 04:21 UTC
Update - We have identified the issue impacting Codespaces customers in multiple regions and are working on mitigation.
Jan 21, 04:15 UTC
Update - We are experiencing elevated error rates in multiple regions and are currently investigating.
Jan 21, 03:38 UTC
Investigating - We are investigating reports of degraded performance for Codespaces
Jan 21, 03:38 UTC
Incident with Actions
Resolved - On 2024-01-21 from 02:05 UTC to 06:19 UTC, GitHub Hosted Runners experienced increased error rates from our main cloud service provider. The errors were initially limited to a single region and we were able to route around the issue by transparently failing over to other regions. However, errors gradually expanded across all regions we deploy to and led to our available compute capacity being exhausted.

During the incident, up to 35% of Actions jobs using Larger Runners and 2% of Actions jobs using GitHub Hosted Runners overall may have experienced intermittent delays in starting. Once the issue was resolved by our cloud service provider, our systems made a full recovery without intervention.

We’re working closely with our service provider to understand the cause of the outage and mitigations we can put in place. We’re also working to increase our resilience to outages of this nature by expanding the regions we deploy to beyond the existing set, especially for Larger Runners.
Jan 21, 06:19 UTC
Update - We've applied a mitigation to fix the issues with queuing and running Actions jobs. We are seeing improvements in telemetry and are monitoring for full recovery.
Jan 21, 05:54 UTC
Update - We have mitigated the issues impacting Actions Larger Runners. We are still experiencing delays starting normal jobs, and are continuing to investigate.
Jan 21, 05:26 UTC
Update - The team has identified the cause of the issues with Actions Larger Runners and has begun mitigation.
Jan 21, 04:53 UTC
Update - The team continues to investigate issues with some Actions jobs being queued for a long time and a percentage of jobs failing. We will continue providing updates on the progress towards mitigation.
Jan 21, 04:16 UTC
Investigating - We are investigating reports of degraded performance for Actions
Jan 21, 03:45 UTC
Jan 20, 2024

No incidents reported.

Jan 19, 2024

No incidents reported.

Jan 18, 2024

No incidents reported.

Jan 17, 2024

No incidents reported.

Jan 16, 2024

No incidents reported.

Jan 15, 2024

No incidents reported.

Jan 14, 2024

No incidents reported.

Jan 13, 2024

No incidents reported.

Jan 12, 2024

No incidents reported.

Jan 11, 2024

No incidents reported.

Jan 10, 2024

No incidents reported.

← Incident History Powered by Atlassian Statuspage