GitHub Status

Incident with Git Operations

Update - We are currently investigating reports from some customers encountering errors when cloning repositories via workflows or via the command line. We do not currently have an ETA for resolution. Next update in 30 minutes.
Oct 22, 2023 - 15:34 UTC

Investigating - We are investigating reports of degraded performance for Git Operations
Oct 22, 2023 - 15:16 UTC

Git Operations

Partial Outage

API Requests

Operational

Webhooks

Operational

Visit www.githubstatus.com for more information Operational

Issues

Operational

Pull Requests

Operational

Actions

Operational

Packages

Operational

Pages

Operational

Codespaces

Operational

Copilot Operational

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

Past Incidents

Oct 22, 2023

Unresolved incident: Incident with Git Operations.

Oct 21, 2023

No incidents reported.

Oct 20, 2023

No incidents reported.

Oct 19, 2023

No incidents reported.

Oct 18, 2023

No incidents reported.

Oct 17, 2023

Incident with Codespaces

Resolved - From 10:59 UTC to 13:48 UTC, GitHub Codespaces service was down or degraded due to an outage in our authentication service.This issue impacted 67% of users over this time period.

Our service auth layer experienced throttling with our third party dependencies due to higher load. This impacted all user facing scenarios for Codespaces service. Our automated regional failover kicked in, but it failed to mitigate as this issue impacted the service globally. We mitigated manually by reducing load on external dependency.

With the incident mitigated, we are working to assess and implement scaling improvements to make our service more resilient with increasing load.
Oct 17, 13:49 UTC

Update - Codespaces is experiencing degraded performance. We are continuing to investigate.
Oct 17, 13:46 UTC

Update - We are continuing with efforts to mitigate Codespaces issues and are beginning to see some Codespace creations succeed.
Oct 17, 13:24 UTC

Update - We have identified an issue impacting most Codespaces operations and are working on a mitigation.
Oct 17, 12:18 UTC

Update - Codespaces is experiencing degraded availability. We are continuing to investigate.
Oct 17, 11:18 UTC

Investigating - We are investigating reports of degraded performance for Codespaces
Oct 17, 11:14 UTC

Oct 16, 2023

No incidents reported.

Oct 15, 2023

No incidents reported.

Oct 14, 2023

No incidents reported.

Oct 13, 2023

No incidents reported.

Oct 12, 2023

No incidents reported.

Oct 11, 2023

No incidents reported.

Oct 10, 2023

No incidents reported.

Oct 9, 2023

Incident with Pull Requests

Resolved - On October 9, 2023 at 14:24 UTC, a noticeable delay in commits appearing in pull requests was detected. During the incident, approximately 9% of pull requests (less than the 20% first reported) experienced staleness of up to 7m. The root cause was identified to be an increase in the latency of a downstream dependency causing pull request workers to saturate their available capacity, resulting in delayed updates to PRs - no data was lost during this incident.

We mitigated this by adding additional capacity to the affected worker pool at 15:02 UTC. This allowed our background jobs to catch up with the backlog of updates and provide relief to our customers. Additionally, we have significantly increased the performance of the downstream service to prevent recurrence
Oct 9, 15:18 UTC

Update - We are investigating delays for commits showing up on Pull Requests page loads in the web UI. As a result of this, about 20% of pull requests are currently showing stale data of up-to 7m. We are currently investigating contributing factors right now.
Oct 9, 14:52 UTC

Investigating - We are investigating reports of degraded performance for Pull Requests
Oct 9, 14:51 UTC

Oct 8, 2023

No incidents reported.

Product

Platform

Support

Company