Cosmic Global - Notice history

We are closing this issue as it has been 6 hours since the resolution and we have confirmed everything has remained stable since.

The LON Docklands Core Router has fully recovered, with all line cards now online. A supervisor switchover was performed, which caused temporary impact. We are actively monitoring to ensure all services remain stable.

We are aware the outage has been extended, and our techs are still onsite diligently working towards the full fix. We will continue to update.

The affected line card has been replaced using a spare from our on-site inventory. Impacted customer services will begin restoring as the new card completes its boot process.

A redundant line card has failed in our LON Docklands Core Router, primarily impacting 10GE devices. A replacement is currently underway.

We’re experiencing an outage with one of our transport providers between London and Amsterdam, which temporarily affected connectivity to our London PoP for users routed through Amsterdam. We’ve implemented adjustments to reroute traffic around the issue, and no further impact is expected. We sincerely apologize for the disruption and appreciate your patience and understanding.

Impact was between 10:27 AM CT and 10:36 AM CT (9 minutes).

Hi everyone, During an emergency update to our DDoS mitigation systems, an error caused the automated rollback functionality to fail. As a result, the systems entered a continuous boot loop and, due to limited connectivity, were unable to restore the latest version automatically. What would typically be a five-second operation took over 15 minutes as we manually restored the systems.

Although we normally do not perform updates on weekends, a critical bug required an immediate fix to prevent potential issues later today. We appreciate your understanding. The situation has now been resolved, and no further impact is expected over the remainder of the weekend.

Thank you.

All degraded PoPs should have recovered/are recovering.

Ashburn and Amsterdam should be recovered. We are still working diligently.

We experienced an outage in London due to an unexpected ASIC restart on our Arista core router. We're doing a root cause analysis to determine the cause. We believe it is related to new capacity we had provisioned pending setup next week.

Everything is back online. Please feel free to reach out to our team if you have any questions.