Cosmic Global - Emergency Maintenance to Address TCP Issues in LAX – Maintenance details

Maintenance has completed successfully.

The maintenance was done to fix a software bug in one of our core routers that put it into a bad state. The maintenance was extended due to a side effect from the reboot of the router. Immediately after the router came back up we saw a complete service restoration in LAX, but we began seeing BGP errors between our PoPs. Eventually, this led to multiple pops having a quick, but pretty full drop.

We immediately began restarting our BGP daemons on all of the core routers so that inter-pop communications could be restored.

We are monitoring the network to ensure no further issues do occur, but based on the results of the reboot, and our subsequent fixes we think we are in good order.

Thanks for your patience, and Happy Thanksgiving to those in the U.S.!

Maintenance is in progress and has been extended to ASH and Dallas due to BGP reconvergence.