Friday, March 27, 2009

RFO - Network Service Disruption 3/27 @ 19:05 PDT (GMT -7)

Window
Friday, March 27, 2009 19:05 - 19:13 PDT
(Saturday, March 28, 2009 02:05 - 02:13 GMT)

Customer Impact
This event affected many customers

Details
While performing a proactive maintenance on the infrastructure to increase security and improve resilience to malicious attacks against our network, an incorrect configuration command was entered on the border routers which started to gradually block legitimate traffic. As soon as the maintenance engineer was notified by our monitoring tool, the erroneous configuration was reverted, and connectivity was restored.