[RESOLVED] Data Center Outage
Monitoring continues, but all systems are online and stable as of this writing.
Monitoring continues, but all systems are online and stable as of this writing.
Hardware failure in the main campus data center at approximately 08:00am this morning led to near complete service outage. Technicians responded immediately to assess the situation, ultimately replacing and rebuilding networking equipment and configuration; restoring network services. At this time, most services have been restored, and staff continue to monitor the situation.
OS X clients are now receiving their updates as expected.
As of noon yesterday, basic functionality had been restored to core and infrastructure services. Throughout yesterday afternoon and into late yesterday evening, work proceeded on resolving remaining application problems. At this time, all known issues related to yesterday’s network outage have been resolved. Anyone continuing to have difficulties should contact the CTS Helpdesk (x2083).
A network equipment failure cascade affected connectivity to most campus network services. Technicians continue to work on isolated service issues.
The infrastructure underlying the campus computer account is currently undergoing critical maintenance. Account addition, deletion, and password resets are all unavailable.
Wireless devices attempting to connect to W@SP may fail as we are close to all available addresses being used. There is no ETA for a resolution. This issue should be considered ongoing until further notice.
Macs are again receiving their virus definitions and updated clients. As a large number clients are connecting to the update server simultaneously, it may take a few days before all receive their updates.
The server that provides AntiVirus definitions/management to Mac OS X clients on campus is experiencing difficulties. Anti-Virus software on these computers will continue to function, but may not receive updates until the problem is resolved.
Windows domain maintenance is complete, and all Windows login and file-sharing services are once again available.