Past Incidents

Sunday 23rd October 2016

Dirty Cow kernel upgrades, scheduled 9 years ago

Given the severity of the Dirty Cow vulnerability and variants that are and are not effective against different variants of RedHat Enterprise Linux, which we use, all servers are undergoing a proactive kernel upgrade this afternoon. Expect a < 5 minute outage for newer generation servers (v6+) and a 10-15 minute outage for older generation (pre v6) servers. Luna has already been upgraded, so no further action will be taken on Luna.

3:38 PM EDT - maintenance window concluded

Apollo Apollo outage, scheduled 9 years ago

Apollo outage, investigating...

1:00 PM EDT - Apollo back up, stemmed from live testing of a variant of the Dirty Cow exploit. Not successfully leveraged, but does induce a kernel panic. Upgrading kernels on all servers...

Saturday 22nd October 2016

Luna Luna kernel upgrade, scheduled 9 years ago

Luna is being taken down immediately for a kernel upgrade in response to the Dirty Cow exploit. Luna is the only RHEL7 server and the only one vulnerable to the exploit.

Friday 21st October 2016

No incidents reported

Thursday 20th October 2016

No incidents reported

Wednesday 19th October 2016

No incidents reported

Tuesday 18th October 2016

No incidents reported

Monday 17th October 2016

No incidents reported