Crash on IAD3 XCP-NG cloud system

Crash on IAD3 XCP-NG cloud system

Major Resolved Started Jun 25, 2019 16:59 UTC · resolved Sep 23, 2019 17:06 UTC (90 days)

1. Resolved · Sep 23, 2019 17:06 UTC

   IAD3 Cloud Systems Have been updated at Node (Hardware) Level.

2. Monitoring · Jun 26, 2019 21:08 UTC

   This Issue will remain open for 10 days. At this time our team has been unable to ascertain if this was a Data Center power issue (more likely) or a hardware (server) issue on the HPE equipment. Some internal systems (unrelated to your hosting experience) are still offline currently, so our team wants to carefully inspect all evidence regarding this issue.

3. Identified · Jun 25, 2019 16:59 UTC

   Our team is currently working to resolve what is in essence a rolling crash of part of our XCP-NG cloud system in IAD3. Over 50% of host nodes are currently affected with outages ranging from 3-6 hours. As our team works to bring crashed nodes online, services will slowly restore for affected VM's