Ongoing power outage (2020-12-10, Amsterdam, power backplane defect)

  • Sunday, 13th December, 2020
  • 08:56am

This message has been sent to update you regarding the ongoing power outage affecting one or more of your services.

After extensive troubleshooting, it was found that the electrical damages from the power supply blow up did not extend farther than from the main boards. As one of the power supplies shows external damage, it would therefor appear that a power supply blew up and caused a ripple effect damaging the power backplane, personality board and main board of each of the 8 blade servers attached to it.

As discussed earlier, this event is unprecedented, not supposed to occur and wasn't accounted for when choosing how many spare parts to store on-site. We have spares for everything (from power supplies, to PDU's to switches), but we do not have an unlimited number of them. Because of the small number (24) of HP SL230s hosted at our Amsterdam location, we were only storing 2 spare HP SL230s blade servers on-site. These units have been used to troubleshoot and bring back online the topmost left and right blade servers in the enclosure, leaving 6 blade servers still powered off.

At this point, we must source spare HP SL230s blade servers or spare HP SL230s personality boards and main boards. We have engaged discussion with 2 different suppliers and are working on having these parts shipped as soon possible. However, even with the most expedited shipping option, we still expect at the very least 2 more business days before the parts reach the datacenter. Therefor, we expect the downtime to extend up to Tuesday, December 15th or longer.

Since your drives will have to be connected to a new main board, it is important, if you haven't done so already, for you to let us know what operating system is installed on your server and if the HP B320i RAID controller is enabled.

This is a very unfortunate and unexpected turn of event and we apologize for the downtime.

Note that Psychz Networks providing spare parts or allowing your drives to be imported to one of their servers isn't an option (as per their decision) and no other HP SL230s blade server or other server is available on our side.

This type of catastrophic failure cannot be prevented, but having enough spare parts on-site for a fast resolution is essential. As mentioned earlier, we always store spare parts for everything on-site, but we cannot store an unlimited number of them. Knowing that such a catastrophic failure is possible, we are working on dramatically increasing our number of spare HP SL230s spare parts at all sites.

We will follow-up with you as we obtain a more precise ETA for the delivery of the parts.

Thank you for your understanding,

« Back