CNC / Service Desk Down

[chernove]

I was doing some simple coding updates in the file manager today and all was fine. About 4:20 this afternoon the CNC shut down with "There was a problem connecting to the system database. Please try again in a moment, or contact the Service Desk." This is still coming up and the Service Desk link is also not working. I tweeted FQ and sent a twitter message. Still down and still haven't heard.
Is there an update, please? (Even if only "there's no update right now, we're working on it")



Thanks!
E

[Mike]

One of our backend servers that manage the Service Desk stopped responding earlier. A technician is at the data center now and has replaced some hardware and is powercycling the server as I type this response. Hopefully, everything should be returned to service very soon. If not, we will post an update with more information.

Our apologies for the inconvenience,
Mike

[chernove]

Great; I appreciate the update!

Many thanks, as always,
Eric

[Kevin]

The problem was the return of the wonderful capacitor problem on a fairly old system. It took a little while to figure out what hardware to use as the machine that was dead had IDE disks on a 3Ware RAID controller. Then it took a while to transplant that storage system and to relocate the system because the newer machine wouldn't physically fit in the same place.

The power cycling that Mike mentioned was because the machine didn't boot completely and the root password I had in my KeePassXC database didn't work. So, I had to use the init=/bin/bash trick to seize control and discover that the network chip in the new machine wasn't supported by the kernel that was on the old machine. That wasn't too hard to fix though since the old machine had a separate ethernet card I yanked out and installed.