As you may have guessed, these forums and the FutureQuest network went down earlier today. Updates have been provided via our Twitter account, and those updates have been summarized on our Facebook page. See:
https://twitter.com/FutureQuest/stat...37967723970560
Basically, earlier today the network went offline. Prior to the outage we were having spotty power issues from the hurricane, but the UPS and generator were supplying power for our data center normally. When the network went down, the external routers were still up and running, but our internal switch gear was not.
One of our techs was able to reach the data center this afternoon after the more severe fallout from hurricane Ian passed over the Orlando area. We found that the generator went offline with a hard error due to an engine overspeed. This is indicative of potential water damage taking out one phase of the 3 phase inverter.
The external routers our Tech was able to access don't require much power, and therefore have been able to be kept up and running by our UPS (and for those routers we are utilizing the remaining power store). We also found that the generator developed a coolant leak, which arose sometime after our hurricane preparedness testing.
We are going to see if we can keep coolant level topped off, and we will try resetting the generator to see if we can clear the error. However, we may need to switch between the generator and UPS power. To do that, we have to shutdown the generator and allow it to cool before opening the filler cap due to high pressure. Right now, we are waiting for the UPS to get further recharged before attempting this procedure.
As these forums are currently up, we will continue to post updates here. However, please keep an eye on the Twitter and Facebook feeds, as they will remain our primary modes of communication in case these forums go down again.
Linear Mode
