We have had out-of-band management ports & networks design for decades! I know the feeling of driving 8 hours because I lost connection to the device I was configuring. https://en.wikipedia.org/wiki/Out-of-band_management
This. And if you're really worried about it you can go crazy with security with individually issued hardware security tokens and one time use access tokens.
It's pretty inexcusable that FB wasn't able to use OOB management.