On the contrary, it's obvious to me that solitary confinement is significantly more expensive per inmate than non-solitary high security imprisonment.

So how do you prevent the inmates from killing each other without separating them physically?

You can separate them physically without putting them in solitary confinement.