You should be able to punish people even though there's reasonable doubt that they are culpable? Are you arguing for a "balance of probabilities" standard? Or that it's worth punishing some innocents so that the guilty are also punished?
The standard of proof required to ban someone from a once-a-month pub meetup is far lower than the standard required to, say, give someone the death penalty.
I think I am arguing for a "balance of probabilities". If (to spout off random hypothetical) the punishment is something like a banning of someone from EA conferences, then there definitely needs to be evidence of their misconduct, but that level of evidence doesn't need to be the same as if they are looking at a criminal conviction. The point is balancing the need to protect the victim while not punishing the innocent is a difficult issue outside the criminal courtroom.