Because sometimes people do bad things in ways that are hard to prove, but they still happen.
The Catholic priest makes sure he and the altar boy are the only ones in the church. The coworker who makes unwelcome advances is careful to do it verbally when there aren’t witnesses. The abusive spouse leverages psychological traumas to make their partner feel crazy.
And how do you pick whose lives to ruin without evidence? What do you do about the ones who are wrongly accused? How many innocent lives are you willing to destroy?
That question cuts both ways. How many lives did Weinstein and Cosby and Savile destroy? (And look how tough it was to nail them, and keep it that way.) What about the victims whose attackers are good at avoiding hard evidence?
The basic legal standard is crimes/torts in court have to be proven. English law violates it in defamation cases.