Somebody has to come up with the intended results of the optimization for certain chips and the actual benchmarks in the first place. So they do write assembly and test various things.

However, that person probably have extensive experience in that narrow set of problems. Most programmers don't.