They should also filter for geographies that providers serve. e.g. If one provider is serving predominantly rural areas, most of their trunks will be using directional wireless, leaving them at a severe disadvantage which is no fault of theirs.
If we were then to rank ISP's on throughput, even though a rural ISP is serving a critical and under-served part of our community, they would be rewarded with negative perception.
I'll second this. When I lived in Mitchell, SD (15k people - look it up) I had 3 ISPs to choose from (in city limits). I had pretty good throughput from 2 of them - one was wireless.
If we were then to rank ISP's on throughput, even though a rural ISP is serving a critical and under-served part of our community, they would be rewarded with negative perception.