People would probably vote more if they had to vote at least 5 times to see the ranks, i.e. say "3 more votes to see ranks" in top center, and then pop up the ranks automatically.
Here I am clicking color after color like a dunce, wondering when I get to see the ranking. After 20-30 or so clicks I finally notice the ultra-tiny-low-contrast "Ranks" text.
I didn’t even know I was voting on anything during my first three clicks. “Choose a color” doesn’t equate to “vote on a color” in my mind. I thought I was “choosing a color” to see its rank (and I didn’t get why it was showing me two on the page). I must be the lowest common denominator in this case.
And then click it (even though it's the one area of the page that doesn't have a cursor:pointer (took me some time too, even after coming back here to check comments)).
I don't think anyone would be mad.