>That's the kind of thing that makes people take their business to the other middleman across the street.

Yeah except name me a "middleman" passive index fund that allows you to exercise voting rights at your discretion? I would take my business there, but it doesn't exist.