I don't think I've ever heard of training wheels at literal ground level when the bike is upright -- what would even be the point? It's basically a tricycle, like you say.

When I've seen them, they've been at least an inch or two above, which (coupled with telling the child that the game is to prevent them touching the ground) would seem to mitigate this problem while still effectively preventing falls.