Completely speculation, but I wonder if it's using the same mechanism explored in the famous upside down goggles experiment: https://en.wikipedia.org/wiki/Upside_down_goggles Gizmodo article talking about the effect: https://io9.gizmodo.com/does-your-brain-really-have-the-powe...

Basically, if you wear goggles that distort your vision for long enough, your visual processing adapts and "corrects" for the distortion such that you can function normally. Then if you remove the goggles your brain still tries to correct for the distortion that isn't there (for a while at least), so the world appears distorted without the glasses.