At least for now, you should consider a persistent overlay that explains that Esc breaks out of view mode and releases control over the mouse. Not being able to use the mouse as you usually do is very unpleasant.

I really like these fun alternatives to ordinary web sites even though the UX designer in me is having a heart attack because of the countless usability and accessability issues