If you put your webcam behind your video chat window, you can achieve better eye contact with your remote participants. I wonder how well a webcam can see through these screens and/or how much of a hole would be required in the rendered image to avoid obstructing the camera.
With the right level of integration the camera could subtract the image that is in front of it. That would requires having a pretty good model of the point spread function, perfect synchronization etc.
OLEDs have a fast response... I wonder if it would be possible to put the camera shutter and the oled out of phase enough to substantially dim it.
Perhaps polarization could be used to get better isolation.
With all the engineering required to do it, it might be much less expensive to have three or four cameras at the edges of the display, then extract a depth map and resynthesize an view from the perspective of the centre of the screen. :)
Plus that would give you bonus features like being able to automatically blur our or heavily denoise the background. :)
> I wonder if it would be possible to put the camera shutter and the oled out of phase enough to substantially dim it.
That's a neat idea. It reminds me of the early fighter planes that fired bullets between the propeller blades by having the gun driven off the engine, timed so that the bullet passes through the plane of the propeller while the blades are not in the way.
> I wonder if it would be possible to put the camera shutter and the oled out of phase enough to substantially dim it.
That is exactly the idea, to sync the camera to capture in between OLED pulses. It's not going to be perfect, but then to use computational photography to subtract whatever bleed of pixel color is left.
In theory, it should be totally workable. In practice, I'm not sure what the tradeoffs are in terms of acceptable image quality and resolution for the camera.
I would think a teleprompter style setup should work.
I remember ages ago someone created a reverse version, basically a periscope you hang over the camera on your laptop. I think the idea was you position the window with the face behind the mirror.
