Here’s a project I sincerely hope Nintendo’s big chiefs have seen. Write a bit of code, put the Wii remote on the TV and the sensor bar on your head and what do you get? Correct 3D perspective of the objects presented on screen. Like looking through a window.
Using the infrared camera in the Wii remote and a head mounted sensor bar (two IR LEDs), you can accurately track the location of your head and render view dependent images on the screen. This effectively transforms your display into a portal to a virtual environment. The display properly reacts to head and body movement as if it were a real window creating a realistic illusion of depth and space.
The project is the brainchild of Johnny Chung Lee at Carnegie Mellon University. Software and support is offered on his site if you want to try this on your own Wii.