Touch-screens That can Sense Hand Movements

Scientists at Microsoft Corporation’s lab in the UK have developed a prototype interactive touch-screen that can see and recognize one’s hand movements and anything near its surface.

The screen acts as a two-handed touch interface and a crude infrared camera. Users can operate the display with both hands, in a similar manner to the display in the film Minority Report, say its developers.

However, the screen can also recognise particular hand gestures as well as objects placed within a centimetre of its surface, they say.

“It can sense much more than fingers, and is essentially a low resolution scanner and camera,” said lead researcher Shahram Izadi, adding that the screen can even communicate wirelessly with other devices nearby using the same infrared technology it uses to see.

He said they developed the technology, dubbed ThinSight, by adding an extra layer of electronics behind a normal laptop screen.

This added a couple of centimetres to the overall thickness, but completely transformed its abilities, Izadi said.

He said the screen “saw” by using a grid of paired infrared sensors and transmitters that sit just behind the backlight of the laptop's LCD panel.

The sensors formed crude images when infrared light bounced off an object, which allowed the screen to identify hand gestures or to see objects, and let them interact with onscreen images, he added.

Co-researcher Steve Hodges said ThinSight could also work as a wireless infrared transmitter and receiver, responding to an ordinary TV remote or other infrared-enabled gadgets.