Compare the latest tech products

OmniTouch turns any surface into a touchscreen interface


October 19, 2011

OmniTouch displays interface on user's hand

OmniTouch displays interface on user's hand

Image Gallery (12 images)

Had Shakespeare been born several centuries later, he might have said "All the world's an interface," especially if he'd had a chance to play with the recently-developed, wearable OmniTouch system. While interactive interface projectors are far from new, this innovative concept design utilizes a different approach that promises to turn just about any solid surface into a touch-sensitive input device. Books, tables, walls, hands and other body parts, it's all fair game.

In its current proof-of-concept iteration, which was prototyped at idea-rich Microsoft Research in Redmond, Washington, by PhD student Chris Harrison and his team, the rough-hewn shoulder mounted device resembles a sci-fi prosthetic weapon, but looks can be deceiving.

"We explored and prototyped a powerful alternative approach to mobile interaction that uses a body-worn projection/sensing system to capitalize on the tremendous surface area the real world provides," explains Harrison.

Like the proverbial "better" mousetrap, the concept of mobile interaction seems prone to constant tinkering. The OmniTouch draws from a blend of disciplines to overcome numerous issues that beset similar devices. Some approaches require placing markers on the fingertips but still can't discern whether the fingers are "clicked" (touching the surface) or hovering. Others can't "read" surfaces beyond those of the user's own body or they lack the ability to respond to touch/drag motions.

To surmount these hurdles, Harrison and his colleagues combined a PrimeSense short-range depth camera with a Microvision ShowWX+ laser pico-projector. The camera generated a 320x240 depth map at a rate of 30FPS, even for objects as close as 8 inches (20cm). The projector delivered a sharp, focus-free, wide-angle image independent of the surface's distance - a useful property in such applications. Both devices were then linked to a desktop computer.

The OmniTouch gets its edge in finger position detection through a complex series of calculations that begins with the generation of the depth map. The second video below contains a detailed description of the process which enables the device to determine whether one's fingers are floating above a surface of actually contacting it. The inputs yielded closely approximate those of touchscreens and mice, so the possibilities for the OmniTouch are seemingly endless. Let's hope the wait for a commercial version isn't.

The paper, OmniTouch: Wearable Multitouch Interaction Everywhere, by Chris Harrison, Hrvoje Benko and Andy Wilson was presented in the Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, October 16 - 19, 2011)

Source: Chris Harrison

All images courtesy Chris Harrison.

About the Author
Randolph Jonsson A native San Franciscan, Randolph attended the U.S. Naval Academy at Annapolis, Maryland before finding his way to the film business. Eventually, he landed a job at George Lucas' Industrial Light + Magic, where he worked on many top-grossing films in both the camera and computer graphics departments. A proud member of MENSA, he's passionate about technology, optimal health, photography, marine biology, writing, world travel and the occasional, well-crafted gin and tonic! All articles by Randolph Jonsson

Just imagine the party games this could enable.


I\'m sorry. I didn\'t mean to grope you, I was searching for a pickup line that might work on a woman of such beauty.


Can\'t wait for the haptic feedback version...


has anyone ever heard of sitxh sense?

Post a Comment

Login with your Gizmag account:

Related Articles
Looking for something? Search our articles