Mobile Technology

OmniTouch turns any surface into a touchscreen interface

OmniTouch turns any surface into a touchscreen interface
OmniTouch displays interface on user's hand
OmniTouch displays interface on user's hand
View 12 Images
Shoulder-mounted OmniTouch prototype
1/12
Shoulder-mounted OmniTouch prototype
Shoulder-mounted OmniTouch prototype
2/12
Shoulder-mounted OmniTouch prototype
OmniTouch displays interface on user's hand
3/12
OmniTouch displays interface on user's hand
The OmniTouch wearable interface projector
4/12
The OmniTouch wearable interface projector
OmniTouch displays interface on user's arm
5/12
OmniTouch displays interface on user's arm
OmniTouch displays interface on a tablet
6/12
OmniTouch displays interface on a tablet
OmniTouch displays interface on a desktop
7/12
OmniTouch displays interface on a desktop
OmniTouch displays interface on a wall
8/12
OmniTouch displays interface on a wall
OmniTouch displays interface on user's hand
9/12
OmniTouch displays interface on user's hand
OmniTouch displays interface on user's hand
10/12
OmniTouch displays interface on user's hand
OmniTouch depth map and depth derivative of finger on tablet
11/12
OmniTouch depth map and depth derivative of finger on tablet
OmniTouch depth map and depth derivative of finger on hand
12/12
OmniTouch depth map and depth derivative of finger on hand
View gallery - 12 images

Had Shakespeare been born several centuries later, he might have said "All the world's an interface," especially if he'd had a chance to play with the recently-developed, wearable OmniTouch system. While interactive interface projectors are far from new, this innovative concept design utilizes a different approach that promises to turn just about any solid surface into a touch-sensitive input device. Books, tables, walls, hands and other body parts, it's all fair game.

In its current proof-of-concept iteration, which was prototyped at idea-rich Microsoft Research in Redmond, Washington, by PhD student Chris Harrison and his team, the rough-hewn shoulder mounted device resembles a sci-fi prosthetic weapon, but looks can be deceiving.

"We explored and prototyped a powerful alternative approach to mobile interaction that uses a body-worn projection/sensing system to capitalize on the tremendous surface area the real world provides," explains Harrison.

Like the proverbial "better" mousetrap, the concept of mobile interaction seems prone to constant tinkering. The OmniTouch draws from a blend of disciplines to overcome numerous issues that beset similar devices. Some approaches require placing markers on the fingertips but still can't discern whether the fingers are "clicked" (touching the surface) or hovering. Others can't "read" surfaces beyond those of the user's own body or they lack the ability to respond to touch/drag motions.

To surmount these hurdles, Harrison and his colleagues combined a PrimeSense short-range depth camera with a Microvision ShowWX+ laser pico-projector. The camera generated a 320x240 depth map at a rate of 30FPS, even for objects as close as 8 inches (20cm). The projector delivered a sharp, focus-free, wide-angle image independent of the surface's distance - a useful property in such applications. Both devices were then linked to a desktop computer.

The OmniTouch gets its edge in finger position detection through a complex series of calculations that begins with the generation of the depth map. The second video below contains a detailed description of the process which enables the device to determine whether one's fingers are floating above a surface of actually contacting it. The inputs yielded closely approximate those of touchscreens and mice, so the possibilities for the OmniTouch are seemingly endless. Let's hope the wait for a commercial version isn't.

The paper, OmniTouch: Wearable Multitouch Interaction Everywhere, by Chris Harrison, Hrvoje Benko and Andy Wilson was presented in the Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, October 16 - 19, 2011)

Source: Chris Harrison

All images courtesy Chris Harrison.

OmniTouch - Demo Video - ACM UIST 2011

View gallery - 12 images
4 comments
4 comments
asdflkj
Just imagine the party games this could enable.
Slowburn
I\'m sorry. I didn\'t mean to grope you, I was searching for a pickup line that might work on a woman of such beauty.
martin
Can\'t wait for the haptic feedback version...
Froden
has anyone ever heard of sitxh sense?