Prototype Microsoft keyboard recognizes hand gestures


April 28, 2014

A user zooms in on a map by pinching their fingers on the keyboard

A user zooms in on a map by pinching their fingers on the keyboard

Image Gallery (3 images)

Gesture recognition devices may indeed offer more functionality than is possible using just a keyboard and mouse, but in order to use them, users have to lift their hands up and away from that keyboard. A team at Microsoft Research decided to address that problem, and created a prototype mechanical keyboard that recognizes hand gestures performed on or immediately above the keys.

The Type-Hover-Swipe keyboard features a 16 x 4 array of infrared proximity sensors embedded in a printed circuit board. Each sensor node peeks out from between the regular key caps, tracking the movement of the user's hands as they touch the keyboard or hover above it.

Although the array only manages a resolution of 64 pixels, it operates at high frame rates – above 300 hertz. That's enough for it to detect rapid movement, thus allowing the keyboard's machine learning algorithm to recognize a number of both static and dynamic "motion signatures."

These include swiping up, down, left and right; changing applications by hovering the hand in place; pinching to zoom; pointing for index up and down; and even a steering wheel gesture that allows users to control an onscreen car in a racing game.

More details on how the keyboard learns and recognizes gestures are available in the video below. There's currently no word on possible commercialization of the technology.

Source: Microsoft Research

About the Author
Ben Coxworth An experienced freelance writer, videographer and television producer, Ben's interest in all forms of innovation is particularly fanatical when it comes to human-powered transportation, film-making gear, environmentally-friendly technologies and anything that's designed to go underwater. He lives in Edmonton, Alberta, where he spends a lot of time going over the handlebars of his mountain bike, hanging out in off-leash parks, and wishing the Pacific Ocean wasn't so far away. All articles by Ben Coxworth

From the company that brought you the Kinect, (a camera device able to recognize hand gestures, body movements, which individual is using it, etc) comes a new device which does even less, and is more frustrating to use.

Daniel Gregory

What's funny is the patent filed by Apple for this tech and gestures when MS has had this type of tech in an actually demo product.

I can see this being very useful for newer 8/9" Windows tablets that do not have room for a touchpad on a detachable keyboard.

Rann Xeroxx
Post a Comment

Login with your Gizmag account:

Related Articles
Looking for something? Search our articles