Gesture Recognition

The smallest gesture can hide a world of meaning. A particular flick of a baton and a beseeching gesture can transform the key moment of a concert from mundane to ethereal. Alas, computers are seriously handicapped in understanding human gestural language, both in software and hardware. In particular, finding a method for describing gestures presented to a computer as input data for further processing has proven a difficult problem. In response, Microchip Technologies has developed the world's first 3D gesture recognition chip that senses the gesture without contact, through its effect on electric fields.  Read More

As evidenced by the Kinect system, Microsoft has a serious dedication to making user interfaces that track the movement of its users. The company has shown a new technology, which it is calling Digits, that tracks hand movements through a device worn on a user's wrist. This means there are no gloves needed.  Read More

While the Nintendo Wii and Microsoft Kinect are largely responsible for bringing gesture control into the lounge room, a new technology from OMRON promises to make gesture control mobile. Building on the company’s core “OKAO Vision” facial image sensing technology, OMRON has developed a new hand gesture recognition technology compatible not only with Windows PCs, but also Android and iOS mobile operating systems.  Read More

Microsoft’s Kinect peripheral senses motion inputs using a combination of a depth sensor, RGB camera and a multi-array microphone. Now Microsoft’s research division, Microsoft Research, has developed a gesture recognition system called SoundWave that relies on sound instead of video to bring gesture recognition capabilities to a standard laptop or desktop computer without the need for any additional hardware.  Read More

We’ve all seen footage of flight crews on the decks of aircraft carriers, directing taxiing planes using arm signals. That’s all very well and good when they’re communicating with human pilots, but what happens as more and more human-piloted military aircraft are replaced with autonomous drones? Well, if researchers at MIT are successful in one of their latest projects, not much should change. They’re currently devising a system that would allow robotic aircraft to understand human arm gestures.  Read More

While digital cameras have made it easier to take self-portraits thanks to the inclusion of self-timers, face, smile and motion detection, and the positioning of displays on the front of the camera - as seen with Samsung's DualView camera - changing the framing or altering settings still requires the user to run back to the camera itself to get things right. Now researchers at the University of Tsukuba's Department of Computer Science in Japan have developed technology that lets shutterbugs put themselves in the picture and snap a pic using Kinect-like hand gestures.  Read More

Although surgeons need to frequently review medical images and records during surgery, they’re also in the difficult position of not being able to touch non-sterile objects such as keyboards, computer mice or touchscreens. Stepping away from the operating table to check a computer also adds time to a procedure. Researchers from Indiana’s Purdue University are addressing this situation by developing gesture-recognition systems for computers, so that surgeons can navigate through and manipulate screen content simply by moving their hands in the air. The system could additionally be used with robotic scrub nurses, also being developed at Purdue, to let the devices know what instruments the surgeon wants handed to them.  Read More

They're not a failed attempt at Belgian jigsaw camouflage or a trophy from clown school, these colorful lycra gloves are the vital component in a new gestural user input system developed by researchers at MIT. When used with a standard webcam and some clever software, the wearer's hand movements are instantaneously translated into on-screen commands or control gestures. Commercial development of the system could lead to widespread availability of cheap and easy-to-use spatial gesture interfaces.  Read More

Tokyo Auto Salon opens tomorrow and could benefit from much of the hangover from the greatly downsized Tokyo Motor Show last October. One of the most exciting prospects of the show is the first showing of Honda’s Gathers Advance 4, a next-generation car navigation and multimedia system concept which is based around a combination of gesture control (top left image) and voice recognition. Little has been released about the system as yet, however a series of images released by Honda indicates in-car cameras trained on the driver (behind iPod –top right) and voice recognition controls on the steering wheel (bottom right).  Read More