Decision time? Check out our latest product comparisons

Aura turns hand gestures into music

By

February 18, 2014

Pitch is controlled by raising and lowering the hands, while the volume can be cranked up ...

Pitch is controlled by raising and lowering the hands, while the volume can be cranked up by spreading the hands apart

Image Gallery (3 images)

Some take their air guitar playing more seriously than others, but even for those exerting the most energy, those perfectly struck imaginary chords are heard by nobody's ears except their own. Aura, an electronic instrument that translates hand gestures into music, could be just what these highly animated faux musicians need to get a little more reward for their efforts.

The brainchild of Cornell University engineering student Ray Li, Aura uses a small base to create a magnetic field which detect magnetic sensors attached to the player's hands with custom-made gloves. These communicate the position and orientation of the hands within the field to a programmed interface, which then translates the data to MIDI (Musical Instrument Digital Interface) signals to be played through a synthesizer.

Pitch is controlled by raising and lowering the hands, while the volume can be cranked up by spreading the hands apart. Artists can get a bit more creative by closing their fingers to muffle the sounds or twisting their hands add some distortion. Beyond this innovative input process however, Li likens the instrument to a typical MIDI controller.

"How the Aura makes music, is that it just controls the software on my laptop," says Li. "There is infinite possibilities for the sounds that the Aura can make. It just sends out data, in terms of positions and different parameters, and those can be interpreted by many different software."

Li's vision for modernized, alternative music interfaces dates back to his sophomore year, where Sabre, his electronic cello was born. Conceived as a project for his circuits course, the instrument comprised a wooden base with conductive strips for strings and a joystick to manipulate the sound. On returning to study, Li began to hypothesize on how the instrument could be improved to allow for greater expressiveness.

"I went in thinking that I would build another version of the Sabre but with a motion sensor instead of a joystick," says Li. "After thinking about it more, I thought what if the whole thing was just a motion based instrument?"

Li's invention is to be featured in an upcoming presentation funded by the Cornell Council for the Arts called SoundSpace. In the meantime you can see a Li get hands on with the Aura in his demonstration video below.

Source: Cornell University

About the Author
Nick Lavars Nick was born outside of Melbourne, Australia, with a general curiosity that has drawn him to some distant (and very cold) places. Somewhere between enduring a winter in the Canadian Rockies and trekking through Chilean Patagonia, he graduated from university and pursued a career in journalism. He now writes for Gizmag, excited by tech and all forms of innovation, Melbourne's bizarre weather and curried egg sandwiches.   All articles by Nick Lavars
3 Comments

Congratulations on reinventing the theramin!

Peter Kowalchuk-Reid
18th February, 2014 @ 08:06 pm PST

A long time ago, Nintendo borrowed a NASA idea and made the Power Glove. Now we have this. Swell.

Eddie
19th February, 2014 @ 04:27 am PST

Seems to me a Leap Motion Controller and a good music app would be able to do all this does and more.

Gadgeteer
19th February, 2014 @ 04:04 pm PST
Post a Comment

Login with your gizmag account:

Or Login with Facebook:


Related Articles
Looking for something? Search our 29,004 articles