Shopping? Check out our latest product comparisons

Music with the Mind: The Brain-Computer-Music-Interface

The BCMI lets you create music using nothing more than eye movement and brainwaves

The BCMI lets you create music using nothing more than eye movement and brainwaves

Imagine a Wii that lets you play a musical instrument with your brain without touching strings or a keyboard. That's exactly what this "proof of concept" brain-computer-music-interface (BCMI) is designed to do – it uses brain waves and eye movement to sound musical notes, so even a person with "locked-in-syndrome" could participate in creative activity analogous to learning to play a musical instrument. Developed by a team headed by Eduardo Miranda, a composer and computer music specialist from the UK's University of Plymouth, the BCMI can be set up on a laptop computer for under $3,500 (including the computer). For people who are disabled, assistive technology usually aims at day-to-day functioning and largely ignores the unique aspect of being a human – creativity. This is different.

The Brain Computer Interface as an assistive technology

"Creativity - like human life itself - begins in darkness." – Julia Cameron

No-one wants to even think about it but imagine a car crash or a stroke left you totally paralyzed and your only active movements were eye movements, facial gestures and minimal head movements. If you still retain full cognitive capacity, you would have what is called locked-in syndrome, a fate some might regard worse than death. For any person with a disability, one of the biggest obstacles is that people simply assume that if your body doesn't work, then your brain is probably not capable of much either. How much worse is this for the person isolated by locked-in syndrome?

Historically, assistive technologies have relied on the person being able to maneuver at least one part of their body. For example, an Augmented Communication Device may require them to press buttons on a keyboard that has pre-designated questions, statements or responses. These devices can be adapted in order for the buttons to be pressed with a finger, a toe, or a metal-pointer attached to their head. Pretty impressive. But what about people with locked-in syndrome who aren't capable of such motor function other than eye movements? Most of the technology has been simply passing them by.

Technology in the form of the brain computer interface (BCI) provides hope for these and many other people because we no longer have to imagine being able to use our thoughts to control a wheelchair or a communication device. In the past decade this technology has moved increasingly from fantasy into a reality.

In 2007, Mike Hanlon wrote in Gizmag about "The first commercially available Brain Computer Interface" and pointed out how work in the area was focused on enabling paralyzed humans to communicate far more freely, but noted the potential to enhance everyone was not that far away. He was right. Within the last five years we have moved from the ability to point with the mind to a thought controlled cursor. And we have moved from driving wheelchairs with brainwaves to driving a car controlled by mind power.

The brain-computer-music-interface

This latest development has thrust the BCI into the world of music and creativity where, in this, its first use, the brain computer musical interface promises to enhance life immensely for those with a most severe disability, locked-in syndrome.

This is the brainchild of a team headed up by Eduardo Miranda, and the Plymouth BCMI Project [PDF]. The system is not yet wireless, but uses a laptop computer, related software, 3 electrodes and an EEG amplifier and can be built for under US$3,500.

Using brainwaves a person can almost immediately produce a full range of musical notes from this device by simply looking intently at one of four icons. These four icons are responsible for sounding pitch, rhythm, and controlling the strength and speed of the notes. Like learning to play a musical instrument, playing music with this device requires skill and learning. As the scientists note, however, this can be an attractive attribute.

With minimal practice in this proof of concept test, the person with locked-in syndrome rapidly demonstrated skill at playing and found it an enjoyable experience.

Check out what such a device can do when output from it is hooked into a piano keyboard. A practiced person has the potential to play masterful music using nothing but his or her brainwaves.

A whole new medium for creativity

Assistive technologies have made life easier for millions of people with disabilities around the globe. We have technology that can help people at home and at work; help them to communicate; help them with mobility. In fact you could say we've got technology for almost everything important to a person's life, right? But until now, these technologies largely ignored the most unique aspect of being a human – creativity.

In the grand scheme of life, you probably wouldn't say that cooking dinner for yourself or getting yourself out of bed in the morning were the things you were most proud of achieving. People want to be unique, innovative, and admired for their talents. Why else would we write books, design cars, or start our own companies? It's in our nature to create. The BCMI promises to give a whole new medium for creativity because it can be used by anyone almost regardless of any physical disability. Inside each one of us is the untapped potential to be the next Beethoven without the agony of studying music theory or learning the piano. All you need is a brain.

10 Comments

I would expect them to make the piano spit out music, but not this correct and elegantly composed music.

Can this really be true?

Simon Pedersen
28th April, 2011 @ 11:40 pm PDT

Please DO NOT CHEAT!!! Be serious!

pier
29th April, 2011 @ 08:53 am PDT

Interesting, but (without clicking on the links) it doesn't indicate that the player in the video has any musical abilities without the computer. If the music demonstrated is strictly the result of him composing with no formal knowledge of music, it is amazingly awesome. I have had many musical ideas that I could not possibly play, even with the abilities I do have.

Robert Allan Fox
29th April, 2011 @ 11:46 am PDT

My guess would be that he is controlling a selection of melodies and tempo rather than actual notes.

BenjaminPQ
29th April, 2011 @ 12:14 pm PDT

This is not composition, it's just using the brain to activate a bunch of pre-programmed sequences of notes.

La Boehme
1st May, 2011 @ 07:00 pm PDT

it's easier for processing to control notes than melodies & tempos... it works

Daniel Plata Baca
1st May, 2011 @ 07:38 pm PDT

Wow, first time I see this and really interesting that we can possibly play piano with our own brains. That might be a good exercise for improving our brains and really helpful for those with disability, locked-in syndrome. Thanks for uploading the video, it shows the evidence! :)

Kevin H.
5th May, 2011 @ 06:21 am PDT

I agree with Benjamin.. it seems its not actually composition, just using brain to make selection from some existing sequences. Can anyone confirm this?

Vineet Tripathi
14th May, 2011 @ 01:51 am PDT

This could be faked. The computer analyzes the brain waves then prompts the piano. I am not convinced. I'd bet faked.

Guy Macher
14th June, 2011 @ 08:12 am PDT

This isn't original composition- he keeps playing segments from the 3rd movement of Beethoven's moonlight sonata

fieryblues
3rd August, 2011 @ 03:45 pm PDT
Post a Comment

Login with your gizmag account:

Or Login with Facebook:


Related Articles
Looking for something? Search our 27,883 articles