Robotics

MIT researchers augment humans with extra robotic arms

MIT researchers augment humans with extra robotic arms
MIT researchers are developing extra robot limbs that can help out humans where an extra hand, arm, or leg might be useful
MIT researchers are developing extra robot limbs that can help out humans where an extra hand, arm, or leg might be useful
View 8 Images
Researcher demonstrates the operation of the robot arms when installing ceiling panels in an airplane
1/8
Researcher demonstrates the operation of the robot arms when installing ceiling panels in an airplane
One type of Supernumerary Robot Limbs are worn on the shoulders
2/8
One type of Supernumerary Robot Limbs are worn on the shoulders
These limbs are attached at the waist, and assist with precision tasks like drilling holes for assembly
3/8
These limbs are attached at the waist, and assist with precision tasks like drilling holes for assembly
Robotic limbs assist the operator to stabilize his balance against a structure – the yellow structure above the operator's head contains sensors
4/8
Robotic limbs assist the operator to stabilize his balance against a structure – the yellow structure above the operator's head contains sensors
Artists conception of robotic limbs grasping a structure for stability
5/8
Artists conception of robotic limbs grasping a structure for stability
Researchers also investigated attaching limbs at the waist, where they could also act as extra legs
6/8
Researchers also investigated attaching limbs at the waist, where they could also act as extra legs
Visualization of use of robot limbs to attach construction workers to a construction project at various angles
7/8
Visualization of use of robot limbs to attach construction workers to a construction project at various angles
MIT researchers are developing extra robot limbs that can help out humans where an extra hand, arm, or leg might be useful
8/8
MIT researchers are developing extra robot limbs that can help out humans where an extra hand, arm, or leg might be useful
View gallery - 8 images

Featured in comic books since 1963, Dr. Octopus, or "Doc Ock" is an enemy of Spiderman with four extra robotic arms attached to his back that assist him in his nefarious plans. That vision of humans with extra limbs – minus the supervillain part – is taking shape at MIT with researchers adding "supernumerary robotic arms" to assist with tasks that ordinary two-armed humans would find difficult.

There are many tasks around the house or factory that you have probably said to yourself, “if I only an extra arm, this would be a lot easier." Tasks like hanging a ceiling fan, installing an overhead light fixture, or even just holding open a box would be easier if there was an extra arm to help out. Now engineers are envisioning two robotic arms as helping hands.

The project is being run at MIT’s d'Arbeloff Laboratory for Information Systems and Technology and headed by Federico Parietti and Baldin Llorens-Bonilla, both in the Mechanical Engineering Department. Federico has been working on lower limbs, bracing strategies, and stability, while Baldin contributed to the robot shoulder arms, along with coordination and task planning.

The concept was demonstrated with installing ceiling panels in an airplane, a task that must be duplicated dozens of times in the construction of an airliner. A single person installing a large panel overhead must struggle between holding the panel to the ceiling, inserting screws into holes, and using a powered screwdriver to attach the panel. The juggling and dropping of screws would drive any of us to frustration and profanity.

Researcher demonstrates the operation of the robot arms when installing ceiling panels in an airplane
Researcher demonstrates the operation of the robot arms when installing ceiling panels in an airplane

The Supernumerary Robot Limbs (SRL) team looked at this task, and added two lightweight robot arms to a frame attached to a backpack. The arms are attached directly over the spine so that the body can carry the extra weight without strain. This alone would be noteworthy, except that the user now has no way to command the robot arms to move – a conventional joystick or gamepad would take up hands already busy with panels.

So the amazing part of this research is having the arms decide for themselves when and where to help. Sensors on the human’s wrists and on the robot mount determine where the human is on the task, and assigns the robot arms to help.

The robot arms assist the user by pushing up the panel against the ceiling, allowing the human operator to put in screws to attach the panel. As the panel is able to support itself, first one arm goes down, and then the other as the robot senses that the force required to maintain the pose has diminished.

The arms are programmed by the "teach by demonstration" method. A second human first demonstrates to the robot how to help by moving the robot arms manually with the the robot remembering this lesson so it is then able to make the moves on its own.

Robotic limbs assist the operator to stabilize his balance against a structure – the yellow structure above the operator's head contains sensors
Robotic limbs assist the operator to stabilize his balance against a structure – the yellow structure above the operator's head contains sensors

Another application studied by the group is using arms attached to the wearer’s waist that can automatically add stability. Imagine a construction worker trying to drill a hole in a beam while working on a new skyscraper a hundred meters in the air, standing on another beam a few centimeters or inches wide. The supernumerary arms attached to the waist would grab the beams for support and act as stabilizers, attaching the worker to the structure at two points, just like having two extra arms to hold on with.

Each of the robot’s limbs can sense the applied torque, and modify its movements accordingly. Besides just passively holding panels in position, the robot arms can also assist with more precision tasks, like guiding a drill to a particular spot. The research team spent a lot of time developing specific techniques for computing where the robot arms can best assist, and deciding where the robot arms can best be attached for support.

Visualization of use of robot limbs to attach construction workers to a construction project at various angles
Visualization of use of robot limbs to attach construction workers to a construction project at various angles

The project is being supported in part by Boeing, hence the interest in aircraft assembly, but the team sees a range of potential applications for the technology. These include assisting senior citizens, construction workers, and other assembly operators where extra arms might come in (pardon the phrase) handy.

"We want our design to be as light and ergonomic as possible without compromising the robot’s power and capabilities," says Baldin.

The current design is the third generation of robot arms developed, with the shoulder arms weighing about 11-12 lbs. (5-5.4 kg). The team is planning further development of the concept to reduce weight, increase strength, and improve coordination by "developing better control algorithms and increasing the sensing capabilities of the robot."

The video below shows the robotic limbs being demonstrated installing ceiling panels in an airplane.

Sources: MIT d’Arebeloff Laboratory for Information Systems and Technology, Federico Parietti, Baldin Llorens-Bonilla

MIT Robot on the Shoulder Demo

View gallery - 8 images
15 comments
15 comments
Nairda
Simple way to overcome this is to have a toggle with three modes of arm operation: 1. Manual put into position, so you use your human arm to drag the robot arm to where it is mean to hold, then lock into position 2. lock, where the arm stays in the position it is last orientated, with all joints and rotation immobile (including claw) 3. Mimic, where sensors on real arms dictate movement, and the robot arm follows.
An independent toggle for each arm between the three states will likely provide 99% of all requirements.
Autonomous movement is fraught with danger as it relies on contextual understanding of what is going on, and likely going to end up hurting the end user (flailing robot arms anyone?). With the obvious exception of multipurpose heads, like mechanical screwdrivers and cutting tools that are moved through mode (3), and their function started by voice command, e.g. "left hand, screwdriver, clockwise, start"
Francois Retief
Haven't any of these engineers ever read a Spiderman comic? This is not going to end well.
Captain Danger
This could be awesome once mind control is added. I have often argued long hand hard that If I could have one thing extra it would be a Tail ... with a hand attached. This could be the next best thing.
Porterhouse21
ummm.... you need to make it thought controlled! I'm too lazy to have to teach a robot to do what I need, figure out how to make it thought controlled and you have a winner...
If other scientist can figure out how to get a robotic prosthetic arm to move by thought, I think MIT can figure it out also...
flink
Umm.. Yes, it is cool. Very cool. But essentially impractical. That's a lot of hardware to strap on, walk around in, and maintain.
How is this more efficient than using a climbing belt to hang from something or using an extension pole with a flat hunk of wood screwed to it to brace an overhead panel?
Maneuvering around a working office space in that rig would be awkward. Wearing a tool belt and carrying a pole is much easier and less disruptive.
zevulon
i'm left wondering where is the spiderman technology in this. should this guy have gecko pads and be shooting quick dry gluesilk out of his mouth or something?
Gargamoth
I saw something similar in a cartoon when I was a kid. Exo suits could make one guy fly another, another roll and another swim underwater. cool stuff. I hope this tech get perfected. it will make projects easier to do.
Bryan Rule
Come on Zevulon, they're talking about "Doc Oc". I think this is a super cool idea. However, I agree with others who have mentioned a more direct control of the arms might be better. A neural link between the user and the interface would make this one of the coolest things I've ever seen! I guess it didn't work out well for the doctor though...
Kristianna Thomas
This is not Spider Tech for it really is Octopus Technology, although it really needs more than two additional arms; maybe 4, 6, or 12 additional arms. How about 2, 4, 6 or 12 additional legs to help climb, run or leap better. The military would love to have soldiers who can carry, lift and shoot more. In construction one would have to put up 4x8 foot sheets of dry wall, but in the video it shows a person holding up a small sheet of plastic; not great feat there. Although, every journey begins with a single step. We are definitely entering into the age of Robotics.
Dave Ussery
The human skeleton is only so strong would it be able to stand the strain????
Load More