Computational creativity and the future of AI

Aptima's Cognitive Patterns system helps robots make sense of the world


May 8, 2013

An iRobot PackBot navigates a school, in a demonstration of the Cognitive Patterns system

An iRobot PackBot navigates a school, in a demonstration of the Cognitive Patterns system

Image Gallery (2 images)

It’s sometimes easy to forget that for all their human-like qualities, robots are in fact machines. While some systems allow them to recognize basic objects, they still don’t necessarily make sense of what they’re looking at – they might see and recognize a box, for instance, but what does the presence of a box suggest to them? Now, researchers at Massachusetts-based engineering firm Aptima are developing a system known as Cognitive Patterns. It allows robots and humans to collaborate on building the robots’ understanding of the world, thus allowing them to operate on their own more effectively.

At the base of the system is a rich onboard database of objects that the robot can cross-reference with its relatively limited sensory input. In this way, even if not a lot of information is available visibly, what information there is can go a long way towards identifying an object. In some cases, even if an entire object isn’t entirely recognizable, its basic components may still be – by running that combination of those components through the database, a match may yet result.

When the robot is stymied by something that’s truly unidentifiable, it can combine different concepts from its database to create a unique new identity for that item. This closely resembles the process that takes place in the human brain, which allows us to interpret things as the sum of their recognizable parts, instead of just as mysteries.

In such a situation, however, the Cognitive Patterns remote user interface also allows the mostly-autonomous robot to query its human “partner” about things that it doesn’t understand. That person can respond by assigning an identity to the item, which is added to the robot’s database for future reference. This lets the robot actually learn, with some help from its teacher.

At the base of the system is a rich onboard database of objects that the robot can cross-r...

The interface also allows the user to query the robot about what it’s perceiving, it lets the robot post alerts to the user, and it displays live feeds from the robot’s video and mapping systems.

However it goes about recognizing or assigning new identities to objects, the system also provides the robot with some context. If it identifies a refrigerator, for instance, the robot is able to ascertain that it’s probably in a kitchen or lunch room. Should it be trying to locate a furnace, the robot will be able to independently figure out that the presence of a fridge strongly suggests that it’s not in the right room.

Aptima is developing Cognitive Patterns with industry partner iRobot, for DARPA's Defense Sciences Office and the US Army Research Laboratory’s Cognitive Robotics team. More information on the system is available in the video below.

Source: Aptima

About the Author
Ben Coxworth An experienced freelance writer, videographer and television producer, Ben's interest in all forms of innovation is particularly fanatical when it comes to human-powered transportation, film-making gear, environmentally-friendly technologies and anything that's designed to go underwater. He lives in Edmonton, Alberta, where he spends a lot of time going over the handlebars of his mountain bike, hanging out in off-leash parks, and wishing the Pacific Ocean wasn't so far away.   All articles by Ben Coxworth
1 Comment

Here's that slippery slope again!

9th May, 2013 @ 10:44 am PDT
Post a Comment

Login with your gizmag account:

Or Login with Facebook:

Related Articles
Looking for something? Search our 31,314 articles
Recent popular articles in Robotics
Product Comparisons