Computational creativity and the future of AI

AR system lets engineers show remote technicians what they're talking about


July 12, 2011

A new augmented reality system allows engineers to provide visual instructions to remote t...

A new augmented reality system allows engineers to provide visual instructions to remote technicians repairing machines, and it doesn't require internet access (Photo: Fraunhofer)

It can be very frustrating trying to fix something, when the person instructing you isn't there in person, but is instead communicating with you over a phone line - "Whaddaya mean, 'The silver cap'? Which silver cap?!" This is why engineers sometimes need to be flown in to factories or other places that use complex machines, to make repairs that simply can't be explained verbally. Researchers from the Fraunhofer Institute for Communication, Information Processing and Ergonomics, however, have developed an augmented reality system that lets those engineers provide real-time visual instructions to distant on-site technicians ... and it can be done without internet access.

To use the system, the on-site technician would need a laptop computer with a rear-facing webcam. This would allow it to see the malfunctioning machine, without the technician blocking its view.

Each section of the machine would have a physical 2D barcode tag placed on it, which a program running on the computer would read via the camera. That barcode data would be sent through a standard telecommunications network, to the computer of the engineer providing the expertise. There, another program would apply the received data to a CAD image of the machine. Not only would a computer image of the machine come up on the engineer's screen, but it would be displayed from the same angle as the video image on the technician's screen. If the technician were to pick up their computer and move it around the machine, the CAD image on the engineer's screen would change accordingly.

Using a chat protocol, the engineer could then add pop-ups that would appear on the technician's screen, referring to specific parts of the machine (such as "I mean this silver cap, right here"). These pop-ups would remain visually linked to the same parts, even if the technician changed the viewing angle of their computer. Once they were done with a certain part of the machine, the technician could remove the corresponding pop-up from their screen simply by clicking on it. They could also talk directly to the engineer, via the phone line.

Because no internet access would be necessary, the system would be ideal for use in remote locations. Fraunhofer has developed a working prototype, and is planning on field testing it with industry users.

About the Author
Ben Coxworth An experienced freelance writer, videographer and television producer, Ben's interest in all forms of innovation is particularly fanatical when it comes to human-powered transportation, film-making gear, environmentally-friendly technologies and anything that's designed to go underwater. He lives in Edmonton, Alberta, where he spends a lot of time going over the handlebars of his mountain bike, hanging out in off-leash parks, and wishing the Pacific Ocean wasn't so far away.   All articles by Ben Coxworth
Post a Comment

Login with your gizmag account:

Or Login with Facebook:

Related Articles
Looking for something? Search our 31,564 articles