Mobile Technology

Structure Sensor: 3D scanning and augmented reality for iPad

Structure Sensor: 3D scanning and augmented reality for iPad
Structure Sensor brings sophisticated 3D scanning and augmented reality to your mobile device
Structure Sensor brings sophisticated 3D scanning and augmented reality to your mobile device
View 48 Images
Structure Sensor fits onto your iPad with an included bracket
1/48
Structure Sensor fits onto your iPad with an included bracket
Structure Sensor is hackable for use in your own devices, here, an Oculus Rift
2/48
Structure Sensor is hackable for use in your own devices, here, an Oculus Rift
Structure Sensor can be used for body scanning
3/48
Structure Sensor can be used for body scanning
A generated top-down view of a room 3D scanned with Structure Sensor
4/48
A generated top-down view of a room 3D scanned with Structure Sensor
In this augmented reality demo, a virtual cat interacts with a real room
5/48
In this augmented reality demo, a virtual cat interacts with a real room
Structure Sensor comes in two finishes, both anodized aluminum
6/48
Structure Sensor comes in two finishes, both anodized aluminum
Structure Sensor can scan a whole room and provide measurements
7/48
Structure Sensor can scan a whole room and provide measurements
Sensor Structure can be used to scan an object and create a CAD file
8/48
Sensor Structure can be used to scan an object and create a CAD file
A demo of the quality of Structure Sensor's 3D scanning: 3D printed Pooh and source Pooh
9/48
A demo of the quality of Structure Sensor's 3D scanning: 3D printed Pooh and source Pooh
Acquiring an object with Structure Sensor
10/48
Acquiring an object with Structure Sensor
Structure Sensor is made for iPad, but also useable with PC, iOS, Android, or Linux
11/48
Structure Sensor is made for iPad, but also useable with PC, iOS, Android, or Linux
Acquiring an object with Structure Sensor
12/48
Acquiring an object with Structure Sensor
Structure Sensor can detect occlusions and real-word physics; here, virtual balls fill in behind a real-world table
13/48
Structure Sensor can detect occlusions and real-word physics; here, virtual balls fill in behind a real-world table
A Structure Sensor kit comes with a mounting bracket to custom fit each type of iPad
14/48
A Structure Sensor kit comes with a mounting bracket to custom fit each type of iPad
Structure Sensor uses the new Lightning connector
15/48
Structure Sensor uses the new Lightning connector
Closeup to the Structure Sensor, a 3D scanner for your iPad
16/48
Closeup to the Structure Sensor, a 3D scanner for your iPad
Closeup to the Structure Sensor, a 3D scanner for your iPad
17/48
Closeup to the Structure Sensor, a 3D scanner for your iPad
Structure Sensor brings sophisticated 3D scanning and augmented reality to your mobile device
18/48
Structure Sensor brings sophisticated 3D scanning and augmented reality to your mobile device
A Structure Sensor kit comes with a mounting bracket to custom fit each type of iPad
19/48
A Structure Sensor kit comes with a mounting bracket to custom fit each type of iPad
20/48
21/48
22/48
23/48
24/48
25/48
26/48
27/48
28/48
29/48
30/48
31/48
32/48
33/48
34/48
35/48
36/48
37/48
38/48
39/48
40/48
41/48
42/48
43/48
44/48
45/48
46/48
47/48
48/48
View gallery - 48 images

Structure Sensor is a clip on accessory for iPad that's designed to let you 3D scan objects, play augmented reality games and build a digital manipulable model of a room, complete with measurements. Occipital is looking to bring this sleek device to market by raising funds on Kickstarter, where it exceeded its funding goal within the first few hours.

Occipital’s roots are in software, most notably the 360 Panorama app. However, after seeing the potential of the Kinect for 3D applications, founder Jeff Powers was inspired to create a similar mobile tool that wasn’t hampered by needing a powerful desktop CPU or electrical plug-ins.

The Structure Sensor attaches to your device using the included bracket, which overlays PrimeSense 3D sensors with the iPad's camera. IR lasers essentially allow the Structure Sensor to see in the dark or invisibly signal another device. Scanning range begins as close as 40 cm and extends to 3.5 meters, so can be used for small objects or for a whole room.

Structure Sensor can scan a whole room and provide measurements
Structure Sensor can scan a whole room and provide measurements

The Structure Sensor will ship with several demo apps, most of which have videos of their own on the Kickstarter page, but Occipital makes it clear that the project is really about creating a platform. Access to the low level sensor is open to developers, or there’s an API available for those who just want to use its features in their own apps. Hence, Kickstarter reward levels include packages for development teams and hackers.

Structure Sensor is hackable for use in your own devices, here, an Oculus Rift
Structure Sensor is hackable for use in your own devices, here, an Oculus Rift

However, the apps that are included are impressive. You can scan and export an object to CAD or for printing. Walk around your room, acquiring a 3D model which you can interact with for measurements or to zoom out to a bird’s eye view. The other two apps demo the augmented reality gaming potential. In one a virtual pet interacts with your furniture, while the other demos the app’s ability to find edges and corners, with virtual balls bouncing helter skelter around the real-time geometry of the room.

In this augmented reality demo, a virtual cat interacts with a real room
In this augmented reality demo, a virtual cat interacts with a real room

Despite the Structure Sensor being designed for iPads with the new Lightning connector, Android users aren’t left out in the 2D cold. Drivers for Windows, Android, OS X, and Linux are provided, and connecting is simply a matter of using the right USB OTG cable for your device.

It’s easy to see this device being useful in a range of functions for engineers, designers, realtors, or gamers. Pledges start at $349 and the company says it is "near ready to begin manufacturing the first run of Structure Sensors Betas," with shipping expected to start in February 2014. Below is Structure Sensor’s Kickstarter pitch video.

Source: Structure Sensor, Kickstarter

View gallery - 48 images
5 comments
5 comments
MG127
it's a bit expensive for just a double-(IR)camera system with the right software. (btw there are open source solutions for DIY camera setups)
yrag
MG127, If you think it's a plain camera, you REALLY missed the point entirely. Is the Kinnect just a camera?
Why don't you actually take the time to read--not scan the article, and WATCH the video, before you make an uninformed comment.
DonGateley
yrag, why can't you just explain the difference instead of spouting all that hostile belittlement?
kalqlate
And technology marches on! It will be only one or two years before this technology is integrated into smartphones and other smart devices, becoming as standard a feature as compass, accelerometer, GPS, etc. As Samsung continues to press the Galaxy Note into service as the ultimate computing aid, look for them to license this technology, miniaturize it, and implement it as a first in the Note 4, 5, or 6.
Shachar Oz
That's awesome! just like my idea for HomeDesignAR app ! sweet. I wish you guys good luck.