Photography

Photos with overexposed highlights could one day be a thing of the past

Photos with overexposed highlights could one day be a thing of the past
The highlight recovery allowed by the larger dynamic range of a modulo camera could mean no more overexposed images
The highlight recovery allowed by the larger dynamic range of a modulo camera could mean no more overexposed images
View 2 Images
The highlight recovery allowed by the larger dynamic range of a modulo camera could mean no more overexposed images
1/2
The highlight recovery allowed by the larger dynamic range of a modulo camera could mean no more overexposed images
Simulated images shoing how the larger dynamic range of a modulo camera could be "unwrapped" to produce HDR images
2/2
Simulated images shoing how the larger dynamic range of a modulo camera could be "unwrapped" to produce HDR images

Researchers at MIT Media Lab have proposed a new camera technology which could see an end to overexposed images. The modulo camera would work by employing a sensor which can reset the sensor capacitors of pixels as they overexpose, and "unwrapping" algorithms to recover color information which would otherwise have been lost in blown highlights.

There can't be many photographers who haven't suffered at the hands of tricky-to-photograph high-contrast scenes which combine bright and dark areas, where it can be all too easy to overexpose a shot, resulting in washed-out white patches. As such, many photographers are left relying on the dynamic range of their digital camera and trying to balance images in post production, or combining multiple exposures into a single HDR image.

However, a team from MIT Media Lab has come up with a different approach which uses a modulo sensor and new image-processing algorithms to ensure overexposed images are a thing of the past. Collaboration with MIT Lincoln Lab sees the pixel architecture of Digital-pixel Focal Plane Array (DFPA) technology, which features the ability to do on-the-fly digital signal processing, recast as a modulo sensor which can make adjustments on a per-pixel level.

Simulated images shoing how the larger dynamic range of a modulo camera could be "unwrapped" to produce HDR images
Simulated images shoing how the larger dynamic range of a modulo camera could be "unwrapped" to produce HDR images

As such, the modulo camera does not suffer from the problem of overexposure in the same way as traditional digital cameras, because whenever a pixel value gets to its maximum capacity during photon collection, it can be reset and exposed again. Receiving an excess amount of light would normally result in unrecoverable overexposure of those pixels, but this way the camera is able to calculate how much light was received, by how many times each pixel reached maximum capacity and was reset.

This information would produce the sort of psychedelic images seen in the middle of the simulated illustrations before newly proposed "unwrapping" algorithms are used to tap into the larger dynamic range that was captured. The result is the ability to recover Unbounded High Dynamic Range (UHDR) images from situations that traditional digital cameras would not have been able to.

While tests have currently been limited to a low-res lab-bound prototype camera, it's easy to see how this could develop and be deployed in DSLR or smartphone cameras. Researchers also see applications for real-time HDR cameras in robotic vision, such as in a driverless car driving into a tunnel where the contrast currently leaves most cameras temporarily blind.

You can check out a video explaining the tech below.

Source: MIT Media Lab

Unbounded High Dynamic Range Photography using a Modulo Camera_with audio

2 comments
2 comments
minivini
The way the technology is described, it sounds as though multiple images are captured at different exposures and then recombined. I don't think that's what the narrator intends to convey - but using the rain bucket analogy, that's how it appears.

This would be an excellent tech to add to everything from cellphone cameras to professional DSLRs, if indeed separate sensors are used (as it seems to state). Building a proprietary camera utilizing this new tech would be disastrous. Hopefully it'll be embraced by the entire market spectrum. Otherwise, I'll have to keep using fill flash for people and multiple exposures for landscape/architecture.
Deres
Such a feature would be a great enhancement to current sate of the art photograpphy. I hope it would also enhance photos in low luminosity.