All Photons Imaging—Computational Imaging Through Scattering for Vehicles and Medical Applications with Time-Resolved, Data Driven Algorithms

One of the greatest challenges in computational imaging is scaling it to work outside the lab. The main reasons for that challenge are the strong dependency on precise calibration, accurate physical models, and long acquisition times. These prevent practical progress towards medical imaging and seeing through occlusions such as fog with visible light in the wild. This dissertation demonstrates that with time-resolved, data driven, and probabilistic modeling we can alleviate these dependencies, and pave the way towards real world computational imaging through extreme scattering conditions using visible light.

The ability to image through scattering media in the visible part of the electromagnetic spectrum holds many applications in various industries. For example, seeing through fog would enable autonomous robots to operate in challenging weather conditions; augment human driving; and allow airplanes, helicopters, and drones to take off and land in dense fog conditions. In medical imaging, the ability to see into the body in the visible range would reduce the exposure to ionizing radiation and provide more clinically meaningful data. 

In order to image in diverse and extreme scattering conditions, we develop novel algorithms inspired by techniques in signal processing, optimization, statistical analysis, compressive sensing, and machine learning that leverage time-resolved measurement.

We consider four cases of imaging through scattering media with increasing complexity: 1) a theoretical analysis of time-resolved single pixel imaging, which demonstrates scene reconstruction even when the entire scene is measured with a single pixel, an equivalent of simple scattering or a blur that is easy to model. 2) A data driven calibration invariant technique for imaging through simple scattering (a sheet of paper). 3) Imaging through a thick tissue phantom with minimal assumptions on the tissue properties. And, 4) Imaging through a wide range of dense, dynamic, and heterogeneous fog conditions. In that case, we introduce a probabilistic model that is able to recover the occluded target without any assumption about the fog.

Committee members:

Ramesh Raskar
Associate Professor in Media Arts and Sciences, Massachusetts Institute of Technology

Joseph A. Paradiso
Alexander W. Dreyfoos (1954) Professor in Media Arts and Sciences, Massachusetts Institute of Technology

Fadel Adib
Assistant Professor in Media Arts and Sciences, Massachusetts Institute of Technology