Light in Flight

Transient imaging, or light-in-flight imaging, refers to the capture and analysis of light transport at nanosecond and picosecond scales. We develop devices and methods to enable the capture and processing of such data at low cost and unprecedented speed, and to robustly reconstruct 3D scene information within and even beyond the line of sight.


Neural network identification of people hidden from view with a single-pixel, single-photon detector

Piergiorgio Caramazza, Alessandro Boccolini, Daniel Buschek, Matthias Hullin, Catherine F. Higham, Robert Henderson, Roderick Murray-Smith, Daniele Faccio
Scientific Reports (Nature Publishing Group), 8, 11945; doi: 10.1038/s41598-018-30390-0, 2018.

We demonstrate a machine learning approach that can locate and identify people from time-resolved single-pixel measurements.

Non-Line-of-Sight Reconstruction using Efficient Transient Rendering

Julian Iseringhausen, Matthias B. Hullin
arXiv:1809.08044 [cs.GR], Sept. 2018, 2018.

In this paper, we present an efficient renderer for three-bounce indirect transient light transport, and use it to reconstruct objects around corners to unprecedented accuracy.

Machine Learning Assisted Identification of People Hidden Behind a Corner

Piergiorgio Caramazza, Alessandro Boccolini, Gabriella Musarra, Matthias Hullin, Roderick Murray-Smith, Daniele Faccio
Computational Optical Sensing and Imaging, 2017.

We demonstrate the use of machine learning to classify temporal histograms of the light-echoes backscattered from bodies hidden from view around a corner, captured by a SPAD camera.

Material Classification using Raw Time-of-Flight Measurements

Shuochen Su, Felix Heide, Robin Swanson, Jonathan Klein, Clara Callenberg, Matthias B. Hullin, Wolfgang Heidrich
Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.

We show that using multi-frequency time-of-flight measurements, five different white materials can be distinguished on a per-pixel basis.

Doppler Time-of-Flight Imaging

Felix Heide, Wolfgang Heidrich, Matthias B. Hullin, Gordon Wetzstein
ACM Transactions on Graphics (Proc. SIGGRAPH), 34 (4), 2015.

A new computational imaging system that captures metric radial velocity information per pixel -- think of a huge array of traffic speed guns that use light instead of radar.

Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination using Inexpensive Time-of-Flight Sensors

Felix Heide, Lei Xiao, Wolfgang Heidrich and Matthias B. Hullin
Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.

How to look around a corner using echoes of light, using low-end devices that can't even properly measure such data.

Low-Budget Transient Imaging using Photonic Mixer Devices

Felix Heide*, Matthias B. Hullin*, James Gregson, Wolfgang Heidrich (* joint first authors)
ACM Transactions on Graphics (Proc. SIGGRAPH), 32 (4), 2013.

A computational method for capturing videos of light in flight using consumer-grade imaging hardware.