{"id":70,"date":"2017-05-03T20:04:06","date_gmt":"2017-05-03T20:04:06","guid":{"rendered":"http:\/\/localhost:50002\/?page_id=70"},"modified":"2017-05-09T08:04:05","modified_gmt":"2017-05-09T08:04:05","slug":"light-in-flight","status":"publish","type":"page","link":"https:\/\/light.informatik.uni-bonn.de\/research\/light-in-flight\/","title":{"rendered":"Light in Flight"},"content":{"rendered":"Transient imaging, or light-in-flight imaging, refers to the capture and analysis of light transport at nanosecond and picosecond scales. We develop devices and methods to enable the capture and processing of such data at low cost and unprecedented speed, and to robustly reconstruct 3D scene information within and even beyond the line of sight.\r\n<h4>Publications<\/h4>\r\n<div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/super-resolution-time-resolved-imaging-using-computational-sensor-fusion\/\">Super-Resolution Time-Resolved Imaging Using Computational Sensor Fusion<\/a><\/h4><b>Clara Callenberg, Ashley Lyons, Dennis den Brok, Areeba Fatima, Alejandro Turpin, Vytautas Zickus, Laura M. Machesky, Jamie A. Whitelaw, Daniele Faccio, Matthias B. Hullin<\/b><br \/>Scientific Reports (Nature Publishing Group) 11, 1689 (2021), https:\/\/doi.org\/10.1038\/s41598-021-81159-x, 2021.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/super-resolution-time-resolved-imaging-using-computational-sensor-fusion\/\" title=\"Super-Resolution Time-Resolved Imaging Using Computational Sensor Fusion\"><img width=\"1444\" height=\"1062\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2021\/06\/superresolution.png\" class=\"lcp_thumbnail wp-post-image\" alt=\"Super-Resolution Time-Resolved Imaging Using Computational Sensor Fusion\" loading=\"lazy\" \/><\/a><p><i><\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/low-cost-spad-sensing-for-non-line-of-sight-tracking-material-classification-and-depth-imaging\/\">Low-Cost SPAD Sensing for Non-Line-Of-Sight Tracking, Material Classification and Depth Imaging<\/a><\/h4><b>Clara Callenberg, Zheng Shi, Felix Heide, Matthias B. Hullin<\/b><br \/>ACM Transactions on Graphics 40 (4), Article 61 (Proc. SIGGRAPH 2021), 2021.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/low-cost-spad-sensing-for-non-line-of-sight-tracking-material-classification-and-depth-imaging\/\" title=\"Low-Cost SPAD Sensing for Non-Line-Of-Sight Tracking, Material Classification and Depth Imaging\"><img width=\"3000\" height=\"2000\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2021\/06\/representativeImage.jpg\" class=\"lcp_thumbnail wp-post-image\" alt=\"Low-Cost SPAD Sensing for Non-Line-Of-Sight Tracking, Material Classification and Depth Imaging\" loading=\"lazy\" \/><\/a><p><i><\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/non-line-of-sight-reconstruction-using-efficient-transient-rendering\/\">Non-Line-of-Sight Reconstruction using Efficient Transient Rendering<\/a><\/h4><b>Julian Iseringhausen, Matthias B. Hullin<\/b><br \/>ACM Transactions on Graphics 39 (1), 2020.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/non-line-of-sight-reconstruction-using-efficient-transient-rendering\/\" title=\"Non-Line-of-Sight Reconstruction using Efficient Transient Rendering\"><img width=\"1295\" height=\"519\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2019\/09\/iseringhausen2018full.jpg\" class=\"lcp_thumbnail wp-post-image\" alt=\"Non-Line-of-Sight Reconstruction using Efficient Transient Rendering\" loading=\"lazy\" \/><\/a><p><i>In this paper, we present an efficient renderer for three-bounce indirect transient light transport, and use it to reconstruct objects around corners to unprecedented accuracy.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/deep-non-line-of-sight-reconstruction\/\">Deep Non-Line-of-Sight Reconstruction<\/a><\/h4><b>Javier Grau Chopite, Matthias B. Hullin, Michael Wand, Julian Iseringhausen<\/b><br \/>Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/deep-non-line-of-sight-reconstruction\/\" title=\"Deep Non-Line-of-Sight Reconstruction\"><img width=\"957\" height=\"365\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2020\/05\/deepnlos.png\" class=\"lcp_thumbnail wp-post-image\" alt=\"Deep Non-Line-of-Sight Reconstruction\" loading=\"lazy\" \/><\/a><p><i>The first deep-learning framework for reconstructing object shapes around a corner.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/single-pixel-people-identification\/\">Neural network identification of people hidden from view with a single-pixel, single-photon detector<\/a><\/h4><b>Piergiorgio Caramazza, Alessandro Boccolini, Daniel Buschek, Matthias Hullin, Catherine F. Higham, Robert Henderson, Roderick Murray-Smith, Daniele Faccio <\/b><br \/>Scientific Reports (Nature Publishing Group), 8, 11945; doi: 10.1038\/s41598-018-30390-0, 2018.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/single-pixel-people-identification\/\" title=\"Neural network identification of people hidden from view with a single-pixel, single-photon detector\"><img width=\"900\" height=\"342\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2018\/08\/caramazza.jpg\" class=\"lcp_thumbnail wp-post-image\" alt=\"Neural network identification of people hidden from view with a single-pixel, single-photon detector\" loading=\"lazy\" \/><\/a><p><i>We demonstrate a machine learning approach that can locate and identify people from time-resolved single-pixel measurements.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/machine-learning-assisted-identification-of-people-hidden-behind-a-corner\/\">Machine Learning Assisted Identification of People Hidden Behind a Corner<\/a><\/h4><b>Piergiorgio Caramazza, Alessandro Boccolini, Gabriella Musarra, Matthias Hullin, Roderick Murray-Smith, Daniele Faccio<\/b><br \/>Computational Optical Sensing and Imaging, 2017.   <p><i>We demonstrate the use of machine learning to classify temporal histograms of the light-echoes backscattered from bodies hidden from view around a corner, captured by a SPAD camera.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/material-classification-using-raw-time-of-flight-measurements\/\">Material Classification using Raw Time-of-Flight Measurements<\/a><\/h4><b>Shuochen Su, Felix Heide, Robin Swanson, Jonathan Klein, Clara Callenberg, Matthias B. Hullin, Wolfgang Heidrich<\/b><br \/>Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/material-classification-using-raw-time-of-flight-measurements\/\" title=\"Material Classification using Raw Time-of-Flight Measurements\"><img width=\"300\" height=\"75\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2017\/05\/teaser2.png\" class=\"lcp_thumbnail wp-post-image\" alt=\"Material Classification using Raw Time-of-Flight Measurements\" loading=\"lazy\" \/><\/a><p><i>We show that using multi-frequency time-of-flight measurements, five different white materials can be distinguished on a per-pixel basis.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/doppler-time-of-flight-imaging\/\">Doppler Time-of-Flight Imaging<\/a><\/h4><b>Felix Heide, Wolfgang Heidrich, Matthias B. Hullin, Gordon Wetzstein<\/b><br \/>ACM Transactions on Graphics (Proc. SIGGRAPH), 34 (4), 2015.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/doppler-time-of-flight-imaging\/\" title=\"Doppler Time-of-Flight Imaging\"><img width=\"300\" height=\"121\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2017\/05\/doppler-300.png\" class=\"lcp_thumbnail wp-post-image\" alt=\"Doppler Time-of-Flight Imaging\" loading=\"lazy\" \/><\/a><p><i>A new computational imaging system that captures metric radial velocity information per pixel -- think of a huge array of traffic speed guns that use light instead of radar.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/diffuse-mirrors-3d-reconstruction-from-diffuse-indirect-illumination-using-inexpensive-time-of-flight-sensors\/\">Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination using Inexpensive Time-of-Flight Sensors<\/a><\/h4><b>Felix Heide, Lei Xiao, Wolfgang Heidrich and Matthias B. Hullin<\/b><br \/>Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/diffuse-mirrors-3d-reconstruction-from-diffuse-indirect-illumination-using-inexpensive-time-of-flight-sensors\/\" title=\"Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination using Inexpensive Time-of-Flight Sensors\"><img width=\"300\" height=\"166\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2017\/05\/setup_render_300.jpg\" class=\"lcp_thumbnail wp-post-image\" alt=\"Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination using Inexpensive Time-of-Flight Sensors\" loading=\"lazy\" \/><\/a><p><i>How to look around a corner using echoes of light, using low-end devices that can't even properly measure such data.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/low-budget-transient-imaging-using-photonic-mixer-devices\/\">Low-Budget Transient Imaging using Photonic Mixer Devices<\/a><\/h4><b>Felix Heide*, Matthias B. Hullin*, James Gregson, Wolfgang Heidrich (* joint first authors)<\/b><br \/>ACM Transactions on Graphics (Proc. SIGGRAPH), 32 (4), 2013.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/low-budget-transient-imaging-using-photonic-mixer-devices\/\" title=\"Low-Budget Transient Imaging using Photonic Mixer Devices\"><img width=\"300\" height=\"130\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2017\/05\/transientpmd300.jpg\" class=\"lcp_thumbnail wp-post-image\" alt=\"Low-Budget Transient Imaging using Photonic Mixer Devices\" loading=\"lazy\" \/><\/a><p><i>A computational method for capturing videos of light in flight using consumer-grade imaging hardware.<\/i><\/p><\/div>","protected":false},"excerpt":{"rendered":"<p>Transient imaging, or light-in-flight imaging, refers to the capture and analysis of light transport at nanosecond and picosecond scales. We develop devices and methods to enable the capture and processing of such data at low cost and unprecedented speed, and to robustly reconstruct 3D scene information within and even beyond the line of sight. Publications<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":68,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"acf":[],"_links":{"self":[{"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/pages\/70"}],"collection":[{"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/comments?post=70"}],"version-history":[{"count":8,"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/pages\/70\/revisions"}],"predecessor-version":[{"id":242,"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/pages\/70\/revisions\/242"}],"up":[{"embeddable":true,"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/pages\/68"}],"wp:attachment":[{"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/media?parent=70"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}