{"id":814,"date":"2021-07-14T14:35:19","date_gmt":"2021-07-14T14:35:19","guid":{"rendered":"https:\/\/light.informatik.uni-bonn.de\/?page_id=814"},"modified":"2021-07-14T14:43:03","modified_gmt":"2021-07-14T14:43:03","slug":"echo","status":"publish","type":"page","link":"https:\/\/light.informatik.uni-bonn.de\/research\/echo\/","title":{"rendered":"ECHO"},"content":{"rendered":"The automated analysis of visual data is a key enabler for industrial and consumer technologies and of immense economic and social importance. Its main challenge is in the inherent ambiguity of images due to the very mechanism of image capture: light reaching a pixel on different paths or at different times is mixed irreversibly. Consequently, even after decades of extensive research, problems like deblurring or descattering, geometry\/material estimation or motion tracking are still largely unsolved and will remain so in the foreseeable\r\nfuture.<p \/>\r\nTransient imaging (TI) tackles this problem by recording ultrafast optical echoes that unmix light contributions by the total pathlength. So far, TI used to require high-end measurement setups. By introducing computational TI (CTI), we paved the way for a lightweight capture of transient data using consumer hardware. We showed the potential of CTI in scenarios like robust range measurement, descattering and imaging of objects outside the line of sight \u2013 tasks that had been considered difficult to impossible so far.\r\nThe ECHO project is rooted in computer graphics and computational imaging. In it, we will overcome the practical limitations that are hampering a large-scale deployment of TI: the time required for data capture and to reconstruct the desired information, both in the order of seconds to minutes, a lack of dedicated image priors and of quality guarantees for the reconstruction, the limited accuracy and performance of forward models and the lack of ground-truth data and benchmark methods.\r\nOver the course of ECHO, we will pioneer advanced capture setups and strategies, formation models, priors and numerical methods, for the first time enabling real-time reconstruction and analysis of transient light transport in complex and dynamic scenes. The methodology developed in this far-reaching project will turn TI from a research technology into a family of practical tools that will immediately benefit many applications.\r\n<p \/>\r\n<strong>ECHO is funded by ERC Starting Grant 802192 (funding period 12\/2018 &#8211; 11\/2023).<\/strong>\r\n\r\n<a href=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2021\/07\/erclogo_on_white_200.png\"><img loading=\"lazy\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2021\/07\/erclogo_on_white_200.png\" alt=\"The ECHO project is funded by the European Research Council.\" width=\"482\" height=\"200\" class=\"aligncenter size-full wp-image-820\" style=\"border:none\" \/><\/a>\r\n<h4>Project Team<\/h4>\r\n<div class=\"person\">\r\n<div class=\"specs\" style=\"background-image:url(&quot;\/photos\/matthias2.jpg&quot;);\">\r\n<h4><a href=\"\/team\/matthias-hullin\">Prof. Dr.-Ing. Matthias B. Hullin<\/a><\/h4>\r\n<br \/><b>Principal Investigator<\/b>\r\n<br \/>\r\nE-mail: hullin@&#8230;<br \/>\r\nPhone: +49 228 73-54169\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"person\">\r\n<div class=\"specs\" style=\"background-image:url(&quot;\/photos\/clara.jpg&quot;);\">\r\n<h4><a href=\"\/team\/clara-callenberg\">Clara Callenberg<\/a><\/h4>\r\n<br \/><b>PhD Researcher<\/b>\r\n<br \/>\r\nE-mail: callenbe@&#8230;<br \/>\r\nPhone: +49 228 73-60636\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"person\">\r\n<div class=\"specs\" style=\"background-image:url(&quot;\/photos\/javier.jpg&quot;);\">\r\n<h4><a href=\"\/team\/javier-grau-chopite\">M.Sc. Javier Grau Chopite<\/a><\/h4>\r\n<br \/><b>PhD Researcher<\/b>\r\n<br \/>\r\nE-mail: jgraucho@uni-bonn.de\r\n<br \/>Phone: +49 228 73-60642\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"person\">\r\n<div class=\"specs\" style=\"background-image:url(&quot;\/photos\/person.png&quot;);\">\r\n<h4><a href=\"\/team\/weizhen-huang\">M.Sc. Weizhen Huang<\/a><\/h4>\r\n<br \/><b>PhD Researcher<\/b>\r\n<br \/>\r\nE-mail: whuang@&#8230;\r\n<br \/>Phone: +49 228 73-60740\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"person\">\r\n<div class=\"specs\" style=\"background-image:url(&quot;\/photos\/markus.jpg&quot;);\">\r\n<h4><a href=\"\/team\/markus-plack\">M.Sc. Markus Plack<\/a><\/h4>\r\n<br \/><b>PhD Researcher<\/b>\r\n<br \/>\r\nE-mail: mplack@&#8230;\r\n<br \/>Phone: +49 228 73-4546\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n\r\n<div class=\"person\">\r\n<div class=\"specs\" style=\"background-image:url(&quot;\/photos\/person.png&quot;);\">\r\n<h4>Patrick H\u00e4hn<\/h4>\r\n<br \/><b>Student Helper<\/b>\r\n<\/div>\r\n<\/div>\r\n\r\n<h3>Former members \/ graduates<\/h3>\r\n\r\n<div class=\"person\">\r\n<div class=\"specs\" style=\"background-image:url(&quot;\/photos\/jonathan.jpg&quot;);\">\r\n<h4>Dr. rer. nat. Jonathan Klein<\/h4>\r\n<br \/><b>PhD Researcher<\/b>\r\n\r\n<br \/>E-mail: kleinj@&#8230;\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"person\">\r\n<div class=\"specs\" style=\"background-image:url(&quot;\/photos\/sebastian.jpg&quot;);\">\r\n<h4>Dr. rer. nat. Sebastian Thiel (n\u00e9 Werner)<\/h4>\r\n<br \/><b>PhD Researcher. Now at Max Planck Institute for Radio Astronomy.<\/b>\r\n\r\n<br \/>E-mail: werners@&#8230;\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"person\">\r\n<div class=\"specs\" style=\"background-image:url(&quot;\/photos\/person.png&quot;);\">\r\n<h4>Dr. rer. nat. Julian Iseringhausen<\/h4>\r\n<br \/><b>PhD Researcher \/ Postdoc (now at Google Research)<\/b>\r\n\r\n<br \/>E-mail: uni-bonn@iseringhausen.graphics\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"person\">\r\n<div class=\"specs\" style=\"background-image:url(&quot;\/photos\/person.png&quot;);\">\r\n<h4>Candice Ottersbach<\/h4>\r\n<b>Bachelor&#8217;s Student<\/b>\r\n<\/div>\r\n<\/div>\r\n\r\n<h4>Publications<\/h4>\r\n<div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/rendering-iridescent-rock-dove-neck-feathers\/\">Rendering Iridescent Rock Dove Neck Feathers<\/a><\/h4><b>Weizhen Huang, Sebastian Merzbach, Clara Callenberg, Doekele G. Stavenga, Matthias B. Hullin<\/b><br \/>In Proceedings of SIGGRAPH 2022 (Conference Papers), 2022.   <p><i>A practical appearance model for iridescent feathers.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/a-microfacet-based-hair-scattering-model\/\">A Microfacet-based Hair Scattering Model<\/a><\/h4><b>Weizhen Huang, Matthias B. Hullin, Johannes Hanika<\/b><br \/>Computer Graphics Forum 41 (4) (Proc. EGSR 2022), 2022.   <p><i>The first fiber scattering model based on physically plausible macro-, meso-, and microgeometry.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/super-resolution-time-resolved-imaging-using-computational-sensor-fusion\/\">Super-Resolution Time-Resolved Imaging Using Computational Sensor Fusion<\/a><\/h4><b>Clara Callenberg, Ashley Lyons, Dennis den Brok, Areeba Fatima, Alejandro Turpin, Vytautas Zickus, Laura M. Machesky, Jamie A. Whitelaw, Daniele Faccio, Matthias B. Hullin<\/b><br \/>Scientific Reports (Nature Publishing Group) 11, 1689 (2021), https:\/\/doi.org\/10.1038\/s41598-021-81159-x, 2021.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/super-resolution-time-resolved-imaging-using-computational-sensor-fusion\/\" title=\"Super-Resolution Time-Resolved Imaging Using Computational Sensor Fusion\"><img width=\"1444\" height=\"1062\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2021\/06\/superresolution.png\" class=\"listthumb wp-post-image\" alt=\"Super-Resolution Time-Resolved Imaging Using Computational Sensor Fusion\" loading=\"lazy\" \/><\/a><p><i><\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/low-cost-spad-sensing-for-non-line-of-sight-tracking-material-classification-and-depth-imaging\/\">Low-Cost SPAD Sensing for Non-Line-Of-Sight Tracking, Material Classification and Depth Imaging<\/a><\/h4><b>Clara Callenberg, Zheng Shi, Felix Heide, Matthias B. Hullin<\/b><br \/>ACM Transactions on Graphics 40 (4), Article 61 (Proc. SIGGRAPH 2021), 2021.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/low-cost-spad-sensing-for-non-line-of-sight-tracking-material-classification-and-depth-imaging\/\" title=\"Low-Cost SPAD Sensing for Non-Line-Of-Sight Tracking, Material Classification and Depth Imaging\"><img width=\"3000\" height=\"2000\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2021\/06\/representativeImage.jpg\" class=\"listthumb wp-post-image\" alt=\"Low-Cost SPAD Sensing for Non-Line-Of-Sight Tracking, Material Classification and Depth Imaging\" loading=\"lazy\" \/><\/a><p><i><\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/non-line-of-sight-reconstruction-using-efficient-transient-rendering\/\">Non-Line-of-Sight Reconstruction using Efficient Transient Rendering<\/a><\/h4><b>Julian Iseringhausen, Matthias B. Hullin<\/b><br \/>ACM Transactions on Graphics 39 (1), 2020.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/non-line-of-sight-reconstruction-using-efficient-transient-rendering\/\" title=\"Non-Line-of-Sight Reconstruction using Efficient Transient Rendering\"><img width=\"1295\" height=\"519\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2019\/09\/iseringhausen2018full.jpg\" class=\"listthumb wp-post-image\" alt=\"Non-Line-of-Sight Reconstruction using Efficient Transient Rendering\" loading=\"lazy\" \/><\/a><p><i>In this paper, we present an efficient renderer for three-bounce indirect transient light transport, and use it to reconstruct objects around corners to unprecedented accuracy.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/wood-pixels\/\">Computational Parquetry: Fabricated Style Transfer with Wood Pixels<\/a><\/h4><b>Julian Iseringhausen, Michael Weinmann, Weizhen Huang, Matthias B. Hullin<\/b><br \/>ACM Transactions on Graphics 39 (2), 2020.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/wood-pixels\/\" title=\"Computational Parquetry: Fabricated Style Transfer with Wood Pixels\"><img width=\"888\" height=\"600\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2019\/09\/0052.jpg\" class=\"listthumb wp-post-image\" alt=\"Computational Parquetry: Fabricated Style Transfer with Wood Pixels\" loading=\"lazy\" \/><\/a><p><i>A new computational woodworking technique enabled by analysis of features found in natural materials.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/chemomechanical-simulation-of-soap-film-flow-on-spherical-bubbles\/\">Chemomechanical Simulation of Soap Film Flow on Spherical Bubbles<\/a><\/h4><b>Weizhen Huang, Julian Iseringhausen, Tom Kneiphof, Ziyin Qu, Chenfanfu Jiang, Matthias B. Hullin<\/b><br \/>ACM Transactions on Graphics 39 (4) (Proc. SIGGRAPH), 2020.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/chemomechanical-simulation-of-soap-film-flow-on-spherical-bubbles\/\" title=\"Chemomechanical Simulation of Soap Film Flow on Spherical Bubbles\"><img width=\"2029\" height=\"1080\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2020\/05\/papers_101s3.jpg\" class=\"listthumb wp-post-image\" alt=\"Chemomechanical Simulation of Soap Film Flow on Spherical Bubbles\" loading=\"lazy\" \/><\/a><p><i>A framework for simulating the intricate flow within spherical soap films.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/deep-non-line-of-sight-reconstruction\/\">Deep Non-Line-of-Sight Reconstruction<\/a><\/h4><b>Javier Grau Chopite, Matthias B. Hullin, Michael Wand, Julian Iseringhausen<\/b><br \/>Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/deep-non-line-of-sight-reconstruction\/\" title=\"Deep Non-Line-of-Sight Reconstruction\"><img width=\"957\" height=\"365\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2020\/05\/deepnlos.png\" class=\"listthumb wp-post-image\" alt=\"Deep Non-Line-of-Sight Reconstruction\" loading=\"lazy\" \/><\/a><p><i>The first deep-learning framework for reconstructing object shapes around a corner.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/trigonometric-moments-for-editable-structured-light-range-finding\/\">Trigonometric moments for editable structured light range finding<\/a><\/h4><b>Sebastian Werner, Julian Iseringhausen, Clara Callenberg, Matthias B. Hullin<\/b><br \/>Proc. Vision, Modeling and Visualization, Rostock, Germany , 2019.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/trigonometric-moments-for-editable-structured-light-range-finding\/\" title=\"Trigonometric moments for editable structured light range finding\"><img width=\"2430\" height=\"1600\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2019\/10\/WernerEtAl-MomentBasedStructuredLight-VMV2019-preview.png\" class=\"listthumb wp-post-image\" alt=\"Trigonometric moments for editable structured light range finding\" loading=\"lazy\" \/><\/a><p><i>We enhance existing structured light phase shifting methods by using trigonometric moments.<\/i><\/p><\/div><div class='publist-item'><h4 class=\"lcp_post\"><a href=\"https:\/\/light.informatik.uni-bonn.de\/a-quantitative-platform-for-non-line-of-sight-imaging-problems\/\">A Quantitative Platform for Non-Line-of-Sight Imaging Problems<\/a><\/h4><b>Jonathan Klein, Martin Laurenzis, Dominik L. Michels, Matthias B. Hullin<\/b><br \/>In Proceedings of British Machine Vision Conference (BMVC 2018), Northumbria University, Newcastle, UK, September 3-6, 2018, 2018.   <a href=\"https:\/\/light.informatik.uni-bonn.de\/a-quantitative-platform-for-non-line-of-sight-imaging-problems\/\" title=\"A Quantitative Platform for Non-Line-of-Sight Imaging Problems\"><img width=\"400\" height=\"151\" src=\"https:\/\/light.informatik.uni-bonn.de\/wp-content\/uploads\/2018\/09\/representative-image.png\" class=\"listthumb wp-post-image\" alt=\"A Quantitative Platform for Non-Line-of-Sight Imaging Problems\" loading=\"lazy\" \/><\/a><p><i>In this paper, we present a reference database of time-resolved light echoes for non-line-of-sight sensing.<\/i><\/p><\/div>","protected":false},"excerpt":{"rendered":"<p>The automated analysis of visual data is a key enabler for industrial and consumer technologies and of immense economic and social importance. Its main challenge is in the inherent ambiguity of images due to the very mechanism of image capture: light reaching a pixel on different paths or at different times is mixed irreversibly. Consequently, &#8230;<a class=\"post-readmore\" href=\"https:\/\/light.informatik.uni-bonn.de\/research\/echo\/\">read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":68,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"acf":[],"_links":{"self":[{"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/pages\/814"}],"collection":[{"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/comments?post=814"}],"version-history":[{"count":9,"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/pages\/814\/revisions"}],"predecessor-version":[{"id":826,"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/pages\/814\/revisions\/826"}],"up":[{"embeddable":true,"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/pages\/68"}],"wp:attachment":[{"href":"https:\/\/light.informatik.uni-bonn.de\/wp-json\/wp\/v2\/media?parent=814"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}