Single-Photon Imaging at SIGGRAPH

Live demo of several single-photon camera applications, including computer vision in low-light, software-defined imaging, low-light event sensing, high dynamic range imaging, and high-speed videography.

Single-photon sensors are a novel class of imaging sensors that are sensitive to the individual arrival of photons. In recent years, single-photon sensors have witnessed rapid growth in key sensor characteristics such as array resolution, which, for the first time, has made computer vision and imaging with these emerging sensors possible. This rapid growth has also spurred the development of algorithms that can harness the rich spatio-temporal scene information captured by single-photon sensors, which has led to several new imaging capabilities. These capabilities include imaging in challenging SNR conditions, high-dynamic range imaging, compensating extreme camera motion extents, and even providing the functionality of numerous imaging systems via post-capture processing. Our demo showcased these exciting capabilities to a wide computer vision and graphics audience at SIGGRAPH, and in doing so, made a case for the mainstream adoption of single-photon technology.

Publications

A Live Demo of Single-Photon Imaging and Applications

Sacha Jungerman, Varun Sundar, Mohit Gupta

ACM SIGGRAPH 2024 Emerging Technologies (E-Tech) 2024

IEEE CVPR 2024 Demo

Best Demo (“best-in-show”) Award at SIGGRAPH 2024 E-Tech

pdf
@inproceedings{10.1145/3641517.3664397,
author = {Jungerman, Sacha and Sundar, Varun and Gupta, Mohit},
title = {A Live Demo of Single-Photon Imaging and Applications},
year = {2024},
isbn = {9798400705243},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3641517.3664397},
doi = {10.1145/3641517.3664397},
abstract = {Single-photon sensors are a novel class of imaging sensors that are sensitive to the individual arrival of photons. In recent years, single-photon sensors have witnessed rapid growth in key sensor characteristics such as array resolution, which, for the first time, has made computer vision and imaging with these emerging sensors possible. This rapid growth has also spurred the development of algorithms that can harness the rich spatio-temporal scene information captured by single-photon sensors, which has led to several new imaging capabilities. These capabilities include imaging in challenging SNR conditions, high-dynamic range imaging, compensating extreme camera motion extents, and even providing the functionality of numerous imaging systems via post-capture processing. Our demo will showcase these exciting capabilities to a wide computer vision and graphics audience, and in doing so, make a case for the mainstream adoption of single-photon technology.},
booktitle = {ACM SIGGRAPH 2024 Emerging Technologies},
articleno = {1},
numpages = {3},
keywords = {Single-photon camera, high dynamic range, high-speed imaging, low-light imaging, motion compensation, quanta image sensors, single-photon avalanche diode, software-defined cameras.},
location = {Denver, CO, USA},
series = {SIGGRAPH ’24}
}