Monday, November 06, 2023

Sony Blog-post on Single-photon Imaging

SONY published a blog-post about our work on single-photon imaging as part of Sony’s Faculty Innovation Award program. We have been fortunate to be supported by Sony for the past three years to perform research on computer vision with single-photon cameras. 

Sunday, October 22, 2023

Single-photon Imaging at ICCV’23 in Paris

U. Toronto presented their award-winning paper on passive high-speed single-photon imaging. It’s a nice shot-in-the-arm for this exciting and rapidly developing research area! Congratulations!

WISION Lab presented four papers on various aspects of single-photon imaging:

a) SoDaCam: If you capture every incident photon, you can computationally recreate a variety of cameras (normal cameras, HDR cameras, event cameras, high-speed cameras, etc.) — after-the-fact — all from photons captured by one single-photon camera. Taking the idea of software-defined cameras to its limit, starting from digital cameras (pixels), light-field cameras (rays) to individual photons. Getting closer toward the goal of a single, all-purpose camera?

b) Eulerian Single-Photon Vision: Single-photon cameras are known to be power / compute / bandwidth hungry? This work shows that it’s possible to do fast low-level vision (edge detection, optical flow) in extreme low light with single-photon cameras on a tight computational and memory budget.

c) Panoramas from Photons: Can we capture scene representation under extreme conditions (ultra low-light, rapidly moving camera)? How many of us have been prompted to slow down the camera when making a panorama with our iPhones? Wouldn’t it be nice to take a high-quality gigapixel panoramic of a starry night sky? This paper tackles classical vision problems (motion estimation, feature correspondence) under the extreme regime of single-photon imaging. Also features the largest (so far) single-photon panorama ever captured!

d) Compressive Single-Photon Cameras: Another major challenge faced by single-photon cameras is that of data deluge. These sensors capture orders of magnitude more data, making it challenging, if not impossible, for downstream algorithms to keep up. This is especially critical in real-time and resource-constrained applications (e.g., robot navigation, autonomous driving). This work takes steps to address this problem by designing novel compressed representations of raw single-photon data. The key is to compute these representations on the fly as photons come in, thus achieving 1-2 orders of magnitude compression only with lightweight computational operations that can be implemented on-chip. 

Sunday, October 22, 2023

Colorful Single-Photon Imaging at SIGGRAPH’23

Single-photon cameras have come a long way from their single-pixel versions till just a few years ago. These are starting to get deployed in smartphones (e.g., iPhones), something I personally didn’t think could happen for several more years (if not decades).

What’s next? It’s time to see photons in color!

If you are at SIGGRAPH, come by our paper presentation today (Aug. 9).

Sunday, October 22, 2023

Ubicept Closes Successful Seed Round

Proud to announce Ubicept successfully closing a seed round! It is incredibly satisfying to see nearly decade-long research on single-photon imaging starting to leave the lab and see the light of the day 🙂

Kudos to the Ubicept team for making this possible, especially Sebastian Bauer and Tristan Swedish — feel extremely fortunate to be working with you!

Here’s to seeing the world in a new light, one photon at a time!

Sunday, October 22, 2023

Jongho’s Paper in Nature Communications (2023)

Jongho’s new paper on single-photon processing in Nature Communications. This is a throwback to classical computer vision — a training-free technique designed for raw photon-cubes, which generalizes reasonably well to a diverse set of applications and imaging scenarios. He shows results on (a) long-range 3D imaging (via single-photon LiDAR), as well as (b) fluorescence lifetime microscopy.

Building up toward the vision of general-purpose “photon processing units” that could be implemented on-chip in future single-photon cameras.

Sunday, October 22, 2023

ICCP 2023 in Madison

ICCP 2023 program is live! We have an exciting lineup of speakers, complemented by a strong technical program. Hope to see folks in Madison!

Sunday, October 22, 2023

Best PhD Thesis Award to Sizhuo!

Sizhuo’s PhD thesis was awarded as one of two best PhD theses from the Computer Sciences Department here at UWisconsin. This thesis is an early attempt to bring single-photon imaging to mainstream computer vision. It’s great to see this line of work being well received not just in imaging and computer vision, but more broadly. Still feel we have barely scratched the surface, and the most exciting work in quanta imaging is ahead of us! Congratulations to Sizhuo!

Details here.

Thursday, June 18, 2020

Quanta Burst Photography at SIGGRAPH 2020

Paper on ultra-low light photography using single-photon cameras at SIGGRAPH 2020. Details here.

Thursday, October 31, 2019

Marr Prize Honorable Mention at ICCV 2019

Paper on single-photon 3D imaging receives the Marr Prize (best paper) honorable mention at ICCV 2019. Details here.