Single Doxel Imager: A compressive hyperspectral video imaging system using a single-pixel detector

Описание: Here we showcase a video-rate hyperspectral imager based on a single-pixel photodetector that can achieve high-throughput hyperspectral video recording at a low bandwidth. Specifically, we demonstrate a joint spatial-spectral encoding scheme which can encode the scene into highly compressed single-pixel measurements and obtain temporal correlation at the same time. Since it uses a single photodetector, it is ideal for hyperspectral video imaging in the short-, mid-, and long-wave infrared as well as the terahertz electromagnetic bands.

Nature Communications volume 15, Article number: 1456 (2024)
https://doi.org/10.1038/s41467-024-45...

Capturing fine spatial, spectral, and temporal information of the scene is highly desirable in many applications. However, recording data of such high dimensionality requires significant transmission bandwidth. Current computational imaging methods can partially address this challenge but are still limited in reducing input data throughput. In this paper, we report a video-rate hyperspectral imager based on a single-pixel photodetector which can achieve high-throughput hyperspectral video recording at a low bandwidth. We leverage the insight that 4-dimensional (4D) hyperspectral videos are considerably more compressible than 2D grayscale images. We propose a joint spatial-spectral capturing scheme encoding the scene into highly compressed measurements and obtaining temporal correlation at the same time. Furthermore, we propose a reconstruction method relying on a signal sparsity model in 4D space and a deep learning reconstruction approach greatly accelerating reconstruction. We demonstrate reconstruction of 128 × 128 hyperspectral images with 64 spectral bands at more than 4 frames per second offering a 900× data throughput compared to conventional imaging, which we believe is a first-of-its kind of a single-pixel-based hyperspectral imager. (This video is from prior to publication, in the published paper we describe how to perform machine learning neural net reconstruction directly on the doxel imager measurements.)