Abstract

Coded aperture compressive temporal imaging (CACTI) utilizes compressive sensing (CS) theory to compress three dimensional (3D) signals into 2D measurements for sampling in a single snapshot measurement, which in turn acquires high-dimensional (HD) visual signals. To solve the problems of low quality and slow runtime often encountered in reconstruction, deep learning has become the mainstream for signal reconstruction and has shown superior performance. Currently, however, impressive networks are typically supervised networks with large-sized models and require vast training sets that can be difficult to obtain or expensive. This limits their application in real optical imaging systems. In this paper, we propose a lightweight reconstruction network that recovers HD signals only from compressed measurements with noise and design a block consisting of convolution to extract and fuse local and global features, stacking multiple features to form a lightweight architecture. In addition, we also obtain unsupervised loss functions based on the geometric characteristics of the signal to guarantee the powerful generalization capability of the network in order to approximate the reconstruction process of real optical systems. Experimental results show that our proposed network significantly reduces the model size and not only has high performance in recovering dynamic scenes, but the unsupervised video reconstruction network can approximate its supervised version in terms of reconstruction performance.

© 2024 Optica Publishing Group

Coded aperture compression temporal imaging based on a dual-mask and deep denoiser

YouRan Ge, GangRong Qu, YuHao Huang, and Duo Liu
J. Opt. Soc. Am. A 40(7) 1468-1477 (2023)

Unsupervised reconstruction with a registered time-unsheared image constraint for compressed ultrafast photography

Haoyu Zhou, Yan Song, Zhiming Yao, Dongwei Hei, Yang Li, Baojun Duan, Yinong Liu, and Liang Sheng
Opt. Express 32(9) 16333-16350 (2024)

High-performance reconstruction method combining total variation with a video denoiser for compressed ultrafast imaging

Chengquan Pei, David Day-Uei Li, Qian Shen, Shian Zhang, Dalong Qi, Chengzhi Jin, and Le Dong
Appl. Opt. 63(8) C32-C40 (2024)

DSCNet: lightweight and efficient self-supervised network via depthwise separable cross convolution blocks for speckle image matching

Lin Li, Peng Wang, Lingrui Wang, Changku Sun, and Luhua Fu
Opt. Express 32(6) 10715-10731 (2024)

Unsupervised speckle denoising in digital holographic interferometry based on 4-f optical simulation integrated cycle-consistent generative adversarial network

HongBo Yu, Qiang Fang, QingHe Song, Silvio Montresor, Pascal Picart, and Haiting Xia
Appl. Opt. 63(13) 3557-3569 (2024)