Light Field Super-Resolution with Zero-Shot Learning
By Zhen Cheng, Zhiwei Xiong, Chang Wen Chen, Dong Liu, Zhengjun Zha. 2021
60 citations recorded by the source corpus.
Deep learning provides a new avenue for light field super-resolution (SR). However, the domain gap caused by drastically different light field acquisition conditions poses a main obstacle in practice. To fill this gap, we propose a zero-shot learning framework for light field SR, which learns a mapping to super-resolve the reference view with examples extracted solely from the input low-resolution light field itself. Given highly limited training data under the zero-shot setting, however, we observe that it is difficult to train an end-to-end network successfully. Instead, we divide this challenging task into three sub-tasks, i.e., pre-upsampling, view alignment, and multi-view aggregation, and then conquer them separately with simple yet efficient CNNs. Moreover, the proposed framework can be readily extended to finetune the pre-trained model on a source dataset to better adapt to the target input, which further boosts the performance of light field SR in the wild. Experimental results validate that our method not only outperforms classic non-learning-based methods, but also generalizes better to unseen light fields than state-of-the-art deep-learning-based methods when the domain gap is large.
Subfields: Biophysics, Computer Vision and Pattern Recognition
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Biophysics
In Computer Vision and Pattern Recognition
Citations in the corpus
- Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learning (2022, methodology): “Specifically, after mapping all new samples to the learned embedding space [3, 40], we compute the normalized cosine scores Si between them and all prototypes,”