Neural holography with camera-in-the-loop training
By Yifan Peng, Suyeon Choi, Nitish Padmanaban, Gordon Wetzstein. ACM Transactions on Graphics, 2020
412 citations recorded by the source corpus.
Holographic displays promise unprecedented capabilities for direct-view displays as well as virtual and augmented reality applications. However, one of the biggest challenges for computer-generated holography (CGH) is the fundamental tradeoff between algorithm runtime and achieved image quality, which has prevented high-quality holographic image synthesis at fast speeds. Moreover, the image quality achieved by most holographic displays is low, due to the mismatch between the optical wave propagation of the display and its simulated model. Here, we develop an algorithmic CGH framework that achieves unprecedented image fidelity and real-time framerates. Our framework comprises several parts, including a novel camera-in-the-loop optimization strategy that allows us to either optimize a hologram directly or train an interpretable model of the optical wave propagation and a neural network architecture that represents the first CGH algorithm capable of generating full-color high-quality holographic images at 1080p resolution in real time.
Subfields: Atomic and Molecular Physics, and Optics, Computer Vision and Pattern Recognition, Media Technology
View Paper: https://www.semanticscholar.org/paper/9edd7402d9e573f296184155aefdc4dad12627fc
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Atomic and Molecular Physics, and Optics
In Computer Vision and Pattern Recognition
In Media Technology
Citations in the corpus
- Advanced liquid crystal devices for augmented reality and virtual reality displays: principles and applications (2022, background): “The good news is that with the advancement of algorithms and convolutional neural networks (CNNs) 138,139 , solving this problem is just around the corner.”
- Roadmap on wavefront shaping and deep imaging in complex media (2021, methodology): “Another critical aspect to the performance of deep imaging techniques is managing the joint operation of image acquisition and illumination hardware operating simultaneously in closed-loop systems [79, 173, 176].”