You have attempted to access the full-text of an Early Posting article. Access is available via an institutional subscription.

See the Early Posting FAQ page for additional information.

Neural radiance fields-based holography [Invited]

Applied Optics
  • Kang Minsung, Fan Wang, KAI KUMANO, Tomoyoshi Ito, and Tomoyoshi Shimobaba
  • received 03/11/2024; accepted 05/01/2024; posted 05/01/2024; Doc. ID 523562
  • Abstract: This study presents a novel approach for generating holograms based on the neural radiance fields (NeRF)technique. Generating real-world three-dimensional (3D) data is difficult in hologram computation. NeRFis a state-of-the-art technique for 3D light-field reconstruction from 2D images based on volume rendering.The NeRF can rapidly predict new-view images that are not included in a training dataset. In this study,we constructed a rendering pipeline directly from a radiance field generated from 2D images by NeRFfor hologram generation using deep neural networks within a reasonable time. The pipeline comprisesthree main components: the NeRF, a depth predictor, and a hologram generator, all constructed using deepneural networks. The pipeline does not include any physical calculations. The predicted holograms ofa 3D scene viewed from any direction were computed using the proposed pipeline. The simulation andexperimental results are presented.