HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed
  via Gaussian Splatting
High dynamic range (HDR) novel view synthesis (NVS) aims to create
photorealistic images from novel viewpoints using HDR imaging techniques. The
rendered HDR images capture a wider range of brightness levels containing more
details of the scene than normal low dynamic range (LDR) images. Existing HDR
NVS methods are mainly based on NeRF. They suffer from long training time and
slow inference speed. In this paper, we propose a new framework, High Dynamic
Range Gaussian Splatting (HDR-GS), which can efficiently render novel HDR views
and reconstruct LDR images with a user input exposure time. Specifically, we
design a Dual Dynamic Range (DDR) Gaussian point cloud model that uses
spherical harmonics to fit HDR color and employs an MLP-based tone-mapper to
render LDR color. The HDR and LDR colors are then fed into two Parallel
Differentiable Rasterization (PDR) processes to reconstruct HDR and LDR views.
To establish the data foundation for the research of 3D Gaussian
splatting-based methods in HDR NVS, we recalibrate the camera parameters and
compute the initial positions for Gaussian point clouds. Experiments
demonstrate that our HDR-GS surpasses the state-of-the-art NeRF-based method by
3.84 and 1.91 dB on LDR and HDR NVS while enjoying 1000x inference speed and
only requiring 6.3% training time.
6653f1fa67b5ae524c6be57f
Yuanhao Cai
6653f1fa67b5ae524c6be580
Zihao Xiao
admin_assigned
2024-05-27T10:04:30.796Z
6601e539cdd950b22e703462
/avatars/bf9e674dfa2e9a9e229fd0758aa661d3.svg
Zihao Xiao
user
zxiao10
6653f1fa67b5ae524c6be581
Yixun Liang
claimed_verified
2024-05-27T09:10:39.844Z
647d8f65becb41a272907e7a
/avatars/f891a1986a9361b23b7c83c23031cf26.svg
yixunliang
user
lyxun
6653f1fa67b5ae524c6be582
Yulun Zhang
admin_assigned
2024-05-27T10:04:57.482Z
647a0400bfaa9e96b8529a7f
/avatars/41161df5af1e6818d9e021389db316dd.svg
Yulun Zhang
user
yulunzhang
6653f1fa67b5ae524c6be583
Xiaokang Yang
admin_assigned
2024-05-27T10:05:11.186Z
64eaba6b1d8b651a9aed1203
/avatars/a0f26095c262ca1a204c27ff4bfb188c.svg
yangxiaokang
user
zicheqingluo
6653f1fa67b5ae524c6be584
Yaoyao Liu
claimed_verified
2024-05-27T19:46:13.296Z
652d84e4656cca7ce9e82d5a
https://cdn-avatars.huggingface.co/v1/production/uploads/652d84e4656cca7ce9e82d5a/FcVTLrJSr1n8REnRQP9jK.jpeg
Yaoyao Liu
user
yaoyaoliu
6653f1fa67b5ae524c6be585
Alan Yuille
HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed
  via Gaussian Splatting
High dynamic range (HDR) novel view synthesis (NVS) aims to create
photorealistic images from novel viewpoints using HDR imaging techniques. The
rendered HDR images capture a wider range of brightness levels containing more
details of the scene than normal low dynamic range (LDR) images. Existing HDR
NVS methods are mainly based on NeRF. They suffer from long training time and
slow inference speed. In this paper, we propose a new framework, High Dynamic
Range Gaussian Splatting (HDR-GS), which can efficiently render novel HDR views
and reconstruct LDR images with a user input exposure time. Specifically, we
design a Dual Dynamic Range (DDR) Gaussian point cloud model that uses
spherical harmonics to fit HDR color and employs an MLP-based tone-mapper to
render LDR color. The HDR and LDR colors are then fed into two Parallel
Differentiable Rasterization (PDR) processes to reconstruct HDR and LDR views.
To establish the data foundation for the research of 3D Gaussian
splatting-based methods in HDR NVS, we recalibrate the camera parameters and
compute the initial positions for Gaussian point clouds. Experiments
demonstrate that our HDR-GS surpasses the state-of-the-art NeRF-based method by
3.84 and 1.91 dB on LDR and HDR NVS while enjoying 1000x inference speed and
only requiring 6.3% training time.
A novel HDR Gaussian Splatting (HDR-GS) framework efficiently synthesizes HDR and LDR images from novel viewpoints, outperforming NeRF in quality and speed.
NeRF HDR NVS LDR images Dual Dynamic Range (DDR) Gaussian point cloud model spherical harmonics MLP-based tone-mapper Parallel Differentiable Rasterization (PDR) Gaussian point clouds