FreeTimeGS: Free Gaussians at Anytime and Anywhere for Dynamic Scene
  Reconstruction
This paper addresses the challenge of reconstructing dynamic 3D scenes with
complex motions. Some recent works define 3D Gaussian primitives in the
canonical space and use deformation fields to map canonical primitives to
observation spaces, achieving real-time dynamic view synthesis. However, these
methods often struggle to handle scenes with complex motions due to the
difficulty of optimizing deformation fields. To overcome this problem, we
propose FreeTimeGS, a novel 4D representation that allows Gaussian primitives
to appear at arbitrary time and locations. In contrast to canonical Gaussian
primitives, our representation possesses the strong flexibility, thus improving
the ability to model dynamic 3D scenes. In addition, we endow each Gaussian
primitive with an motion function, allowing it to move to neighboring regions
over time, which reduces the temporal redundancy. Experiments results on
several datasets show that the rendering quality of our method outperforms
recent methods by a large margin.
6842a994497e2b62234145d7
Yifan Wang
6842a994497e2b62234145d8
Peishan Yang
6842a994497e2b62234145d9
Zhen Xu
6842a994497e2b62234145da
Jiaming Sun
6842a994497e2b62234145db
Zhanhua Zhang
6842a994497e2b62234145dc
Yong Chen
6842a994497e2b62234145dd
Hujun Bao
6842a994497e2b62234145de
Sida Peng
6842a994497e2b62234145df
Xiaowei Zhou
FreeTimeGS: Free Gaussians at Anytime and Anywhere for Dynamic Scene
  Reconstruction
This paper addresses the challenge of reconstructing dynamic 3D scenes with
complex motions. Some recent works define 3D Gaussian primitives in the
canonical space and use deformation fields to map canonical primitives to
observation spaces, achieving real-time dynamic view synthesis. However, these
methods often struggle to handle scenes with complex motions due to the
difficulty of optimizing deformation fields. To overcome this problem, we
propose FreeTimeGS, a novel 4D representation that allows Gaussian primitives
to appear at arbitrary time and locations. In contrast to canonical Gaussian
primitives, our representation possesses the strong flexibility, thus improving
the ability to model dynamic 3D scenes. In addition, we endow each Gaussian
primitive with an motion function, allowing it to move to neighboring regions
over time, which reduces the temporal redundancy. Experiments results on
several datasets show that the rendering quality of our method outperforms
recent methods by a large margin.
A novel 4D representation, FreeTimeGS, enhances the modeling of dynamic 3D scenes by enabling Gaussian primitives to appear at arbitrary times and locations, improving rendering quality compared to existing methods.
3D Gaussian primitives canonical space deformation fields real-time dynamic view synthesis 4D representation motion function temporal redundancy