Synthetic Video Enhances Physical Fidelity in Video Synthesis
We investigate how to enhance the physical fidelity of video generation
models by leveraging synthetic videos derived from computer graphics pipelines.
These rendered videos respect real-world physics, such as maintaining 3D
consistency, and serve as a valuable resource that can potentially improve
video generation models. To harness this potential, we propose a solution that
curates and integrates synthetic data while introducing a method to transfer
its physical realism to the model, significantly reducing unwanted artifacts.
Through experiments on three representative tasks emphasizing physical
consistency, we demonstrate its efficacy in enhancing physical fidelity. While
our model still lacks a deep understanding of physics, our work offers one of
the first empirical demonstrations that synthetic video enhances physical
fidelity in video synthesis. Website: https://kevinz8866.github.io/simulation/
67e61017b116b3c559188a0f
Qi Zhao
67e61017b116b3c559188a10
Xingyu Ni
admin_assigned
2025-03-28T09:17:44.258Z
67b576e39b7058fa21ab72a3
/avatars/5393231dc585950d9579323521f41ff4.svg
Xingyu Ni
user
Univstar
67e61017b116b3c559188a11
Ziyu Wang
67e61017b116b3c559188a12
Feng Cheng
admin_assigned
2025-03-28T09:18:07.030Z
65c3dfb180497543ca257ffd
/avatars/1eb9e114e2c4dc2dc2c3b2e3f387d214.svg
Feng Cheng
user
fengcheng1
67e61017b116b3c559188a13
Ziyan Yang
67e61017b116b3c559188a14
Lu Jiang
67e61017b116b3c559188a15
Bohan Wang
Synthetic Video Enhances Physical Fidelity in Video Synthesis
We investigate how to enhance the physical fidelity of video generation
models by leveraging synthetic videos derived from computer graphics pipelines.
These rendered videos respect real-world physics, such as maintaining 3D
consistency, and serve as a valuable resource that can potentially improve
video generation models. To harness this potential, we propose a solution that
curates and integrates synthetic data while introducing a method to transfer
its physical realism to the model, significantly reducing unwanted artifacts.
Through experiments on three representative tasks emphasizing physical
consistency, we demonstrate its efficacy in enhancing physical fidelity. While
our model still lacks a deep understanding of physics, our work offers one of
the first empirical demonstrations that synthetic video enhances physical
fidelity in video synthesis. Website: https://kevinz8866.github.io/simulation/
Using synthetic videos derived from computer graphics, a method is proposed to improve physical fidelity in video generation models by reducing artifacts and enhancing consistency.
synthetic videos computer graphics pipelines 3D consistency physical realism video synthesis physical fidelity