Sora Generates Videos with Stunning Geometrical Consistency
The recently developed Sora model [1] has exhibited remarkable capabilities
in video generation, sparking intense discussions regarding its ability to
simulate real-world phenomena. Despite its growing popularity, there is a lack
of established metrics to evaluate its fidelity to real-world physics
quantitatively. In this paper, we introduce a new benchmark that assesses the
quality of the generated videos based on their adherence to real-world physics
principles. We employ a method that transforms the generated videos into 3D
models, leveraging the premise that the accuracy of 3D reconstruction is
heavily contingent on the video quality. From the perspective of 3D
reconstruction, we use the fidelity of the geometric constraints satisfied by
the constructed 3D models as a proxy to gauge the extent to which the generated
videos conform to real-world physics rules. Project page:
https://sora-geometrical-consistency.github.io/
65dea5fcc1c0850fb97e0f79
Xuanyi Li
extracted_confirmed
2024-02-28T13:30:43.255Z
65deb47507334f484a61635b
/avatars/3821a78c535b875d6920519ed20e308f.svg
XuanyiLi
user
XuanyiLi
65dea5fcc1c0850fb97e0f7a
Daquan Zhou
admin_assigned
2024-02-28T12:36:05.889Z
63fe0b160c1bbe8e29d2dd32
/avatars/bc574036287170a77057893efaa48e2d.svg
Zhou
user
DaQuan21
65dea5fcc1c0850fb97e0f7b
Chenxu Zhang
65dea5fcc1c0850fb97e0f7c
Shaodong Wei
65dea5fcc1c0850fb97e0f7d
Qibin Hou
65dea5fcc1c0850fb97e0f7e
Ming-Ming Cheng
admin_assigned
2024-02-28T12:37:04.152Z
64e496ae0195913c7fa91c66
/avatars/23f274f0a3b4ef6ded35205df9bfb564.svg
chengmingming
user
mingming8688
Sora Generates Videos with Stunning Geometrical Consistency
The recently developed Sora model [1] has exhibited remarkable capabilities
in video generation, sparking intense discussions regarding its ability to
simulate real-world phenomena. Despite its growing popularity, there is a lack
of established metrics to evaluate its fidelity to real-world physics
quantitatively. In this paper, we introduce a new benchmark that assesses the
quality of the generated videos based on their adherence to real-world physics
principles. We employ a method that transforms the generated videos into 3D
models, leveraging the premise that the accuracy of 3D reconstruction is
heavily contingent on the video quality. From the perspective of 3D
reconstruction, we use the fidelity of the geometric constraints satisfied by
the constructed 3D models as a proxy to gauge the extent to which the generated
videos conform to real-world physics rules. Project page:
https://sora-geometrical-consistency.github.io/
A new benchmark evaluates video generation fidelity by assessing the geometric consistency of reconstructed 3D models.
video generation 3D models geometric constraints real-world physics fidelity