Exploring the Evolution of Physics Cognition in Video Generation: A
  Survey
Recent advancements in video generation have witnessed significant progress,
especially with the rapid advancement of diffusion models. Despite this, their
deficiencies in physical cognition have gradually received widespread attention
- generated content often violates the fundamental laws of physics, falling
into the dilemma of ''visual realism but physical absurdity". Researchers began
to increasingly recognize the importance of physical fidelity in video
generation and attempted to integrate heuristic physical cognition such as
motion representations and physical knowledge into generative systems to
simulate real-world dynamic scenarios. Considering the lack of a systematic
overview in this field, this survey aims to provide a comprehensive summary of
architecture designs and their applications to fill this gap. Specifically, we
discuss and organize the evolutionary process of physical cognition in video
generation from a cognitive science perspective, while proposing a three-tier
taxonomy: 1) basic schema perception for generation, 2) passive cognition of
physical knowledge for generation, and 3) active cognition for world
simulation, encompassing state-of-the-art methods, classical paradigms, and
benchmarks. Subsequently, we emphasize the inherent key challenges in this
domain and delineate potential pathways for future research, contributing to
advancing the frontiers of discussion in both academia and industry. Through
structured review and interdisciplinary analysis, this survey aims to provide
directional guidance for developing interpretable, controllable, and physically
consistent video generation paradigms, thereby propelling generative models
from the stage of ''visual mimicry'' towards a new phase of ''human-like
physical comprehension''.
67e60da88decdc7da4bf69a9
Minghui Lin
admin_assigned
2025-03-28T09:01:37.704Z
67e617ebd0fd66b1f393eedc
/avatars/97a5ba0d0422f04e396399da1b74e8d4.svg
Minghui Lin
user
minnielin
67e60da88decdc7da4bf69aa
Xiang Wang
67e60da88decdc7da4bf69ab
Yishan Wang
admin_assigned
2025-03-28T09:01:51.882Z
65dcaf16287a93e081d9c2f0
/avatars/2db4e25c6924461abb5634f8ffd1ee87.svg
Yishanwang
user
yishanwang
67e60da88decdc7da4bf69ac
Shu Wang
extracted_pending
2025-03-28T02:47:05.703Z
65fd82762bf2cd20ddaa193f
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/yBYbWp_mT7UusYdkqtAvw.png
Siteng Huang
user
huangsiteng
67e60da88decdc7da4bf69ad
Fengqi Dai
67e60da88decdc7da4bf69ae
Pengxiang Ding
67e60da88decdc7da4bf69af
Cunxiang Wang
admin_assigned
2025-03-28T09:02:15.357Z
65eaf755ab0a6a90da55ab58
/avatars/a46890a9d067a913513edf3759f12c85.svg
Cunxiang Wang
user
wangcunxiang
67e60da88decdc7da4bf69b0
Zhengrong Zuo
67e60da88decdc7da4bf69b1
Nong Sang
67e60da88decdc7da4bf69b2
Siteng Huang
admin_assigned
2025-03-28T09:02:43.147Z
65fd82762bf2cd20ddaa193f
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/yBYbWp_mT7UusYdkqtAvw.png
Siteng Huang
user
huangsiteng
67e60da88decdc7da4bf69b3
Donglin Wang
admin_assigned
2025-03-28T09:02:37.839Z
67597be2f3cd6492d4162ef8
/avatars/ba580c04b7057927d4a22dcb44c52400.svg
DONGLIN
user
wangdonglin130
Exploring the Evolution of Physics Cognition in Video Generation: A
  Survey
Recent advancements in video generation have witnessed significant progress,
especially with the rapid advancement of diffusion models. Despite this, their
deficiencies in physical cognition have gradually received widespread attention
- generated content often violates the fundamental laws of physics, falling
into the dilemma of ''visual realism but physical absurdity". Researchers began
to increasingly recognize the importance of physical fidelity in video
generation and attempted to integrate heuristic physical cognition such as
motion representations and physical knowledge into generative systems to
simulate real-world dynamic scenarios. Considering the lack of a systematic
overview in this field, this survey aims to provide a comprehensive summary of
architecture designs and their applications to fill this gap. Specifically, we
discuss and organize the evolutionary process of physical cognition in video
generation from a cognitive science perspective, while proposing a three-tier
taxonomy: 1) basic schema perception for generation, 2) passive cognition of
physical knowledge for generation, and 3) active cognition for world
simulation, encompassing state-of-the-art methods, classical paradigms, and
benchmarks. Subsequently, we emphasize the inherent key challenges in this
domain and delineate potential pathways for future research, contributing to
advancing the frontiers of discussion in both academia and industry. Through
structured review and interdisciplinary analysis, this survey aims to provide
directional guidance for developing interpretable, controllable, and physically
consistent video generation paradigms, thereby propelling generative models
from the stage of ''visual mimicry'' towards a new phase of ''human-like
physical comprehension''.
This survey reviews the integration of physical cognition into video generation to improve realism while maintaining physical consistency, proposing a taxonomy for understanding the evolutionary process and challenges in this domain.
diffusion models physical cognition motion representations physical knowledge generative systems cognitive science schema perception passive cognition active cognition world simulation physical consistency