Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large
  Multimodal Models
Video understanding represents the most challenging frontier in computer
vision, requiring models to reason about complex spatiotemporal relationships,
long-term dependencies, and multimodal evidence. The recent emergence of
Video-Large Multimodal Models (Video-LMMs), which integrate visual encoders
with powerful decoder-based language models, has demonstrated remarkable
capabilities in video understanding tasks. However, the critical phase that
transforms these models from basic perception systems into sophisticated
reasoning engines, post-training, remains fragmented across the literature.
This survey provides the first comprehensive examination of post-training
methodologies for Video-LMMs, encompassing three fundamental pillars:
supervised fine-tuning (SFT) with chain-of-thought, reinforcement learning (RL)
from verifiable objectives, and test-time scaling (TTS) through enhanced
inference computation. We present a structured taxonomy that clarifies the
roles, interconnections, and video-specific adaptations of these techniques,
addressing unique challenges such as temporal localization, spatiotemporal
grounding, long video efficiency, and multimodal evidence integration. Through
systematic analysis of representative methods, we synthesize key design
principles, insights, and evaluation protocols while identifying critical open
challenges in reward design, scalability, and cost-performance optimization. We
further curate essential benchmarks, datasets, and metrics to facilitate
rigorous assessment of post-training effectiveness. This survey aims to provide
researchers and practitioners with a unified framework for advancing Video-LMM
capabilities. Additional resources and updates are maintained at:
https://github.com/yunlong10/Awesome-Video-LMM-Post-Training
68e47fd5e4e093a7044e4d3c
Yunlong Tang
claimed_verified
2025-10-07T12:26:53.963Z
6344c87f0f69ad8aa61dfcf6
https://cdn-avatars.huggingface.co/v1/production/uploads/6344c87f0f69ad8aa61dfcf6/tTVHu2l2aiAnK160vgT6u.jpeg
Yolo Y. Tang
user
yunlong10
68e47fd5e4e093a7044e4d3d
Jing Bi
68e47fd5e4e093a7044e4d3e
Pinxin Liu
68e47fd5e4e093a7044e4d3f
Zhenyu Pan
claimed_verified
2025-10-07T12:26:51.453Z
669794c5813d96b4eb0b3fd6
/avatars/b4e2bb7b07cc281932d783dcbb64f211.svg
Zhenyu Pan
user
zhenyupan
68e47fd5e4e093a7044e4d40
Zhangyun Tan
claimed_verified
2025-10-10T09:38:36.933Z
64ae63e35b181f6ccacc69d6
/avatars/19551a705d5fbdb3a7dd89696d9797b7.svg
Zhangyun Tan
user
Outloud4u
68e47fd5e4e093a7044e4d41
Qianxiang Shen
68e47fd5e4e093a7044e4d42
Jiani Liu
68e47fd5e4e093a7044e4d43
Hang Hua
claimed_verified
2025-10-08T08:03:06.647Z
639f8277beb95d698de007dd
/avatars/57f223ccd9d3cb03166ccf0e41361c58.svg
HangHua
user
hhua2
68e47fd5e4e093a7044e4d44
Junjia Guo
68e47fd5e4e093a7044e4d45
Yunzhong Xiao
68e47fd5e4e093a7044e4d46
Chao Huang
68e47fd5e4e093a7044e4d47
Zhiyuan Wang
68e47fd5e4e093a7044e4d48
Susan Liang
68e47fd5e4e093a7044e4d49
Xinyi Liu
68e47fd5e4e093a7044e4d4a
Yizhi Song
68e47fd5e4e093a7044e4d4b
Yuhe Nie
claimed_verified
2025-10-18T04:50:53.065Z
652f1a46d7808dbb9d0f0332
/avatars/8138a0f2987a5d8ed1c138f395f95b61.svg
Yuhe Nie
user
DolphinNie
68e47fd5e4e093a7044e4d4c
Jia-Xing Zhong
68e47fd5e4e093a7044e4d4d
Bozheng Li
68e47fd5e4e093a7044e4d4e
Daiqing Qi
claimed_verified
2025-10-07T12:26:43.897Z
649e469cab5656f6acbd6d1d
/avatars/774942d6268a9d3fadccb058bd9e8b90.svg
Daiqing Qi
user
Daiqingq
68e47fd5e4e093a7044e4d4f
Ziyun Zeng
claimed_verified
2025-10-08T08:03:08.756Z
65e6a9a4c799256ec5f7ef77
/avatars/539a455841675539a62b44ff9803a948.svg
ziyun zeng
user
zengziyun
68e47fd5e4e093a7044e4d50
Ali Vosoughi
claimed_verified
2025-10-07T12:26:56.370Z
65c16eb788812bbe20224c75
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/P7xg4ryhWZrfOkHYRS1QI.jpeg
Ali Vosoughi
user
ali-vosoughi
68e47fd5e4e093a7044e4d51
Luchuan Song
68e47fd5e4e093a7044e4d52
Zeliang Zhang
claimed_verified
2025-10-07T12:26:49.355Z
66805e103dd5f4c44c1c939a
/avatars/ef2eebf1d61f86dde3397471ca180b95.svg
Zeliang Zhang
user
zeliang0426
68e47fd5e4e093a7044e4d53
Daiki Shimada
68e47fd5e4e093a7044e4d54
Han Liu
68e47fd5e4e093a7044e4d55
Jiebo Luo
68e47fd5e4e093a7044e4d56
Chenliang Xu
Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large
  Multimodal Models
Video understanding represents the most challenging frontier in computer
vision, requiring models to reason about complex spatiotemporal relationships,
long-term dependencies, and multimodal evidence. The recent emergence of
Video-Large Multimodal Models (Video-LMMs), which integrate visual encoders
with powerful decoder-based language models, has demonstrated remarkable
capabilities in video understanding tasks. However, the critical phase that
transforms these models from basic perception systems into sophisticated
reasoning engines, post-training, remains fragmented across the literature.
This survey provides the first comprehensive examination of post-training
methodologies for Video-LMMs, encompassing three fundamental pillars:
supervised fine-tuning (SFT) with chain-of-thought, reinforcement learning (RL)
from verifiable objectives, and test-time scaling (TTS) through enhanced
inference computation. We present a structured taxonomy that clarifies the
roles, interconnections, and video-specific adaptations of these techniques,
addressing unique challenges such as temporal localization, spatiotemporal
grounding, long video efficiency, and multimodal evidence integration. Through
systematic analysis of representative methods, we synthesize key design
principles, insights, and evaluation protocols while identifying critical open
challenges in reward design, scalability, and cost-performance optimization. We
further curate essential benchmarks, datasets, and metrics to facilitate
rigorous assessment of post-training effectiveness. This survey aims to provide
researchers and practitioners with a unified framework for advancing Video-LMM
capabilities. Additional resources and updates are maintained at:
https://github.com/yunlong10/Awesome-Video-LMM-Post-Training
This survey examines post-training methodologies for Video-LMMs, focusing on supervised fine-tuning, reinforcement learning, and test-time scaling, while addressing challenges in video understanding.
Video-LMMs supervised fine-tuning reinforcement learning test-time scaling temporal localization spatiotemporal grounding long video efficiency multimodal evidence integration reward design scalability cost-performance optimization