Kwai Keye-VL Technical Report
While Multimodal Large Language Models (MLLMs) demonstrate remarkable
capabilities on static images, they often fall short in comprehending dynamic,
information-dense short-form videos, a dominant medium in today's digital
landscape. To bridge this gap, we introduce Kwai Keye-VL, an
8-billion-parameter multimodal foundation model engineered for leading-edge
performance in short-video understanding while maintaining robust
general-purpose vision-language abilities. The development of Keye-VL rests on
two core pillars: a massive, high-quality dataset exceeding 600 billion tokens
with a strong emphasis on video, and an innovative training recipe. This recipe
features a four-stage pre-training process for solid vision-language alignment,
followed by a meticulous two-phase post-training process. The first
post-training stage enhances foundational capabilities like instruction
following, while the second phase focuses on stimulating advanced reasoning. In
this second phase, a key innovation is our five-mode ``cold-start'' data
mixture, which includes ``thinking'', ``non-thinking'', ``auto-think'', ``think
with image'', and high-quality video data. This mixture teaches the model to
decide when and how to reason. Subsequent reinforcement learning (RL) and
alignment steps further enhance these reasoning capabilities and correct
abnormal model behaviors, such as repetitive outputs. To validate our approach,
we conduct extensive evaluations, showing that Keye-VL achieves
state-of-the-art results on public video benchmarks and remains highly
competitive on general image-based tasks (Figure 1). Furthermore, we develop
and release the KC-MMBench, a new benchmark tailored for real-world
short-video scenarios, where Keye-VL shows a significant advantage.
6865e6218c83dab5f72d1e47
Kwai Keye Team
6865e6218c83dab5f72d1e48
Biao Yang
6865e6218c83dab5f72d1e49
Bin Wen
6865e6218c83dab5f72d1e4a
Changyi Liu
6865e6218c83dab5f72d1e4b
Chenglong Chu
6865e6218c83dab5f72d1e4c
Chengru Song
6865e6218c83dab5f72d1e4d
Chongling Rao
6865e6218c83dab5f72d1e4e
Chuan Yi
6865e6218c83dab5f72d1e4f
Da Li
6865e6218c83dab5f72d1e50
Dunju Zang
6865e6218c83dab5f72d1e51
Fan Yang
6865e6218c83dab5f72d1e52
Guorui Zhou
6865e6218c83dab5f72d1e53
Hao Peng
6865e6218c83dab5f72d1e54
Haojie Ding
6865e6218c83dab5f72d1e55
Jiaming Huang
6865e6218c83dab5f72d1e56
Jiangxia Cao
claimed_verified
2025-07-03T07:16:44.694Z
65802e81b701ff85a37caba8
/avatars/b2e9726893caa7e62aad83b1d02e5b41.svg
jiangxia cao
user
caojiangxia
6865e6218c83dab5f72d1e57
Jiankang Chen
6865e6218c83dab5f72d1e58
Jingyun Hua
claimed_verified
2025-07-03T07:15:01.253Z
61540338e5b9ae6774201e58
https://cdn-avatars.huggingface.co/v1/production/uploads/61540338e5b9ae6774201e58/h_159VrXOlIgu0N0pNgXj.png
jingyun
user
hjy
6865e6218c83dab5f72d1e59
Jin Ouyang
6865e6218c83dab5f72d1e5a
Kaibing Chen
6865e6218c83dab5f72d1e5b
Kaiyu Jiang
6865e6218c83dab5f72d1e5c
Kaiyu Tang
6865e6218c83dab5f72d1e5d
Kun Gai
6865e6218c83dab5f72d1e5e
Shengnan Zhang
claimed_verified
2025-07-03T16:19:02.360Z
662f09423f9804ca5f967e48
/avatars/139436300511b67e4a6c4fb7f36ee166.svg
Sophie Zhang
user
suafie
6865e6218c83dab5f72d1e5f
Siyang Mao
6865e6218c83dab5f72d1e60
Sui Huang
6865e6218c83dab5f72d1e61
Tianke Zhang
claimed_verified
2025-07-09T08:52:53.262Z
64c7537571947b03ff2bd375
/avatars/f48d57e72d08caea42b03aa02f0c92ad.svg
ktz
user
Victoryztk23
6865e6218c83dab5f72d1e62
Tingting Gao
claimed_verified
2025-07-03T07:47:43.679Z
68652063e29f1407b58da60f
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/hTgS65zsKRPxELjSMDSNm.png
tingting gao
user
TinaGao
6865e6218c83dab5f72d1e63
Wei Chen
6865e6218c83dab5f72d1e64
Wei Yuan
claimed_verified
2025-07-03T07:16:49.219Z
65423daba385933e812516d5
/avatars/d18b85b4206ab5905ef5bc95622dff3e.svg
wei yuan
user
yw95
6865e6218c83dab5f72d1e65
Xiangyu Wu
6865e6218c83dab5f72d1e66
Xiao Hu
claimed_verified
2025-07-03T07:16:42.172Z
64a4dba8fe950993d2d89113
https://cdn-avatars.huggingface.co/v1/production/uploads/64a4dba8fe950993d2d89113/yukb9NNeVspIX7eFTreUq.jpeg
Xiao Hu
user
huxiao09
6865e6218c83dab5f72d1e67
Xingyu Lu
claimed_verified
2025-07-03T07:16:46.882Z
673597cfc2424474d12ca58c
/avatars/f748f19619b07838a66bc419a7a6db9d.svg
xingyulu
user
Xingyulu47
6865e6218c83dab5f72d1e68
Yang Zhou
6865e6218c83dab5f72d1e69
Yi-Fan Zhang
claimed_verified
2025-07-03T07:15:06.461Z
623d8ca4c29adf5ef6175615
https://cdn-avatars.huggingface.co/v1/production/uploads/623d8ca4c29adf5ef6175615/q7lHao7UPwU1u7YLSP56m.jpeg
Yi-Fan Zhang
user
yifanzhang114
6865e6218c83dab5f72d1e6a
Yiping Yang
6865e6218c83dab5f72d1e6b
Yulong Chen
6865e6218c83dab5f72d1e6c
Zhenhua Wu
6865e6218c83dab5f72d1e6d
Zhenyu Li
6865e6218c83dab5f72d1e6e
Zhixin Ling
claimed_verified
2025-07-03T07:15:03.454Z
641948b7d13ffa40812eb239
/avatars/65a0262fea6907bec48ddc1d966742da.svg
Zhixin Ling
user
NamingIsTroublesome
6865e6218c83dab5f72d1e6f
Ziming Li
6865e6218c83dab5f72d1e70
Dehua Ma
6865e6218c83dab5f72d1e71
Di Xu
6865e6218c83dab5f72d1e72
Haixuan Gao
6865e6218c83dab5f72d1e73
Hang Li
6865e6218c83dab5f72d1e74
Jiawei Guo
6865e6218c83dab5f72d1e75
Jing Wang
6865e6218c83dab5f72d1e76
Lejian Ren
6865e6218c83dab5f72d1e77
Muhao Wei
6865e6218c83dab5f72d1e78
Qianqian Wang
6865e6218c83dab5f72d1e79
Qigen Hu
6865e6218c83dab5f72d1e7a
Shiyao Wang
6865e6218c83dab5f72d1e7b
Tao Yu
6865e6218c83dab5f72d1e7c
Xinchen Luo
6865e6218c83dab5f72d1e7d
Yan Li
6865e6218c83dab5f72d1e7e
Yiming Liang
6865e6218c83dab5f72d1e7f
Yuhang Hu
6865e6218c83dab5f72d1e80
Zeyi Lu
6865e6218c83dab5f72d1e81
Zhuoran Yang
6865e6218c83dab5f72d1e82
Zixing Zhang
Kwai Keye-VL Technical Report
While Multimodal Large Language Models (MLLMs) demonstrate remarkable
capabilities on static images, they often fall short in comprehending dynamic,
information-dense short-form videos, a dominant medium in today's digital
landscape. To bridge this gap, we introduce Kwai Keye-VL, an
8-billion-parameter multimodal foundation model engineered for leading-edge
performance in short-video understanding while maintaining robust
general-purpose vision-language abilities. The development of Keye-VL rests on
two core pillars: a massive, high-quality dataset exceeding 600 billion tokens
with a strong emphasis on video, and an innovative training recipe. This recipe
features a four-stage pre-training process for solid vision-language alignment,
followed by a meticulous two-phase post-training process. The first
post-training stage enhances foundational capabilities like instruction
following, while the second phase focuses on stimulating advanced reasoning. In
this second phase, a key innovation is our five-mode ``cold-start'' data
mixture, which includes ``thinking'', ``non-thinking'', ``auto-think'', ``think
with image'', and high-quality video data. This mixture teaches the model to
decide when and how to reason. Subsequent reinforcement learning (RL) and
alignment steps further enhance these reasoning capabilities and correct
abnormal model behaviors, such as repetitive outputs. To validate our approach,
we conduct extensive evaluations, showing that Keye-VL achieves
state-of-the-art results on public video benchmarks and remains highly
competitive on general image-based tasks (Figure 1). Furthermore, we develop
and release the KC-MMBench, a new benchmark tailored for real-world
short-video scenarios, where Keye-VL shows a significant advantage.
Kwai Keye-VL, an 8-billion-parameter multimodal model, excels in short-video understanding and general vision-language tasks through a comprehensive pre-training and post-training process, including a five-mode data mixture and reinforcement learning.
Multimodal Large Language Models Kwai Keye-VL vision-language alignment cold-start data mixture thinking non-thinking auto-think think with image reinforcement learning KC-MMBench