LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal
  Training
We present LLaVA-OneVision-1.5, a novel family of Large Multimodal Models
(LMMs) that achieve state-of-the-art performance with significantly reduced
computational and financial costs. Different from the existing works,
LLaVA-OneVision-1.5 provides an open, efficient, and reproducible framework for
building high-quality vision-language models entirely from scratch. The
LLaVA-OneVision-1.5 release comprises three primary components: (1) Large-Scale
Curated Datasets: We construct an 85M concept-balanced pretraining dataset
LLaVA-OneVision-1.5-Mid-Traning and a meticulously curated 26M instruction
dataset LLaVA-OneVision-1.5-Instruct, collectively encompassing 64B compressed
multimodal tokens. (2) Efficient Training Framework: We develop a complete
end-to-end efficient training framework leveraging an offline parallel data
packing strategy to facilitate the training of LLaVA-OneVision-1.5 within a
$16,000 budget. (3) State-of-the-art Performance: Experimental results
demonstrate that LLaVA-OneVision1.5 yields exceptionally competitive
performance across a broad range of downstream tasks. Specifically,
LLaVA-OneVision-1.5-8B outperforms Qwen2.5-VL-7B on 18 of 27 benchmarks, and
LLaVA-OneVision-1.5-4B surpasses Qwen2.5-VL-3B on all 27 benchmarks. We
anticipate releasing LLaVA-OneVision-1.5-RL shortly and encourage the community
to await further updates.
68db2f1cd2bf1f4b15ec7251
Xiang An
claimed_verified
2025-09-30T06:35:28.707Z
6478679d7b370854241b2ad8
https://cdn-avatars.huggingface.co/v1/production/uploads/6478679d7b370854241b2ad8/dBczWYYdfEt9tQcnVGhQk.jpeg
xiangan
user
xiangan
68db2f1cd2bf1f4b15ec7252
Yin Xie
68db2f1cd2bf1f4b15ec7253
Kaicheng Yang
claimed_verified
2025-10-17T04:14:46.420Z
63e202f352b7578dba448ab5
https://cdn-avatars.huggingface.co/v1/production/uploads/63e202f352b7578dba448ab5/8itVBLcv14m7OVsoF8h1o.jpeg
Yang
user
Kaichengalex
68db2f1cd2bf1f4b15ec7254
Wenkang Zhang
68db2f1cd2bf1f4b15ec7255
Xiuwei Zhao
68db2f1cd2bf1f4b15ec7256
Zheng Cheng
68db2f1cd2bf1f4b15ec7257
Yirui Wang
68db2f1cd2bf1f4b15ec7258
Songcen Xu
68db2f1cd2bf1f4b15ec7259
Changrui Chen
68db2f1cd2bf1f4b15ec725a
Chunsheng Wu
68db2f1cd2bf1f4b15ec725b
Huajie Tan
claimed_verified
2025-10-03T12:55:20.619Z
66b5dc0b854ad316cf835ab4
https://cdn-avatars.huggingface.co/v1/production/uploads/66b5dc0b854ad316cf835ab4/8gOWw81rV5la7mzjw_qRv.jpeg
tanhuajie2001
user
tanhuajie2001
68db2f1cd2bf1f4b15ec725c
Chunyuan Li
68db2f1cd2bf1f4b15ec725d
Jing Yang
68db2f1cd2bf1f4b15ec725e
Jie Yu
68db2f1cd2bf1f4b15ec725f
Xiyao Wang
claimed_verified
2025-10-03T12:55:22.726Z
655fed9fdef5905d38b84af3
/avatars/2cda4182dfd11a1e94743639e62328ea.svg
Xiyao Wang
user
russwang
68db2f1cd2bf1f4b15ec7260
Bin Qin
68db2f1cd2bf1f4b15ec7261
Yumeng Wang
68db2f1cd2bf1f4b15ec7262
Zizhen Yan
claimed_verified
2025-10-02T13:56:43.922Z
6687ba13cfd851a0fc84336d
/avatars/f60ef8c1ee4661d2c47d14df5acb5753.svg
Yadda Yan
user
yaddas
68db2f1cd2bf1f4b15ec7263
Ziyong Feng
68db2f1cd2bf1f4b15ec7264
Ziwei Liu
68db2f1cd2bf1f4b15ec7265
Bo Li
claimed_verified
2025-09-30T06:35:25.641Z
62d3f7d84b0933c48f3cdd9c
https://cdn-avatars.huggingface.co/v1/production/uploads/62d3f7d84b0933c48f3cdd9c/rSoSyH0Td9fD9HVlyK7bh.jpeg
Bo Li
user
luodian
68db2f1cd2bf1f4b15ec7266
Jiankang Deng
LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal
  Training
We present LLaVA-OneVision-1.5, a novel family of Large Multimodal Models
(LMMs) that achieve state-of-the-art performance with significantly reduced
computational and financial costs. Different from the existing works,
LLaVA-OneVision-1.5 provides an open, efficient, and reproducible framework for
building high-quality vision-language models entirely from scratch. The
LLaVA-OneVision-1.5 release comprises three primary components: (1) Large-Scale
Curated Datasets: We construct an 85M concept-balanced pretraining dataset
LLaVA-OneVision-1.5-Mid-Traning and a meticulously curated 26M instruction
dataset LLaVA-OneVision-1.5-Instruct, collectively encompassing 64B compressed
multimodal tokens. (2) Efficient Training Framework: We develop a complete
end-to-end efficient training framework leveraging an offline parallel data
packing strategy to facilitate the training of LLaVA-OneVision-1.5 within a
$16,000 budget. (3) State-of-the-art Performance: Experimental results
demonstrate that LLaVA-OneVision1.5 yields exceptionally competitive
performance across a broad range of downstream tasks. Specifically,
LLaVA-OneVision-1.5-8B outperforms Qwen2.5-VL-7B on 18 of 27 benchmarks, and
LLaVA-OneVision-1.5-4B surpasses Qwen2.5-VL-3B on all 27 benchmarks. We
anticipate releasing LLaVA-OneVision-1.5-RL shortly and encourage the community
to await further updates.
LLaVA-OneVision-1.5 is a family of large multimodal models that achieves state-of-the-art performance with reduced costs through efficient training and high-quality datasets.
Large Multimodal Models LMMs Large-Scale Curated Datasets pretraining dataset instruction dataset multimodal tokens efficient training framework offline parallel data packing strategy state-of-the-art performance downstream tasks Qwen2.5-VL-7B Qwen2.5-VL-3B