EmbodiedOneVision: Interleaved Vision-Text-Action Pretraining for
  General Robot Control
The human ability to seamlessly perform multimodal reasoning and physical
interaction in the open world is a core goal for general-purpose embodied
intelligent systems. Recent vision-language-action (VLA) models, which are
co-trained on large-scale robot and visual-text data, have demonstrated notable
progress in general robot control. However, they still fail to achieve
human-level flexibility in interleaved reasoning and interaction. In this work,
introduce EO-Robotics, consists of EO-1 model and EO-Data1.5M dataset. EO-1 is
a unified embodied foundation model that achieves superior performance in
multimodal embodied reasoning and robot control through interleaved
vision-text-action pre-training. The development of EO-1 is based on two key
pillars: (i) a unified architecture that processes multimodal inputs
indiscriminately (image, text, video, and action), and (ii) a massive,
high-quality multimodal embodied reasoning dataset, EO-Data1.5M, which contains
over 1.5 million samples with emphasis on interleaved vision-text-action
comprehension. EO-1 is trained through synergies between auto-regressive
decoding and flow matching denoising on EO-Data1.5M, enabling seamless robot
action generation and multimodal embodied reasoning. Extensive experiments
demonstrate the effectiveness of interleaved vision-text-action learning for
open-world understanding and generalization, validated through a variety of
long-horizon, dexterous manipulation tasks across multiple embodiments. This
paper details the architecture of EO-1, the data construction strategy of
EO-Data1.5M, and the training methodology, offering valuable insights for
developing advanced embodied foundation models.
68b4e4e7851c6e7b001ec9a7
Delin Qu
claimed_verified
2025-09-01T07:50:50.399Z
64daecec888b7e9c400f59b5
https://cdn-avatars.huggingface.co/v1/production/uploads/64daecec888b7e9c400f59b5/f4pfOfWk6jYJX-Nf2-qHn.png
Delin Qu
user
delinqu
68b4e4e7851c6e7b001ec9a8
Haoming Song
68b4e4e7851c6e7b001ec9a9
Qizhi Chen
68b4e4e7851c6e7b001ec9aa
Zhaoqing Chen
68b4e4e7851c6e7b001ec9ab
Xianqiang Gao
68b4e4e7851c6e7b001ec9ac
Xinyi Ye
68b4e4e7851c6e7b001ec9ad
Qi Lv
claimed_verified
2025-09-09T13:50:10.357Z
678123194248fde89e4fc9bf
/avatars/c207e25e12a138eed048c72b143b9bcf.svg
aopolin-lv
user
aopolin-lv
68b4e4e7851c6e7b001ec9ae
Modi Shi
68b4e4e7851c6e7b001ec9af
Guanghui Ren
claimed_verified
2025-09-01T07:50:48.188Z
646ec9b135f55eb49e405faa
/avatars/a17194be585d20e2a021e77a5a20e213.svg
Guanghui Ren
user
sundrops
68b4e4e7851c6e7b001ec9b0
Cheng Ruan
68b4e4e7851c6e7b001ec9b1
Maoqing Yao
68b4e4e7851c6e7b001ec9b2
Haoran Yang
68b4e4e7851c6e7b001ec9b3
Jiacheng Bao
68b4e4e7851c6e7b001ec9b4
Bin Zhao
68b4e4e7851c6e7b001ec9b5
Dong Wang
EmbodiedOneVision: Interleaved Vision-Text-Action Pretraining for
  General Robot Control
The human ability to seamlessly perform multimodal reasoning and physical
interaction in the open world is a core goal for general-purpose embodied
intelligent systems. Recent vision-language-action (VLA) models, which are
co-trained on large-scale robot and visual-text data, have demonstrated notable
progress in general robot control. However, they still fail to achieve
human-level flexibility in interleaved reasoning and interaction. In this work,
introduce EO-Robotics, consists of EO-1 model and EO-Data1.5M dataset. EO-1 is
a unified embodied foundation model that achieves superior performance in
multimodal embodied reasoning and robot control through interleaved
vision-text-action pre-training. The development of EO-1 is based on two key
pillars: (i) a unified architecture that processes multimodal inputs
indiscriminately (image, text, video, and action), and (ii) a massive,
high-quality multimodal embodied reasoning dataset, EO-Data1.5M, which contains
over 1.5 million samples with emphasis on interleaved vision-text-action
comprehension. EO-1 is trained through synergies between auto-regressive
decoding and flow matching denoising on EO-Data1.5M, enabling seamless robot
action generation and multimodal embodied reasoning. Extensive experiments
demonstrate the effectiveness of interleaved vision-text-action learning for
open-world understanding and generalization, validated through a variety of
long-horizon, dexterous manipulation tasks across multiple embodiments. This
paper details the architecture of EO-1, the data construction strategy of
EO-Data1.5M, and the training methodology, offering valuable insights for
developing advanced embodied foundation models.
EO-Robotics, comprising EO-1 model and EO-Data1.5M dataset, advances multimodal embodied reasoning and robot control through interleaved vision-text-action pre-training.
vision-language-action (VLA) models embodied foundation model multimodal inputs auto-regressive decoding flow matching denoising interleaved vision-text-action comprehension long-horizon tasks dexterous manipulation