RoboVerse: Towards a Unified Platform, Dataset and Benchmark for
  Scalable and Generalizable Robot Learning
Data scaling and standardized evaluation benchmarks have driven significant
advances in natural language processing and computer vision. However, robotics
faces unique challenges in scaling data and establishing evaluation protocols.
Collecting real-world data is resource-intensive and inefficient, while
benchmarking in real-world scenarios remains highly complex. Synthetic data and
simulation offer promising alternatives, yet existing efforts often fall short
in data quality, diversity, and benchmark standardization. To address these
challenges, we introduce RoboVerse, a comprehensive framework comprising a
simulation platform, a synthetic dataset, and unified benchmarks. Our
simulation platform supports multiple simulators and robotic embodiments,
enabling seamless transitions between different environments. The synthetic
dataset, featuring high-fidelity physics and photorealistic rendering, is
constructed through multiple approaches. Additionally, we propose unified
benchmarks for imitation learning and reinforcement learning, enabling
evaluation across different levels of generalization. At the core of the
simulation platform is MetaSim, an infrastructure that abstracts diverse
simulation environments into a universal interface. It restructures existing
simulation environments into a simulator-agnostic configuration system, as well
as an API aligning different simulator functionalities, such as launching
simulation environments, loading assets with initial states, stepping the
physics engine, etc. This abstraction ensures interoperability and
extensibility. Comprehensive experiments demonstrate that RoboVerse enhances
the performance of imitation learning, reinforcement learning, world model
learning, and sim-to-real transfer. These results validate the reliability of
our dataset and benchmarks, establishing RoboVerse as a robust solution for
advancing robot learning.
6812d36790b45f422b0bfdc2
Haoran Geng
admin_assigned
2025-05-05T08:06:54.513Z
66a1f49029c1d29d8c896dab
/avatars/3911311652df37838687fd09302916f5.svg
Haoran Geng
user
HaoranG
6812d36790b45f422b0bfdc3
Feishi Wang
admin_assigned
2025-05-05T08:07:05.298Z
648d172c80bf2c9599264e10
/avatars/950dee7c78d8aa6cb109b7596b1c4693.svg
Feishi Wang
user
Fisher-Wang
6812d36790b45f422b0bfdc4
Songlin Wei
6812d36790b45f422b0bfdc5
Yuyang Li
admin_assigned
2025-05-05T08:08:01.145Z
637cef70b8e573d75beb5748
https://cdn-avatars.huggingface.co/v1/production/uploads/637cef70b8e573d75beb5748/hMl_pKUO3BanR47RQqN6o.png
Yuyang Li
user
aidenli
6812d36790b45f422b0bfdc6
Bangjun Wang
6812d36790b45f422b0bfdc7
Boshi An
6812d36790b45f422b0bfdc8
Charlie Tianyue Cheng
6812d36790b45f422b0bfdc9
Haozhe Lou
admin_assigned
2025-05-05T08:09:21.168Z
6635ab1d4fe4d2b6c4ad08d8
/avatars/63baa0a264e3b26c5a0d552c41d4f978.svg
 Haozhe Lou
user
louhz
6812d36790b45f422b0bfdca
Peihao Li
6812d36790b45f422b0bfdcb
Yen-Jen Wang
6812d36790b45f422b0bfdcc
Yutong Liang
6812d36790b45f422b0bfdcd
Dylan Goetting
admin_assigned
2025-05-05T08:10:07.183Z
61821d05ce66b42e2d4b28c1
/avatars/897d73d52c63b739f8fa0644f3545f47.svg
Dylan Goetting
user
dylangoetting
6812d36790b45f422b0bfdce
Chaoyi Xu
6812d36790b45f422b0bfdcf
Haozhe Chen
6812d36790b45f422b0bfdd0
Yuxi Qian
6812d36790b45f422b0bfdd1
Yiran Geng
6812d36790b45f422b0bfdd2
Jiageng Mao
6812d36790b45f422b0bfdd3
Weikang Wan
admin_assigned
2025-05-05T08:10:54.077Z
67fc3447116c20272cca6322
/avatars/24c208857d9d41827ec7b71b59fbab30.svg
Weikang Wan
user
wkwan7
6812d36790b45f422b0bfdd4
Mingtong Zhang
6812d36790b45f422b0bfdd5
Jiangran Lyu
admin_assigned
2025-05-05T08:11:03.931Z
67ea02f6048f3bf1dd56f3b4
/avatars/0abfc0ec090b28ebfd6b6a4d7abb74d0.svg
Jiangran Lyu
user
Jiangranlyu
6812d36790b45f422b0bfdd6
Siheng Zhao
admin_assigned
2025-05-05T08:11:10.917Z
642e76a8113b200fd767b3c9
https://cdn-avatars.huggingface.co/v1/production/uploads/642e76a8113b200fd767b3c9/03_CAAr6gy7H_F_iUWx76.png
Siheng Zhao
user
OliverZhao
6812d36790b45f422b0bfdd7
Jiazhao Zhang
admin_assigned
2025-05-05T08:11:18.012Z
65658233d35fc55406e8b00d
/avatars/660eaa1923cd3e3478cec8197936a75c.svg
Jiazhao Zhang
user
Jzzhang
6812d36790b45f422b0bfdd8
Jialiang Zhang
6812d36790b45f422b0bfdd9
Chengyang Zhao
admin_assigned
2025-05-05T08:11:31.023Z
679165b9c7f527ef3619504e
/avatars/f3e6ce5fc3d05c8632d8b208f55c2987.svg
Chengyang Zhao
user
chengyzhao
6812d36790b45f422b0bfdda
Haoran Lu
admin_assigned
2025-05-05T08:11:40.233Z
666b3899cff287ed509ed24a
/avatars/1ecf542f023397b134f584b9dd89a2ec.svg
Haoran Lu
user
haoranlu
6812d36790b45f422b0bfddb
Yufei Ding
6812d36790b45f422b0bfddc
Ran Gong
6812d36790b45f422b0bfddd
Yuran Wang
6812d36790b45f422b0bfdde
Yuxuan Kuang
claimed_verified
2025-06-12T12:44:05.718Z
62359088a17d7271859c88f4
https://cdn-avatars.huggingface.co/v1/production/uploads/1647677549197-noauth.jpeg
Yuxuan Kuang
user
yxK
6812d36790b45f422b0bfddf
Ruihai Wu
admin_assigned
2025-05-05T08:12:17.852Z
65080df1338e4879e472d9ec
/avatars/70824da1944bd3abb7b7e826139bdad5.svg
Ruihai Wu
user
warshallrho
6812d36790b45f422b0bfde0
Baoxiong Jia
admin_assigned
2025-05-05T08:12:10.844Z
6304b389bad6ce7fc02691d5
/avatars/a762ca59624ce409650165f36b973488.svg
Baoxiong Jia
user
BuzzBeater
6812d36790b45f422b0bfde1
Carlo Sferrazza
6812d36790b45f422b0bfde2
Hao Dong
6812d36790b45f422b0bfde3
Siyuan Huang
6812d36790b45f422b0bfde4
Yue Wang
6812d36790b45f422b0bfde5
Jitendra Malik
admin_assigned
2025-05-05T08:11:54.579Z
65369a95605a07338de78ab0
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/sGFjOjLT2akN-sn5beVWL.jpeg
Jitendra Malik 
user
jitendra1995
6812d36790b45f422b0bfde6
Pieter Abbeel
RoboVerse: Towards a Unified Platform, Dataset and Benchmark for
  Scalable and Generalizable Robot Learning
Data scaling and standardized evaluation benchmarks have driven significant
advances in natural language processing and computer vision. However, robotics
faces unique challenges in scaling data and establishing evaluation protocols.
Collecting real-world data is resource-intensive and inefficient, while
benchmarking in real-world scenarios remains highly complex. Synthetic data and
simulation offer promising alternatives, yet existing efforts often fall short
in data quality, diversity, and benchmark standardization. To address these
challenges, we introduce RoboVerse, a comprehensive framework comprising a
simulation platform, a synthetic dataset, and unified benchmarks. Our
simulation platform supports multiple simulators and robotic embodiments,
enabling seamless transitions between different environments. The synthetic
dataset, featuring high-fidelity physics and photorealistic rendering, is
constructed through multiple approaches. Additionally, we propose unified
benchmarks for imitation learning and reinforcement learning, enabling
evaluation across different levels of generalization. At the core of the
simulation platform is MetaSim, an infrastructure that abstracts diverse
simulation environments into a universal interface. It restructures existing
simulation environments into a simulator-agnostic configuration system, as well
as an API aligning different simulator functionalities, such as launching
simulation environments, loading assets with initial states, stepping the
physics engine, etc. This abstraction ensures interoperability and
extensibility. Comprehensive experiments demonstrate that RoboVerse enhances
the performance of imitation learning, reinforcement learning, world model
learning, and sim-to-real transfer. These results validate the reliability of
our dataset and benchmarks, establishing RoboVerse as a robust solution for
advancing robot learning.
RoboVerse provides a comprehensive framework with high-quality synthetic data, simulation platform, and unified benchmarks to address data scaling and evaluation challenges in robotics.
synthetic data simulation platform benchmark standardization imitation learning reinforcement learning world model learning sim-to-real transfer MetaSim simulator-agnostic physics engine