Cosmos World Foundation Model Platform for Physical AI
Physical AI needs to be trained digitally first. It needs a digital twin of
itself, the policy model, and a digital twin of the world, the world model. In
this paper, we present the Cosmos World Foundation Model Platform to help
developers build customized world models for their Physical AI setups. We
position a world foundation model as a general-purpose world model that can be
fine-tuned into customized world models for downstream applications. Our
platform covers a video curation pipeline, pre-trained world foundation models,
examples of post-training of pre-trained world foundation models, and video
tokenizers. To help Physical AI builders solve the most critical problems of
our society, we make our platform open-source and our models open-weight with
permissive licenses available via https://github.com/NVIDIA/Cosmos.
677dfaa14bf7f0d4734088a4
NVIDIA
677dfaa14bf7f0d4734088a6
Niket Agarwal
admin_assigned
2025-01-08T13:41:16.772Z
667b2e7f0ae3fef85fe33eb9
/avatars/033f74277bf934d8d9703e9a8c5a6716.svg
Niket Agarwal
user
niketa12
677dfaa14bf7f0d4734088a7
Arslan Ali
admin_assigned
2025-01-08T13:41:24.513Z
6517ec608a6d58d1d7ec8ec1
/avatars/4aac7fa6643f7f2d32e95cc991130ee9.svg
Arslan Ali
user
arslanali
677dfaa14bf7f0d4734088a8
Maciej Bala
admin_assigned
2025-01-08T13:41:34.024Z
675304737c4876b7a1475695
/avatars/7ee3c443f6a143b4a79d679fb7f60fe5.svg
Maciej Bala
user
mbalaNV
677dfaa14bf7f0d4734088a9
Yogesh Balaji
admin_assigned
2025-01-08T13:41:53.307Z
66cd4e2564a8631d7328a637
/avatars/024592abd427a8109f85c49e52e3bb7e.svg
Yogesh Balaji
user
yogeshbalaji
677dfaa14bf7f0d4734088aa
Erik Barker
677dfaa14bf7f0d4734088ab
Tiffany Cai
677dfaa14bf7f0d4734088ac
Prithvijit Chattopadhyay
admin_assigned
2025-01-08T13:43:22.176Z
628d451386d23ad1560882c4
https://cdn-avatars.huggingface.co/v1/production/uploads/628d451386d23ad1560882c4/UMxez0DEvX5qdP5ddqi-8.png
Prithvijit Chattopadhyay
user
prithv1
677dfaa14bf7f0d4734088ad
Yongxin Chen
admin_assigned
2025-01-08T13:43:31.201Z
66f4cf1a03b5ba8a7f1f6522
/avatars/2768d6e37d3f280194cfb8ed274f6015.svg
Yongxin Chen
user
Ema11
677dfaa14bf7f0d4734088ae
Yin Cui
claimed_verified
2025-04-11T07:26:11.516Z
649f05367b57fab3a5b27c8b
https://cdn-avatars.huggingface.co/v1/production/uploads/649f05367b57fab3a5b27c8b/UDJB4yqF2NmaRwCyTOfcl.jpeg
Yin Cui
user
richardaecn
677dfaa14bf7f0d4734088af
Yifan Ding
677dfaa14bf7f0d4734088b0
Daniel Dworakowski
677dfaa14bf7f0d4734088b1
Jiaojiao Fan
admin_assigned
2025-01-08T13:44:52.955Z
67227b67dfa07920c2985d22
/avatars/98f09002722950eadffe5c199d22bb4f.svg
Jiaojiao Fan
user
jjf233
677dfaa14bf7f0d4734088b2
Michele Fenzi
677dfaa14bf7f0d4734088b3
Francesco Ferroni
admin_assigned
2025-01-08T13:45:05.039Z
6353d3e95eac2d2efa7501f9
/avatars/4b063f54000bed4bfb1bfcc3cde1a09e.svg
Francesco Ferroni
user
fferroni
677dfaa14bf7f0d4734088b4
Sanja Fidler
677dfaa14bf7f0d4734088b5
Dieter Fox
677dfaa14bf7f0d4734088b6
Songwei Ge
admin_assigned
2025-01-08T13:45:28.342Z
67291c1a027e12eb38dc8a0c
/avatars/00a0ca6da11d2ffd14a83d28e57c01b4.svg
Songwei Ge
user
SongweiGe
677dfaa14bf7f0d4734088b7
Yunhao Ge
admin_assigned
2025-01-08T13:45:53.639Z
6520e493b80dc49ba0f1e262
/avatars/af21c1ee154b2c9a0d56e69a07508ccb.svg
Yunhao Ge
user
yunhaog
677dfaa14bf7f0d4734088b8
Jinwei Gu
admin_assigned
2025-01-08T13:46:02.830Z
647e8118770c299e56fc2bc8
/avatars/adf80f3473dda42450148789ae5c208f.svg
Jinwei Gu
user
jwgu
677dfaa14bf7f0d4734088b9
Siddharth Gururani
677dfaa14bf7f0d4734088ba
Ethan He
admin_assigned
2025-01-08T13:46:14.910Z
62b20f6df4a72794189248fc
/avatars/87e1125868616d4f7d6ee1e5ec4499b4.svg
Ethan He
user
ethanhe
677dfaa14bf7f0d4734088bb
Jiahui Huang
claimed_verified
2025-02-08T13:56:27.734Z
644a717e75fce8ebef4e4955
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/zLga4NZBohFPlv50dcAo9.png
Jiahui Huang
user
heiwang1997
677dfaa14bf7f0d4734088bc
Jacob Huffman
677dfaa14bf7f0d4734088bd
Pooya Jannaty
677dfaa14bf7f0d4734088be
Jingyi Jin
677dfaa14bf7f0d4734088bf
Seung Wook Kim
677dfaa14bf7f0d4734088c0
Gergely Klár
677dfaa14bf7f0d4734088c1
Grace Lam
677dfaa14bf7f0d4734088c2
Shiyi Lan
677dfaa14bf7f0d4734088c3
Laura Leal-Taixe
677dfaa14bf7f0d4734088c4
Anqi Li
677dfaa14bf7f0d4734088c5
Zhaoshuo Li
677dfaa14bf7f0d4734088c6
Chen-Hsuan Lin
677dfaa14bf7f0d4734088c7
Tsung-Yi Lin
677dfaa14bf7f0d4734088c8
Huan Ling
677dfaa14bf7f0d4734088c9
Ming-Yu Liu
677dfaa14bf7f0d4734088ca
Xian Liu
677dfaa14bf7f0d4734088cb
Alice Luo
677dfaa14bf7f0d4734088cc
Qianli Ma
677dfaa14bf7f0d4734088cd
Hanzi Mao
677dfaa14bf7f0d4734088ce
Kaichun Mo
677dfaa14bf7f0d4734088cf
Arsalan Mousavian
677dfaa14bf7f0d4734088d0
Seungjun Nah
677dfaa14bf7f0d4734088d1
Sriharsha Niverty
677dfaa14bf7f0d4734088d2
David Page
677dfaa14bf7f0d4734088d3
Despoina Paschalidou
677dfaa14bf7f0d4734088d4
Zeeshan Patel
claimed_verified
2025-01-09T10:07:14.790Z
638ee4df6251c8bd7abd246e
/avatars/8d8c4dac7d82cba6dcf884460bdc5328.svg
Zeeshan Patel
user
zeeshanp
677dfaa14bf7f0d4734088d5
Lindsey Pavao
677dfaa14bf7f0d4734088d6
Morteza Ramezanali
677dfaa14bf7f0d4734088d7
Fitsum Reda
677dfaa14bf7f0d4734088d8
Xiaowei Ren
677dfaa14bf7f0d4734088d9
Vasanth Rao Naik Sabavat
677dfaa14bf7f0d4734088da
Ed Schmerling
677dfaa14bf7f0d4734088db
Stella Shi
677dfaa14bf7f0d4734088dc
Bartosz Stefaniak
677dfaa14bf7f0d4734088dd
Shitao Tang
677dfaa14bf7f0d4734088de
Lyne Tchapmi
677dfaa14bf7f0d4734088df
Przemek Tredak
677dfaa14bf7f0d4734088e0
Wei-Cheng Tseng
677dfaa14bf7f0d4734088e1
Jibin Varghese
claimed_verified
2025-01-22T20:49:55.440Z
66d76b37483bbfc9e43eba4b
https://cdn-avatars.huggingface.co/v1/production/uploads/66d76b37483bbfc9e43eba4b/61G28x94O2MYzD2u_wnsD.png
Jibin Rajan Varghese
user
jibinv
677dfaa14bf7f0d4734088e2
Hao Wang
677dfaa14bf7f0d4734088e3
Haoxiang Wang
677dfaa14bf7f0d4734088e4
Heng Wang
677dfaa14bf7f0d4734088e5
Ting-Chun Wang
677dfaa14bf7f0d4734088e6
Fangyin Wei
677dfaa14bf7f0d4734088e7
Xinyue Wei
677dfaa14bf7f0d4734088e8
Jay Zhangjie Wu
claimed_verified
2025-03-04T08:52:46.920Z
633aaf695df91da9cea92960
https://cdn-avatars.huggingface.co/v1/production/uploads/633aaf695df91da9cea92960/h1oOWUudbdlsd63Q5w0hM.png
Jay Wu
user
jayw
677dfaa14bf7f0d4734088e9
Jiashu Xu
677dfaa14bf7f0d4734088ea
Wei Yang
677dfaa14bf7f0d4734088eb
Lin Yen-Chen
677dfaa14bf7f0d4734088ec
Xiaohui Zeng
677dfaa14bf7f0d4734088ed
Yu Zeng
677dfaa14bf7f0d4734088ee
Jing Zhang
677dfaa14bf7f0d4734088ef
Qinsheng Zhang
677dfaa14bf7f0d4734088f0
Yuxuan Zhang
677dfaa14bf7f0d4734088f1
Qingqing Zhao
677dfaa14bf7f0d4734088f2
Artur Zolkowski
Cosmos World Foundation Model Platform for Physical AI
Physical AI needs to be trained digitally first. It needs a digital twin of
itself, the policy model, and a digital twin of the world, the world model. In
this paper, we present the Cosmos World Foundation Model Platform to help
developers build customized world models for their Physical AI setups. We
position a world foundation model as a general-purpose world model that can be
fine-tuned into customized world models for downstream applications. Our
platform covers a video curation pipeline, pre-trained world foundation models,
examples of post-training of pre-trained world foundation models, and video
tokenizers. To help Physical AI builders solve the most critical problems of
our society, we make our platform open-source and our models open-weight with
permissive licenses available via https://github.com/NVIDIA/Cosmos.
The Cosmos World Foundation Model Platform provides a framework for developing customized world models for Physical AI by leveraging video curation, pre-trained models, and tokenizers.
digital twin policy model world model world foundation model video curation pre-trained world foundation models post-training video tokenizers