Ming-Lite-Uni: Advancements in Unified Architecture for Natural
  Multimodal Interaction
We introduce Ming-Lite-Uni, an open-source multimodal framework featuring a
newly designed unified visual generator and a native multimodal autoregressive
model tailored for unifying vision and language. Specifically, this project
provides an open-source implementation of the integrated MetaQueries and
M2-omni framework, while introducing the novel multi-scale learnable tokens and
multi-scale representation alignment strategy. By leveraging a fixed MLLM and a
learnable diffusion model, Ming-Lite-Uni enables native multimodal AR models to
perform both text-to-image generation and instruction based image editing
tasks, expanding their capabilities beyond pure visual understanding. Our
experimental results demonstrate the strong performance of Ming-Lite-Uni and
illustrate the impressive fluid nature of its interactive process. All code and
model weights are open-sourced to foster further exploration within the
community. Notably, this work aligns with concurrent multimodal AI milestones -
such as ChatGPT-4o with native image generation updated in March 25, 2025 -
underscoring the broader significance of unified models like Ming-Lite-Uni on
the path toward AGI. Ming-Lite-Uni is in alpha stage and will soon be further
refined.
681973cfa70a4728958323aa
Biao Gong
admin_assigned
2025-05-06T09:10:35.774Z
644fcbea4f7316588267dc80
https://cdn-avatars.huggingface.co/v1/production/uploads/644fcbea4f7316588267dc80/w8-2Gkaw9BN9VzppNXrTP.jpeg
Biao Gong
user
BiaoGong
681973cfa70a4728958323ab
Cheng Zou
claimed_verified
2025-10-11T14:11:54.659Z
68ddcb0aa95d61917ef9ecba
/avatars/cd7c9a9da61201c9937ae07363a0ad49.svg
Cheng Zou
user
wuyouant
681973cfa70a4728958323ac
Dandan Zheng
claimed_verified
2025-10-09T08:00:15.527Z
63747fe30938c075424108e6
/avatars/fd2d82c4fb2834edae516e904424a462.svg
zheng
user
forde450
681973cfa70a4728958323ad
Hu Yu
681973cfa70a4728958323ae
Jingdong Chen
admin_assigned
2025-05-06T09:10:51.440Z
64575ac8cd935d48a47774ec
/avatars/5d211e2c13d6c4e011e5e58b738413f7.svg
chenjingdong 
user
chenjingdong
681973cfa70a4728958323af
Jianxin Sun
admin_assigned
2025-05-06T09:10:02.728Z
6417cd278f689506e71439ac
/avatars/0993d834c6c3bbc53081aa139ee14a12.svg
jianxinsun
user
jianxinsun
681973cfa70a4728958323b0
Junbo Zhao
681973cfa70a4728958323b1
Jun Zhou
681973cfa70a4728958323b2
Kaixiang Ji
claimed_verified
2025-10-09T12:49:58.529Z
68e7773faf3a162f9301a117
/avatars/86010187beb5cd964eb9cc1db6e64dee.svg
Kaixiang Ji
user
TorryJ
681973cfa70a4728958323b3
Lixiang Ru
681973cfa70a4728958323b4
Libin Wang
claimed_verified
2025-10-09T12:49:56.373Z
66b180741fa16824b629943b
/avatars/42d1076da1ae16ce2277f254416ff839.svg
wang
user
lbwang
681973cfa70a4728958323b5
Qingpei Guo
claimed_verified
2025-10-09T08:00:11.681Z
6482dd5ec2ec7df31fd5cfd5
/avatars/c74fb04b2b4488a9f3f7872b2f91cd7b.svg
qingpei.gqp
user
qingpei
681973cfa70a4728958323b6
Rui Liu
681973cfa70a4728958323b7
Weilong Chai
claimed_verified
2025-10-09T12:49:53.838Z
64d2fe8ed8b712baf1948c03
/avatars/e8f5f368632065e16bd758a7a2cf182e.svg
Willie Chai
user
Williechai
681973cfa70a4728958323b8
Xinyu Xiao
admin_assigned
2025-05-06T09:11:49.316Z
67cc852d2cfa481bce2dd07e
/avatars/0c1c32ec066a8de9148b083b39d1fab8.svg
xinyu xiao
user
bear-xxy
681973cfa70a4728958323b9
Ziyuan Huang
claimed_verified
2025-10-09T08:00:17.761Z
655c5709948930b0fcf88a22
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/4Qk9Nlyus-su16GdIPJao.png
Ziyuan
user
zyhuangnus
Ming-Lite-Uni: Advancements in Unified Architecture for Natural
  Multimodal Interaction
We introduce Ming-Lite-Uni, an open-source multimodal framework featuring a
newly designed unified visual generator and a native multimodal autoregressive
model tailored for unifying vision and language. Specifically, this project
provides an open-source implementation of the integrated MetaQueries and
M2-omni framework, while introducing the novel multi-scale learnable tokens and
multi-scale representation alignment strategy. By leveraging a fixed MLLM and a
learnable diffusion model, Ming-Lite-Uni enables native multimodal AR models to
perform both text-to-image generation and instruction based image editing
tasks, expanding their capabilities beyond pure visual understanding. Our
experimental results demonstrate the strong performance of Ming-Lite-Uni and
illustrate the impressive fluid nature of its interactive process. All code and
model weights are open-sourced to foster further exploration within the
community. Notably, this work aligns with concurrent multimodal AI milestones -
such as ChatGPT-4o with native image generation updated in March 25, 2025 -
underscoring the broader significance of unified models like Ming-Lite-Uni on
the path toward AGI. Ming-Lite-Uni is in alpha stage and will soon be further
refined.
Ming-Lite-Uni, an open-source multimodal framework, integrates vision and language using unified visual generators and autoregressive models, demonstrating strong performance in text-to-image generation and image editing.
Multimodal framework unified visual generator multimodal autoregressive model MetaQueries M2-omni multi-scale learnable tokens multi-scale representation alignment MLLM diffusion model text-to-image generation instruction-based image editing