MeshAnything: Artist-Created Mesh Generation with Autoregressive
  Transformers
Recently, 3D assets created via reconstruction and generation have matched
the quality of manually crafted assets, highlighting their potential for
replacement. However, this potential is largely unrealized because these assets
always need to be converted to meshes for 3D industry applications, and the
meshes produced by current mesh extraction methods are significantly inferior
to Artist-Created Meshes (AMs), i.e., meshes created by human artists.
Specifically, current mesh extraction methods rely on dense faces and ignore
geometric features, leading to inefficiencies, complicated post-processing, and
lower representation quality. To address these issues, we introduce
MeshAnything, a model that treats mesh extraction as a generation problem,
producing AMs aligned with specified shapes. By converting 3D assets in any 3D
representation into AMs, MeshAnything can be integrated with various 3D asset
production methods, thereby enhancing their application across the 3D industry.
The architecture of MeshAnything comprises a VQ-VAE and a shape-conditioned
decoder-only transformer. We first learn a mesh vocabulary using the VQ-VAE,
then train the shape-conditioned decoder-only transformer on this vocabulary
for shape-conditioned autoregressive mesh generation. Our extensive experiments
show that our method generates AMs with hundreds of times fewer faces,
significantly improving storage, rendering, and simulation efficiencies, while
achieving precision comparable to previous methods.
666f92d1963bc5d5884bb55c
Yiwen Chen
claimed_verified
2024-06-17T16:28:36.099Z
64e45b1c2fbf570ac70dc6e8
/avatars/8dd65f75f2c1b92abf2f189f6d8466a2.svg
Chen Yiwen
user
Yiwen-ntu
666f92d1963bc5d5884bb55d
Tong He
claimed_verified
2025-07-17T13:56:54.228Z
6747ede3a9c72aebe1322382
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/inILqQ05sESbYLdsEldJ_.png
Tong He
user
tonghe90
666f92d1963bc5d5884bb55e
Di Huang
666f92d1963bc5d5884bb55f
Weicai Ye
admin_assigned
2024-06-18T09:11:15.633Z
6360d9f0472131c3bc4f61df
/avatars/c5d884e5ef19b781e3405aba6dd68ca8.svg
WeicaiYe
user
WeicaiYe
666f92d1963bc5d5884bb560
Sijin Chen
admin_assigned
2024-06-18T09:11:28.999Z
64d6ee19c3b41747a271da59
/avatars/c67da5d25fdf1dcb552772500955edb2.svg
Sijin Chen
user
ch3cook-fdu
666f92d1963bc5d5884bb561
Jiaxiang Tang
admin_assigned
2024-06-18T09:11:34.939Z
6664dc00da1e6adefea0e177
/avatars/17facee3d6feb800eee233ae81816cd5.svg
jiaxiang tang
user
jiaxiang-tang
666f92d1963bc5d5884bb562
Xin Chen
666f92d1963bc5d5884bb563
Zhongang Cai
admin_assigned
2024-06-18T09:11:50.702Z
652d06833b5997ed71ce5c46
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/xZTXEcnEogEmBm_ledJQr.jpeg
Zhongang Cai
user
caizhongang
666f92d1963bc5d5884bb564
Lei Yang
admin_assigned
2025-03-10T08:10:23.855Z
6626a471430a124253f197c8
/avatars/f5747fdbe495d1296fed9d16d8c95857.svg
yl-1993
user
yl-1993
666f92d1963bc5d5884bb565
Gang Yu
claimed_verified
2024-11-15T09:46:47.907Z
63417332c5565a4b8d43a0d8
https://cdn-avatars.huggingface.co/v1/production/uploads/63417332c5565a4b8d43a0d8/MmnYG7Wu2Z_lqCBvTfJmy.png
Gang Yu
user
skicy
666f92d1963bc5d5884bb566
Guosheng Lin
666f92d1963bc5d5884bb567
Chi Zhang
claimed_verified
2024-08-08T07:42:38.386Z
64196320ed725fef64419c2a
/avatars/96feb22fb5e8931d6c9e0ea06148266f.svg
Chi Zhang
user
DrChiZhang
MeshAnything: Artist-Created Mesh Generation with Autoregressive
  Transformers
Recently, 3D assets created via reconstruction and generation have matched
the quality of manually crafted assets, highlighting their potential for
replacement. However, this potential is largely unrealized because these assets
always need to be converted to meshes for 3D industry applications, and the
meshes produced by current mesh extraction methods are significantly inferior
to Artist-Created Meshes (AMs), i.e., meshes created by human artists.
Specifically, current mesh extraction methods rely on dense faces and ignore
geometric features, leading to inefficiencies, complicated post-processing, and
lower representation quality. To address these issues, we introduce
MeshAnything, a model that treats mesh extraction as a generation problem,
producing AMs aligned with specified shapes. By converting 3D assets in any 3D
representation into AMs, MeshAnything can be integrated with various 3D asset
production methods, thereby enhancing their application across the 3D industry.
The architecture of MeshAnything comprises a VQ-VAE and a shape-conditioned
decoder-only transformer. We first learn a mesh vocabulary using the VQ-VAE,
then train the shape-conditioned decoder-only transformer on this vocabulary
for shape-conditioned autoregressive mesh generation. Our extensive experiments
show that our method generates AMs with hundreds of times fewer faces,
significantly improving storage, rendering, and simulation efficiencies, while
achieving precision comparable to previous methods.
MeshAnything, integrating VQ-VAE and a shape-conditioned transformer, generates high-quality, artist-created meshes with significantly reduced face count, improving efficiency compared to existing mesh extraction methods.
VQ-VAE shape-conditioned decoder-only transformer shape-conditioned autoregressive mesh generation mesh vocabulary mesh extraction artist-created meshes AMs