VibeVoice Technical Report
This report presents VibeVoice, a novel model designed to synthesize
long-form speech with multiple speakers by employing next-token diffusion,
which is a unified method for modeling continuous data by autoregressively
generating latent vectors via diffusion. To enable this, we introduce a novel
continuous speech tokenizer that, when compared to the popular Encodec model,
improves data compression by 80 times while maintaining comparable performance.
The tokenizer effectively preserves audio fidelity while significantly boosting
computational efficiency for processing long sequences. Thus, VibeVoice can
synthesize long-form speech for up to 90 minutes (in a 64K context window
length) with a maximum of 4 speakers, capturing the authentic conversational
``vibe'' and surpassing open-source and proprietary dialogue models.
68ae6a0f364411bea07df70f
Zhiliang Peng
claimed_verified
2025-09-01T07:54:23.745Z
646c408336505117e22f4b36
/avatars/8201da3c4ec51c8e113446f9578d44f6.svg
zhiliang
user
zzliang
68ae6a0f364411bea07df710
Jianwei Yu
68ae6a0f364411bea07df711
Wenhui Wang
68ae6a0f364411bea07df712
Yaoyao Chang
68ae6a0f364411bea07df713
Yutao Sun
68ae6a0f364411bea07df714
Li Dong
claimed_verified
2025-08-27T07:10:54.323Z
5df85abada6d0311fd3d5408
/avatars/2331cf703c1b5d3a62e2050b1a6eb108.svg
Li Dong
user
unilm
68ae6a0f364411bea07df715
Yi Zhu
68ae6a0f364411bea07df716
Weijiang Xu
68ae6a0f364411bea07df717
Hangbo Bao
68ae6a0f364411bea07df718
Zehua Wang
68ae6a0f364411bea07df719
Shaohan Huang
claimed_verified
2025-08-28T08:56:32.368Z
632bd2f72d6a805eeb4bc601
/avatars/6e1533e8a599f3068290aa69ac82cab7.svg
HUANG SHAOHAN
user
buaahsh
68ae6a0f364411bea07df71a
Yan Xia
68ae6a0f364411bea07df71b
Furu Wei
VibeVoice Technical Report
This report presents VibeVoice, a novel model designed to synthesize
long-form speech with multiple speakers by employing next-token diffusion,
which is a unified method for modeling continuous data by autoregressively
generating latent vectors via diffusion. To enable this, we introduce a novel
continuous speech tokenizer that, when compared to the popular Encodec model,
improves data compression by 80 times while maintaining comparable performance.
The tokenizer effectively preserves audio fidelity while significantly boosting
computational efficiency for processing long sequences. Thus, VibeVoice can
synthesize long-form speech for up to 90 minutes (in a 64K context window
length) with a maximum of 4 speakers, capturing the authentic conversational
``vibe'' and surpassing open-source and proprietary dialogue models.
VibeVoice synthesizes long-form multi-speaker speech using next-token diffusion and a highly efficient continuous speech tokenizer, achieving superior performance and fidelity.
next-token diffusion continuous speech tokenizer Encodec audio fidelity computational efficiency long-form speech multi-speaker synthesis conversational vibe dialogue models