E3 TTS: Easy End-to-End Diffusion-based Text to Speech
We propose Easy End-to-End Diffusion-based Text to Speech, a simple and
efficient end-to-end text-to-speech model based on diffusion. E3 TTS directly
takes plain text as input and generates an audio waveform through an iterative
refinement process. Unlike many prior work, E3 TTS does not rely on any
intermediate representations like spectrogram features or alignment
information. Instead, E3 TTS models the temporal structure of the waveform
through the diffusion process. Without relying on additional conditioning
information, E3 TTS could support flexible latent structure within the given
audio. This enables E3 TTS to be easily adapted for zero-shot tasks such as
editing without any additional training. Experiments show that E3 TTS can
generate high-fidelity audio, approaching the performance of a state-of-the-art
neural TTS system. Audio samples are available at https://e3tts.github.io.
654507e52a13610acc1fb6c0
Yuan Gao
654507e52a13610acc1fb6c1
Nobuyuki Morioka
654507e52a13610acc1fb6c2
Yu Zhang
654507e52a13610acc1fb6c3
Nanxin Chen
claimed_verified
2025-05-29T09:41:05.506Z
661c2c46bb1b205d62b52ea0
/avatars/7ca05de9fedd5d7074a1b7fdd0a47e1a.svg
NX Chen
user
cnxhk
E3 TTS: Easy End-to-End Diffusion-based Text to Speech
We propose Easy End-to-End Diffusion-based Text to Speech, a simple and
efficient end-to-end text-to-speech model based on diffusion. E3 TTS directly
takes plain text as input and generates an audio waveform through an iterative
refinement process. Unlike many prior work, E3 TTS does not rely on any
intermediate representations like spectrogram features or alignment
information. Instead, E3 TTS models the temporal structure of the waveform
through the diffusion process. Without relying on additional conditioning
information, E3 TTS could support flexible latent structure within the given
audio. This enables E3 TTS to be easily adapted for zero-shot tasks such as
editing without any additional training. Experiments show that E3 TTS can
generate high-fidelity audio, approaching the performance of a state-of-the-art
neural TTS system. Audio samples are available at https://e3tts.github.io.
E3 TTS is a diffusion-based text-to-speech model that generates high-fidelity audio directly from text without intermediate representations or additional conditioning, supporting zero-shot tasks.
diffusion-based end-to-end diffusion process spectrogram features alignment information temporal structure waveform high-fidelity audio neural TTS