Proactive Detection of Voice Cloning with Localized Watermarking
In the rapidly evolving field of speech generative models, there is a
pressing need to ensure audio authenticity against the risks of voice cloning.
We present AudioSeal, the first audio watermarking technique designed
specifically for localized detection of AI-generated speech. AudioSeal employs
a generator/detector architecture trained jointly with a localization loss to
enable localized watermark detection up to the sample level, and a novel
perceptual loss inspired by auditory masking, that enables AudioSeal to achieve
better imperceptibility. AudioSeal achieves state-of-the-art performance in
terms of robustness to real life audio manipulations and imperceptibility based
on automatic and human evaluation metrics. Additionally, AudioSeal is designed
with a fast, single-pass detector, that significantly surpasses existing models
in speed - achieving detection up to two orders of magnitude faster, making it
ideal for large-scale and real-time applications.
65b9cf6dd88a65abb9117e6a
Robin San Roman
claimed_verified
2024-01-31T11:48:18.242Z
65ba260b3167e14767093ca7
/avatars/f23fa3e8429ac603dd512cc52481a9bc.svg
Robin San Roman
user
Sparker17
65b9cf6dd88a65abb9117e6b
Pierre Fernandez
admin_assigned
2024-01-31T10:03:32.247Z
616c22e040e2f69baa1c7ae0
/avatars/d6c00e7d98e5e8a52e99aa7b1a7815ee.svg
Pierre Fernandez
user
pierrefdz
65b9cf6dd88a65abb9117e6c
Alexandre Défossez
admin_assigned
2024-01-31T10:03:41.720Z
6357f5f50dce5559211a3503
https://cdn-avatars.huggingface.co/v1/production/uploads/1666708948380-noauth.jpeg
Alexandre Défossez
user
adefossez
65b9cf6dd88a65abb9117e6d
Teddy Furon
claimed_verified
2024-10-04T20:12:02.474Z
670000393ec4cc293d41d92c
/avatars/b67843e1f7addaf6769c2cba868bf501.svg
Teddy Furon
user
tfuron
65b9cf6dd88a65abb9117e6e
Tuan Tran
admin_assigned
2024-01-31T10:04:18.019Z
6417f443058f65de4320716e
/avatars/3377a2f5431ff7f5e9d106bc5eec14e8.svg
Tuan Tran
user
tuantran
65b9cf6dd88a65abb9117e6f
Hady Elsahar
admin_assigned
2024-01-31T10:04:24.497Z
60338cdfb5883695ce9d0916
https://cdn-avatars.huggingface.co/v1/production/uploads/60338cdfb5883695ce9d0916/BXbJKt_UwoFnh7xB4ewHs.jpeg
Hady Elsahar
user
hadyelsahar
Proactive Detection of Voice Cloning with Localized Watermarking
In the rapidly evolving field of speech generative models, there is a
pressing need to ensure audio authenticity against the risks of voice cloning.
We present AudioSeal, the first audio watermarking technique designed
specifically for localized detection of AI-generated speech. AudioSeal employs
a generator/detector architecture trained jointly with a localization loss to
enable localized watermark detection up to the sample level, and a novel
perceptual loss inspired by auditory masking, that enables AudioSeal to achieve
better imperceptibility. AudioSeal achieves state-of-the-art performance in
terms of robustness to real life audio manipulations and imperceptibility based
on automatic and human evaluation metrics. Additionally, AudioSeal is designed
with a fast, single-pass detector, that significantly surpasses existing models
in speed - achieving detection up to two orders of magnitude faster, making it
ideal for large-scale and real-time applications.
AudioSeal is an audio watermarking technique that uses a generator/detector architecture to detect AI-generated speech with high robustness and imperceptibility, offering fast detection.
generator/detector architecture localization loss perceptual loss auditory masking state-of-the-art robustness imperceptibility automatic evaluation human evaluation single-pass detector real-time applications