Efficient Monotonic Multihead Attention
We introduce the Efficient Monotonic Multihead Attention (EMMA), a
state-of-the-art simultaneous translation model with numerically-stable and
unbiased monotonic alignment estimation. In addition, we present improved
training and inference strategies, including simultaneous fine-tuning from an
offline translation model and reduction of monotonic alignment variance. The
experimental results demonstrate that the proposed model attains
state-of-the-art performance in simultaneous speech-to-text translation on the
Spanish and English translation task.
65727f19b49f7a8efbc49a34
Xutai Ma
admin_assigned
2023-12-08T10:41:10.678Z
65034bd70fc2f04d8569ab83
/avatars/7473d2513f5aabe00e4751dc55441bee.svg
Ma
user
Xutai
65727f19b49f7a8efbc49a35
Anna Sun
admin_assigned
2023-12-08T10:41:18.717Z
63eace53a332618465d5a527
/avatars/64b887ebcbf3f74abdcdca2e8383441d.svg
Anna Sun
user
annasun28
65727f19b49f7a8efbc49a36
Siqi Ouyang
admin_assigned
2023-12-08T10:41:25.897Z
63fbe11a0aab060792fec566
/avatars/4d2a64f951e2acc83c2947da0e9cc277.svg
Siqi Ouyang
user
owaski
65727f19b49f7a8efbc49a37
Hirofumi Inaguma
65727f19b49f7a8efbc49a38
Paden Tomasello
admin_assigned
2023-12-08T10:41:45.342Z
656e520c57ab9e2219c55dd3
/avatars/21599ad9b3807939f90622f5d694a58c.svg
Paden Tomasello
user
padentomasello
Efficient Monotonic Multihead Attention
We introduce the Efficient Monotonic Multihead Attention (EMMA), a
state-of-the-art simultaneous translation model with numerically-stable and
unbiased monotonic alignment estimation. In addition, we present improved
training and inference strategies, including simultaneous fine-tuning from an
offline translation model and reduction of monotonic alignment variance. The
experimental results demonstrate that the proposed model attains
state-of-the-art performance in simultaneous speech-to-text translation on the
Spanish and English translation task.
Efficient Monotonic Multihead Attention (EMMA) achieves top performance in simultaneous speech-to-text translation through improved training and reduced alignment variance.
Efficient Monotonic Multihead Attention EMMA monotonic alignment simultaneous fine-tuning monotonic alignment variance