EuroLLM: Multilingual Language Models for Europe
The quality of open-weight LLMs has seen significant improvement, yet they
remain predominantly focused on English. In this paper, we introduce the
EuroLLM project, aimed at developing a suite of open-weight multilingual LLMs
capable of understanding and generating text in all official European Union
languages, as well as several additional relevant languages. We outline the
progress made to date, detailing our data collection and filtering process, the
development of scaling laws, the creation of our multilingual tokenizer, and
the data mix and modeling configurations. Additionally, we release our initial
models: EuroLLM-1.7B and EuroLLM-1.7B-Instruct and report their performance on
multilingual general benchmarks and machine translation.
66f397fa734b9d57499abc4e
Pedro Henrique Martins
66f397fa734b9d57499abc4f
Patrick Fernandes
66f397fa734b9d57499abc50
João Alves
claimed_verified
2024-10-23T15:06:57.379Z
61ae32477b23f65fc71a62e4
/avatars/10054d6a17e65e5509f4f48cf4659cde.svg
João Alves
user
jalves97
66f397fa734b9d57499abc51
Nuno M. Guerreiro
claimed_verified
2025-07-22T08:33:43.206Z
61f06c8ba57920a251ec1a5c
https://cdn-avatars.huggingface.co/v1/production/uploads/61f06c8ba57920a251ec1a5c/TmmSN9xWm1noLeAtsUSRk.jpeg
Nuno M. Guerreiro
user
nunonmg
66f397fa734b9d57499abc52
Ricardo Rei
claimed_verified
2024-09-30T08:07:24.987Z
60d9a9791fa5d458da77754d
https://cdn-avatars.huggingface.co/v1/production/uploads/1624887555363-60d9a9791fa5d458da77754d.jpeg
Ricardo Rei
user
RicardoRei
66f397fa734b9d57499abc53
Duarte M. Alves
claimed_verified
2025-03-10T09:53:01.222Z
64132452d8a418df415a6ded
https://cdn-avatars.huggingface.co/v1/production/uploads/64132452d8a418df415a6ded/qkjL5G89uldHUXlCI3n4f.jpeg
Duarte Alves
user
DuarteMRAlves
66f397fa734b9d57499abc54
José Pombal
claimed_verified
2024-09-27T13:47:41.575Z
6408b9d79e9f790c905398a2
/avatars/ee0661b6711073141eeb13dcc6b8b9bd.svg
José Maria Pombal
user
jmprcp
66f397fa734b9d57499abc55
Amin Farajian
66f397fa734b9d57499abc56
Manuel Faysse
claimed_verified
2024-10-04T20:11:35.602Z
60f2e021adf471cbdf8bb660
https://cdn-avatars.huggingface.co/v1/production/uploads/1654090481550-60f2e021adf471cbdf8bb660.jpeg
Manuel Faysse
user
manu
66f397fa734b9d57499abc57
Mateusz Klimaszewski
claimed_verified
2024-09-30T15:51:24.429Z
6579dcdabd88c2afe8665a0e
/avatars/f64a729250c207a76fd31d7daa3e58b6.svg
Mateusz Klimaszewski
user
mklimasz
66f397fa734b9d57499abc58
Pierre Colombo
66f397fa734b9d57499abc59
Barry Haddow
66f397fa734b9d57499abc5a
José G. C. de Souza
claimed_verified
2024-10-18T08:25:45.508Z
63eb70a713a3eb9b0dc757b5
/avatars/877d0b0cb5472d82f75653ec0fe76677.svg
José G. C. de Souza
user
josesouza
66f397fa734b9d57499abc5b
Alexandra Birch
66f397fa734b9d57499abc5c
André F. T. Martins
EuroLLM: Multilingual Language Models for Europe
The quality of open-weight LLMs has seen significant improvement, yet they
remain predominantly focused on English. In this paper, we introduce the
EuroLLM project, aimed at developing a suite of open-weight multilingual LLMs
capable of understanding and generating text in all official European Union
languages, as well as several additional relevant languages. We outline the
progress made to date, detailing our data collection and filtering process, the
development of scaling laws, the creation of our multilingual tokenizer, and
the data mix and modeling configurations. Additionally, we release our initial
models: EuroLLM-1.7B and EuroLLM-1.7B-Instruct and report their performance on
multilingual general benchmarks and machine translation.
The EuroLLM project develops multilingual language models for European Union languages, detailing data collection, tokenizer creation, and model performance.
open-weight LLMs EuroLLM project multilingual LLMs scaling laws multilingual tokenizer data mix modeling configurations EuroLLM-1.7B EuroLLM-1.7B-Instruct