Xmodel-1.5: An 1B-scale Multilingual LLM
We introduce Xmodel-1.5, a novel 1-billion-parameter multilingual large model
pretrained on approximately 2 trillion tokens. The model demonstrates strong
performance across several languages, with particularly notable results in
Thai, Arabic, and French, alongside its effectiveness in Chinese and English.
In addition, we contribute to the research community by releasing a Thai
evaluation dataset, which includes hundreds of questions annotated by students
from Chulalongkorn University's School of Integrated Innovation. While the
results are promising, we acknowledge that there is still room for improvement.
We hope this work advances ongoing efforts in multilingual AI research and
promotes better cross-linguistic understanding in various natural language
processing tasks. Our models and code are publicly available on GitHub at
https://github.com/XiaoduoAILab/XmodelLM.
673b59cad55948359af213ef
Wang Qun
claimed_verified
2024-12-30T19:37:39.593Z
647adfd0e3a7d24c8e46d7d1
https://cdn-avatars.huggingface.co/v1/production/uploads/647adfd0e3a7d24c8e46d7d1/UqZegkj3P2XyPe4Lgnrt7.jpeg
ValeriaWong
user
valeriaWong
673b59cad55948359af213f0
Liu Yang
673b59cad55948359af213f1
Lin Qingquan
admin_assigned
2024-11-18T16:19:06.486Z
66d53492ad293ffc4b17d99b
/avatars/1f89566c6652637731fbc7c1d69314cb.svg
qq
user
linqingquan
673b59cad55948359af213f2
Jiang Ling
Xmodel-1.5: An 1B-scale Multilingual LLM
We introduce Xmodel-1.5, a novel 1-billion-parameter multilingual large model
pretrained on approximately 2 trillion tokens. The model demonstrates strong
performance across several languages, with particularly notable results in
Thai, Arabic, and French, alongside its effectiveness in Chinese and English.
In addition, we contribute to the research community by releasing a Thai
evaluation dataset, which includes hundreds of questions annotated by students
from Chulalongkorn University's School of Integrated Innovation. While the
results are promising, we acknowledge that there is still room for improvement.
We hope this work advances ongoing efforts in multilingual AI research and
promotes better cross-linguistic understanding in various natural language
processing tasks. Our models and code are publicly available on GitHub at
https://github.com/XiaoduoAILab/XmodelLM.
Xmodel-1.5, a 1-billion-parameter multilingual model pretrained on 2 trillion tokens, achieves strong performance across multiple languages and contributes a Thai evaluation dataset.
1-billion-parameter multilingual large model pretrained 2 trillion tokens Thai Arabic French Chinese English Thai evaluation dataset