Meltemi: The first open Large Language Model for Greek
We describe the development and capabilities of Meltemi 7B, the first open
Large Language Model for the Greek language. Meltemi 7B has 7 billion
parameters and is trained on a 40 billion token Greek corpus. For the
development of Meltemi 7B, we adapt Mistral, by continuous pretraining on the
Greek Corpus. Meltemi 7B contains up-to-date information up to September 2023.
Furthermore, we have translated and curated a Greek instruction corpus, which
has been used for the instruction-tuning of a chat model, named Meltemi 7B
Instruct. Special care has been given to the alignment and the removal of toxic
content for the Meltemi 7B Instruct. The developed models are evaluated on a
broad set of collected evaluation corpora, and examples of prompts and
responses are presented. Both Meltemi 7B and Meltemi 7B Instruct are available
at https://huggingface.co/ilsp under the Apache 2.0 license.
66a9c4a585f81589aae3e68b
Leon Voukoutis
admin_assigned
2024-07-31T08:36:49.284Z
648724a02b9aa290e85d33a4
/avatars/c7d7fe9519a7d873158e41e141a8bfde.svg
Leon Voukoutis
user
LVouk
66a9c4a585f81589aae3e68c
Dimitris Roussis
admin_assigned
2024-07-31T08:36:54.903Z
6366fe0ba2abcdf2fd6be58b
https://cdn-avatars.huggingface.co/v1/production/uploads/6366fe0ba2abcdf2fd6be58b/5Uy79Kr-TTCXYYU-sqsX9.jpeg
Dimitris Roussis
user
droussis
66a9c4a585f81589aae3e68d
Georgios Paraskevopoulos
admin_assigned
2024-07-31T08:37:16.127Z
639215a81bae0dde85842ab8
/avatars/7bb312cb899b622929d262a22b584b53.svg
Georgios Paraskevopoulos
user
geopar
66a9c4a585f81589aae3e68e
Sokratis Sofianopoulos
admin_assigned
2024-07-31T08:37:22.021Z
62c539a0aa6319a2dbd79327
/avatars/de9fdedfa8720977a0b5c80b3c167ce8.svg
Sokratis Sofianopoulos
user
soksof
66a9c4a585f81589aae3e68f
Prokopis Prokopidis
admin_assigned
2024-07-31T08:37:28.059Z
64be828ce90972519da1cc39
/avatars/b82555ebff59dce461ab3a1256ae4ba6.svg
Prokopis Prokopidis
user
pprokopidis
66a9c4a585f81589aae3e690
Vassilis Papavasileiou
66a9c4a585f81589aae3e691
Athanasios Katsamanis
66a9c4a585f81589aae3e692
Stelios Piperidis
admin_assigned
2024-07-31T08:37:50.385Z
65aa4ab19aba49e1d0047930
/avatars/a2748a7e79b9a6e13ca96b36812397b6.svg
Stelios Piperidis
user
spiper
66a9c4a585f81589aae3e693
Vassilis Katsouros
admin_assigned
2024-07-31T08:38:05.470Z
61c17fa04fcde74777ea5862
/avatars/bef5b64645219c7957529b9782a53ecd.svg
Vassilis Katsouros
user
Vassilis
Meltemi: The first open Large Language Model for Greek
We describe the development and capabilities of Meltemi 7B, the first open
Large Language Model for the Greek language. Meltemi 7B has 7 billion
parameters and is trained on a 40 billion token Greek corpus. For the
development of Meltemi 7B, we adapt Mistral, by continuous pretraining on the
Greek Corpus. Meltemi 7B contains up-to-date information up to September 2023.
Furthermore, we have translated and curated a Greek instruction corpus, which
has been used for the instruction-tuning of a chat model, named Meltemi 7B
Instruct. Special care has been given to the alignment and the removal of toxic
content for the Meltemi 7B Instruct. The developed models are evaluated on a
broad set of collected evaluation corpora, and examples of prompts and
responses are presented. Both Meltemi 7B and Meltemi 7B Instruct are available
at https://huggingface.co/ilsp under the Apache 2.0 license.
Developers created Meltemi 7B, a 7 billion parameter open-source large language model for Greek, trained on a 40 billion token corpus, and enhanced with instruction-tuning for chat applications.
Large Language Model Mistral Greek Corpus instruction-tuning prompt response