Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open
  Generative Large Language Models
We introduce Jais and Jais-chat, new state-of-the-art Arabic-centric
foundation and instruction-tuned open generative large language models (LLMs).
The models are based on the GPT-3 decoder-only architecture and are pretrained
on a mixture of Arabic and English texts, including source code in various
programming languages. With 13 billion parameters, they demonstrate better
knowledge and reasoning capabilities in Arabic than any existing open Arabic
and multilingual models by a sizable margin, based on extensive evaluation.
Moreover, the models are competitive in English compared to English-centric
open models of similar size, despite being trained on much less English data.
We provide a detailed description of the training, the tuning, the safety
alignment, and the evaluation of the models. We release two open versions of
the model -- the foundation Jais model, and an instruction-tuned Jais-chat
variant -- with the aim of promoting research on Arabic LLMs. Available at
https://huggingface.co/inception-mbzuai/jais-13b-chat
64f0080606fd497b26170eca
Neha Sengupta
admin_assigned
2023-08-31T12:18:23.924Z
6429100588215cee63b9334e
https://cdn-avatars.huggingface.co/v1/production/uploads/6429100588215cee63b9334e/L5-CPVDsIC_1mI_izizyX.jpeg
Neha Sengupta
user
neha1710
64f0080606fd497b26170ecb
Sunil Kumar Sahu
admin_assigned
2023-08-31T12:19:30.906Z
6172c8ea51681de8a2623df2
https://cdn-avatars.huggingface.co/v1/production/uploads/6172c8ea51681de8a2623df2/utzkBPCwoS4jIAHL-5m_z.jpeg
Sunil Kumar Sahu
user
sunilitggu
64f0080606fd497b26170ecc
Bokang Jia
64f0080606fd497b26170ecd
Satheesh Katipomu
admin_assigned
2023-08-31T12:20:29.321Z
62d00768c375d0c842518541
/avatars/2e01b90e4b5c312953ed0a883e336f00.svg
Satheesh K
user
satheeshkatipomu
64f0080606fd497b26170ece
Haonan Li
admin_assigned
2023-08-31T12:20:50.483Z
643934ecb9ac1d55f41cefd7
https://cdn-avatars.huggingface.co/v1/production/uploads/643934ecb9ac1d55f41cefd7/v41FZ2Ar6nVXEkf-w5axf.jpeg
Haonan Li
user
lmlmcat
64f0080606fd497b26170ecf
Fajri Koto
admin_assigned
2023-08-31T12:21:05.872Z
643fb246c2ec31af16aa9313
https://cdn-avatars.huggingface.co/v1/production/uploads/643fb246c2ec31af16aa9313/zCDYOVGdIrncX-k9o7bM6.png
Fajri Koto
user
fajrikoto
64f0080606fd497b26170ed0
Osama Mohammed Afzal
admin_assigned
2023-08-31T12:21:35.358Z
62637f3863f73be3d2f9da5b
/avatars/046c7096cf88f50f34516e7da1b18a0a.svg
Osama Mohammed Afzal
user
oafzal
64f0080606fd497b26170ed1
Samta Kamboj
admin_assigned
2023-08-31T12:21:52.255Z
64784adc5bf35e70ab5b747a
/avatars/9b3b2d12ad3e1959aacfefbb931986dd.svg
samta kamboj
user
samta-kamboj
64f0080606fd497b26170ed2
Onkar Pandit
admin_assigned
2023-08-31T12:22:06.899Z
64a6660602e46deb19ad9114
/avatars/7ecbafc435c7779769dfb1857300cbeb.svg
Onkar Pandit
user
onkarpandit-g42
64f0080606fd497b26170ed3
Rahul Pal
admin_assigned
2023-08-31T12:22:22.619Z
62f346c506b6e6f54b482a20
https://cdn-avatars.huggingface.co/v1/production/uploads/62f346c506b6e6f54b482a20/_O4wz8GpDlqCv0ZXiIngL.jpeg
Rahul Pal
user
rahulpal123
64f0080606fd497b26170ed4
Lalit Pradhan
claimed_verified
2023-09-21T07:25:42.530Z
640efae206c3b5ca883e5bce
/avatars/d911cffeade203fb620f373479a4fd06.svg
LALIT PRADHAN
user
lalitpradhan
64f0080606fd497b26170ed5
Zain Muhammad Mujahid
admin_assigned
2023-08-31T12:23:02.077Z
637e8b1b66ee00bcb2468ed0
https://cdn-avatars.huggingface.co/v1/production/uploads/1669240174964-637e8b1b66ee00bcb2468ed0.jpeg
Zain
user
zainmujahid
64f0080606fd497b26170ed6
Massa Baali
admin_assigned
2023-08-31T12:23:17.189Z
64eddc2f79845a94dd791ebc
/avatars/def0dcf448380873fc29de330b03131f.svg
Massa Baali
user
massabaali
64f0080606fd497b26170ed7
Alham Fikri Aji
admin_assigned
2023-08-31T12:23:46.933Z
61a4dc053205e107691e0d82
https://cdn-avatars.huggingface.co/v1/production/uploads/61a4dc053205e107691e0d82/BESoEHlHYXstXudh6dOdT.jpeg
Alham Fikri Aji
user
afaji
64f0080606fd497b26170ed8
Zhengzhong Liu
admin_assigned
2024-11-27T01:29:05.092Z
62fbdc67c776fd8821ae3f2d
https://cdn-avatars.huggingface.co/v1/production/uploads/62fbdc67c776fd8821ae3f2d/cI7iAZOL40RUYluo5ZVTU.png
Zhengzhong Liu
user
hunterhector
64f0080606fd497b26170ed9
Andy Hock
64f0080606fd497b26170eda
Andrew Feldman
admin_assigned
2023-08-31T12:24:17.683Z
629f97653fa7e9d614e91036
/avatars/0d901c34b21e505ff3fee16ea1ee242b.svg
Andrew Feldman
user
afeldman
64f0080606fd497b26170edb
Jonathan Lee
64f0080606fd497b26170edc
Andrew Jackson
64f0080606fd497b26170edd
Preslav Nakov
admin_assigned
2023-08-31T12:25:08.061Z
647f7eb25e1bc4753746bf9f
/avatars/cc9c6210fdc822d8a106937e747dff41.svg
Preslav Nakov
user
preslavnakov
64f0080606fd497b26170ede
Timothy Baldwin
64f0080606fd497b26170edf
Eric Xing
Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open
  Generative Large Language Models
We introduce Jais and Jais-chat, new state-of-the-art Arabic-centric
foundation and instruction-tuned open generative large language models (LLMs).
The models are based on the GPT-3 decoder-only architecture and are pretrained
on a mixture of Arabic and English texts, including source code in various
programming languages. With 13 billion parameters, they demonstrate better
knowledge and reasoning capabilities in Arabic than any existing open Arabic
and multilingual models by a sizable margin, based on extensive evaluation.
Moreover, the models are competitive in English compared to English-centric
open models of similar size, despite being trained on much less English data.
We provide a detailed description of the training, the tuning, the safety
alignment, and the evaluation of the models. We release two open versions of
the model -- the foundation Jais model, and an instruction-tuned Jais-chat
variant -- with the aim of promoting research on Arabic LLMs. Available at
https://huggingface.co/inception-mbzuai/jais-13b-chat
Jais and Jais-chat, Arabic-centric LLMs based on the GPT-3 architecture, outperform existing models in Arabic and are competitive in English with fewer resources.
GPT-3 decoder-only architecture large language models Arabic multilingual instruction-tuned safety alignment evaluation