Nemotron-4 15B Technical Report
We introduce Nemotron-4 15B, a 15-billion-parameter large multilingual
language model trained on 8 trillion text tokens. Nemotron-4 15B demonstrates
strong performance when assessed on English, multilingual, and coding tasks: it
outperforms all existing similarly-sized open models on 4 out of 7 downstream
evaluation areas and achieves competitive performance to the leading open
models in the remaining ones. Specifically, Nemotron-4 15B exhibits the best
multilingual capabilities of all similarly-sized models, even outperforming
models over four times larger and those explicitly specialized for multilingual
tasks.
65dd6be65012ec503f1bae87
Jupinder Parmar
admin_assigned
2024-02-27T10:38:03.076Z
63d2f8182727d7888cba3c93
/avatars/fa46bab692fcf20b92270ec0fff3681a.svg
Jupinder Parmar
user
jupinderp
65dd6be65012ec503f1bae88
Shrimai Prabhumoye
admin_assigned
2024-02-27T10:38:09.023Z
6470efe7fa9fd77212e17a97
/avatars/a116b279b927627eeee9c23021b6e5ee.svg
Shrimai Prabhumoye
user
shrimai
65dd6be65012ec503f1bae89
Joseph Jennings
admin_assigned
2024-02-27T10:38:16.476Z
645ad6e2d8ba048d02ad374a
/avatars/461a871387bbc0b3e117fd17dfce5430.svg
Joseph Jennings
user
jojennin
65dd6be65012ec503f1bae8a
Mostofa Patwary
admin_assigned
2024-02-27T10:38:23.518Z
630544b09d2531fabd156fd3
/avatars/7b5374244a887577834fb4524ff76d01.svg
Mostofa Patwary
user
mpatwary
65dd6be65012ec503f1bae8b
Sandeep Subramanian
admin_assigned
2024-02-27T10:38:30.421Z
627bf27cf19c5eb46d54cea8
/avatars/b8ca0b4e841858c1d234671187234f56.svg
Sandeep Subramanian
user
MaximumEntropy
65dd6be65012ec503f1bae8c
Dan Su
65dd6be65012ec503f1bae8d
Chen Zhu
65dd6be65012ec503f1bae8e
Deepak Narayanan
admin_assigned
2024-02-27T10:39:09.758Z
617af1457ced0304d1b75b89
/avatars/5fdf3b5d9b93af1a70c4a81eb18a8d19.svg
Deepak Narayanan
user
deepakn94
65dd6be65012ec503f1bae8f
Aastha Jhunjhunwala
admin_assigned
2024-02-27T10:39:15.893Z
63a1eeecf30c4642277e613e
/avatars/50d0fc6f0ce80bb8905b28e4fbe8cadb.svg
Aastha Jhunjhunwala
user
aasthaj
65dd6be65012ec503f1bae90
Ayush Dattagupta
admin_assigned
2024-02-27T10:39:22.510Z
65cc27efa994380c82ca603c
/avatars/651e2fbc272b1e8f8cd343c4c5ff6276.svg
Ayush Dattagupta
user
ayushdg95
65dd6be65012ec503f1bae91
Vibhu Jawa
claimed_verified
2024-02-27T16:08:15.225Z
646ac857086023e36edcc273
/avatars/3b6e51d9ff311bb472be98d5cdc947da.svg
Vibhu Jawa
user
VibhuJawa
65dd6be65012ec503f1bae92
Jiwei Liu
admin_assigned
2024-02-27T10:39:50.905Z
627fbbe9b846ecb5f28e6d0c
/avatars/733e198097cfa66c2300e471101735ff.svg
Jiwei Liu
user
daxiongshu
65dd6be65012ec503f1bae93
Ameya Mahabaleshwarkar
admin_assigned
2024-02-27T10:40:06.314Z
6362e35db64a5669426c4dfc
/avatars/430eafb1a5951480f7edf5735d72709e.svg
Ameya Mahabaleshwarkar
user
amahabal
65dd6be65012ec503f1bae94
Osvald Nitski
65dd6be65012ec503f1bae95
Annika Brundyn
65dd6be65012ec503f1bae96
James Maki
admin_assigned
2024-02-27T10:40:49.000Z
6556621866423b57b2ce0552
/avatars/de80b5d50ef4f84504ebc5f39c6bf147.svg
James Maki
user
jmaki
65dd6be65012ec503f1bae97
Miguel Martinez
claimed_verified
2024-02-28T08:28:16.328Z
61900ccbec759925a87f919b
/avatars/1ba5b639fb871da839d6ad7db427755a.svg
Miguel
user
miguelusque
65dd6be65012ec503f1bae98
Jiaxuan You
65dd6be65012ec503f1bae99
John Kamalu
65dd6be65012ec503f1bae9a
Patrick LeGresley
65dd6be65012ec503f1bae9b
Denys Fridman
admin_assigned
2024-02-27T10:41:40.930Z
64ff36132f27723840f0490d
/avatars/e2b559c81b1892a0e61aae5b9d08133c.svg
Denys Fridman
user
dfridman
65dd6be65012ec503f1bae9c
Jared Casper
65dd6be65012ec503f1bae9d
Ashwath Aithal
65dd6be65012ec503f1bae9e
Oleksii Kuchaiev
admin_assigned
2024-02-27T10:41:55.083Z
622937a4acd5bef90e55c49d
https://cdn-avatars.huggingface.co/v1/production/uploads/1649475932211-622937a4acd5bef90e55c49d.jpeg
Oleksii Kuchaiev
user
okuchaiev
65dd6be65012ec503f1bae9f
Mohammad Shoeybi
claimed_verified
2024-05-28T07:19:41.371Z
6641544c695975af2cbd0da6
/avatars/0ad3c18dcba585259b064fe9b00a07ce.svg
Mohammad Shoeybi
user
shoeybi
65dd6be65012ec503f1baea0
Jonathan Cohen
65dd6be65012ec503f1baea1
Bryan Catanzaro
admin_assigned
2024-02-27T10:42:34.450Z
6311021788942700629e6247
/avatars/e7adc1632b76e80e7e4a590033d1c20a.svg
Bryan Catanzaro
user
ctnzr
Nemotron-4 15B Technical Report
We introduce Nemotron-4 15B, a 15-billion-parameter large multilingual
language model trained on 8 trillion text tokens. Nemotron-4 15B demonstrates
strong performance when assessed on English, multilingual, and coding tasks: it
outperforms all existing similarly-sized open models on 4 out of 7 downstream
evaluation areas and achieves competitive performance to the leading open
models in the remaining ones. Specifically, Nemotron-4 15B exhibits the best
multilingual capabilities of all similarly-sized models, even outperforming
models over four times larger and those explicitly specialized for multilingual
tasks.
large multilingual language model downstream evaluation areas multilingual capabilities