DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code
  Intelligence
We present DeepSeek-Coder-V2, an open-source Mixture-of-Experts (MoE) code
language model that achieves performance comparable to GPT4-Turbo in
code-specific tasks. Specifically, DeepSeek-Coder-V2 is further pre-trained
from an intermediate checkpoint of DeepSeek-V2 with additional 6 trillion
tokens. Through this continued pre-training, DeepSeek-Coder-V2 substantially
enhances the coding and mathematical reasoning capabilities of DeepSeek-V2,
while maintaining comparable performance in general language tasks. Compared to
DeepSeek-Coder-33B, DeepSeek-Coder-V2 demonstrates significant advancements in
various aspects of code-related tasks, as well as reasoning and general
capabilities. Additionally, DeepSeek-Coder-V2 expands its support for
programming languages from 86 to 338, while extending the context length from
16K to 128K. In standard benchmark evaluations, DeepSeek-Coder-V2 achieves
superior performance compared to closed-source models such as GPT4-Turbo,
Claude 3 Opus, and Gemini 1.5 Pro in coding and math benchmarks.
66724bb98b5e22ce4f66df3e
DeepSeek-AI
66724bb98b5e22ce4f66df3f
Qihao Zhu
admin_assigned
2024-06-19T08:26:08.420Z
63cd76b4374057a338e8e703
https://cdn-avatars.huggingface.co/v1/production/uploads/63cd76b4374057a338e8e703/i4Qk5-0aYx3oRhC8b50aJ.jpeg
zhuqihao
user
zqh11
66724bb98b5e22ce4f66df40
Daya Guo
admin_assigned
2024-06-19T08:26:15.136Z
653df20eaa1f487614da4db1
/avatars/12b27ce2c59f53b7e464039deab36a5d.svg
Daya Guo
user
guoday
66724bb98b5e22ce4f66df41
Zhihong Shao
admin_assigned
2024-06-19T08:26:29.442Z
65db64f8b62d242ed8711701
/avatars/753e9f980eb6786c6b53b2f1becbf745.svg
Zhihong Shao
user
ZhihongShao
66724bb98b5e22ce4f66df42
Dejian Yang
admin_assigned
2024-06-19T08:26:41.738Z
6225bb44c6e650de3a65dbaa
/avatars/99c99ced2461978df572c27c1b3a4904.svg
DejianYang
user
DejianYang
66724bb98b5e22ce4f66df43
Peiyi Wang
admin_assigned
2024-06-19T08:26:48.355Z
656873f33fd0bf1f82558695
/avatars/7a085da2e2a91d7f41988501a573ebf9.svg
PEIYI, WANG
user
peiyiwang89
66724bb98b5e22ce4f66df44
Runxin Xu
66724bb98b5e22ce4f66df45
Y. Wu
claimed_verified
2024-06-19T20:20:49.778Z
640556390ab5e22719fc65c8
/avatars/c1814c42ee5fdcc926f841881936f618.svg
Yu Wu
user
wumark
66724bb98b5e22ce4f66df46
Yukun Li
admin_assigned
2024-06-19T08:27:08.329Z
664c65145312449198fb79a8
/avatars/b2524700c4fe02c8fbcabdd0b4a0f587.svg
yukun li
user
imli
66724bb98b5e22ce4f66df47
Huazuo Gao
admin_assigned
2024-06-19T08:27:14.990Z
64e370be59aa5366642ac329
/avatars/0fa1eb6ac6c1aeff3e65bc86a6617f64.svg
Huazuo Gao
user
gaohuazuo
66724bb98b5e22ce4f66df48
Shirong Ma
admin_assigned
2024-06-19T08:27:32.842Z
6482e57a04f67f5f6056a61b
/avatars/b26faf19ba1493b91102ac7978ab3230.svg
Shirong Ma
user
msr2000
66724bb98b5e22ce4f66df49
Wangding Zeng
admin_assigned
2024-06-19T08:27:39.188Z
659384dec0b1372b2e3c184d
/avatars/fdbff8012fe80d5f2e861cbfa2675125.svg
wangding zeng
user
zwd973-deepseek
66724bb98b5e22ce4f66df4a
Xiao Bi
66724bb98b5e22ce4f66df4b
Zihui Gu
66724bb98b5e22ce4f66df4c
Hanwei Xu
66724bb98b5e22ce4f66df4d
Damai Dai
admin_assigned
2024-06-19T08:28:06.857Z
659389f8de82e1ef7b9a8b13
/avatars/896ed9f4cdbd317493b303d070b7e12a.svg
Damai Dai
user
DeepSeekDDM
66724bb98b5e22ce4f66df4e
Kai Dong
66724bb98b5e22ce4f66df4f
Liyue Zhang
66724bb98b5e22ce4f66df50
Yishi Piao
66724bb98b5e22ce4f66df51
Zhibin Gou
claimed_verified
2024-06-19T07:38:03.852Z
62dcf5d4169bd1d2ef2ca724
https://cdn-avatars.huggingface.co/v1/production/uploads/62dcf5d4169bd1d2ef2ca724/oRFFmJDJTLYtPRVPCweQ_.jpeg
Zhibin Gou
user
zubingou
66724bb98b5e22ce4f66df52
Zhenda Xie
admin_assigned
2024-06-19T08:28:37.958Z
6539f6ea26df26ecd1393c37
https://cdn-avatars.huggingface.co/v1/production/uploads/6539f6ea26df26ecd1393c37/9VJusLLAiLhUxfBAFggpF.jpeg
Zhenda Xie
user
zdaxie
66724bb98b5e22ce4f66df53
Zhewen Hao
66724bb98b5e22ce4f66df54
Bingxuan Wang
admin_assigned
2024-06-19T08:28:51.550Z
6523d81d56fe05f216a559f6
/avatars/07fcf56b5b8a0b64c31bdfe8fbf41cc6.svg
Bingxuan Wang
user
YellowDoge
66724bb98b5e22ce4f66df55
Junxiao Song
admin_assigned
2024-06-19T08:28:58.526Z
6565a2dd131d13ccc5d8cb12
/avatars/f5c5441ba74791b64c9740911f952bac.svg
Junxiao Song
user
haha-point
66724bb98b5e22ce4f66df56
Deli Chen
admin_assigned
2024-06-19T08:29:05.063Z
64ec0b6307987950ae738083
/avatars/e131cd22b55e4b62cc48779e512c3da1.svg
deli chen
user
deli96
66724bb98b5e22ce4f66df57
Xin Xie
66724bb98b5e22ce4f66df58
Kang Guan
66724bb98b5e22ce4f66df59
Yuxiang You
66724bb98b5e22ce4f66df5a
Aixin Liu
66724bb98b5e22ce4f66df5b
Qiushi Du
66724bb98b5e22ce4f66df5c
Wenjun Gao
claimed_verified
2025-10-11T14:15:18.407Z
64b00c802307fd350a9e0f6f
/avatars/2856f6768793ca1ef74582a68cebfc55.svg
gao
user
wenjun007
66724bb98b5e22ce4f66df5d
Xuan Lu
66724bb98b5e22ce4f66df5e
Qinyu Chen
66724bb98b5e22ce4f66df5f
Yaohui Wang
66724bb98b5e22ce4f66df60
Chengqi Deng
66724bb98b5e22ce4f66df61
Jiashi Li
admin_assigned
2024-06-19T08:29:13.424Z
64fca5f28d50404bc42ca78a
/avatars/ae01ac0296d6ce1277dacb6894f570b8.svg
Jiashi Li
user
Beginlner
66724bb98b5e22ce4f66df62
Chenggang Zhao
66724bb98b5e22ce4f66df63
Chong Ruan
claimed_verified
2024-08-17T05:38:42.320Z
6398203609f12714ed1935c2
https://cdn-avatars.huggingface.co/v1/production/uploads/6398203609f12714ed1935c2/uXgl0LgKnFYjq1Wz39-a6.jpeg
Chong Ruan
user
Chester111
66724bb98b5e22ce4f66df64
Fuli Luo
66724bb98b5e22ce4f66df65
Wenfeng Liang
DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code
  Intelligence
We present DeepSeek-Coder-V2, an open-source Mixture-of-Experts (MoE) code
language model that achieves performance comparable to GPT4-Turbo in
code-specific tasks. Specifically, DeepSeek-Coder-V2 is further pre-trained
from an intermediate checkpoint of DeepSeek-V2 with additional 6 trillion
tokens. Through this continued pre-training, DeepSeek-Coder-V2 substantially
enhances the coding and mathematical reasoning capabilities of DeepSeek-V2,
while maintaining comparable performance in general language tasks. Compared to
DeepSeek-Coder-33B, DeepSeek-Coder-V2 demonstrates significant advancements in
various aspects of code-related tasks, as well as reasoning and general
capabilities. Additionally, DeepSeek-Coder-V2 expands its support for
programming languages from 86 to 338, while extending the context length from
16K to 128K. In standard benchmark evaluations, DeepSeek-Coder-V2 achieves
superior performance compared to closed-source models such as GPT4-Turbo,
Claude 3 Opus, and Gemini 1.5 Pro in coding and math benchmarks.
DeepSeek-Coder-V2, a Mixture-of-Experts language model, excels in code-specific tasks by enhancing coding and mathematical reasoning capabilities while expanding language support and context length.
Mixture-of-Experts DeepSeek-Coder DeepSeek-V2 coding tasks mathematical reasoning general language tasks programming languages context length coding benchmarks math benchmarks