DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via
  Reinforcement Learning
We introduce our first-generation reasoning models, DeepSeek-R1-Zero and
DeepSeek-R1. DeepSeek-R1-Zero, a model trained via large-scale reinforcement
learning (RL) without supervised fine-tuning (SFT) as a preliminary step,
demonstrates remarkable reasoning capabilities. Through RL, DeepSeek-R1-Zero
naturally emerges with numerous powerful and intriguing reasoning behaviors.
However, it encounters challenges such as poor readability, and language
mixing. To address these issues and further enhance reasoning performance, we
introduce DeepSeek-R1, which incorporates multi-stage training and cold-start
data before RL. DeepSeek-R1 achieves performance comparable to OpenAI-o1-1217
on reasoning tasks. To support the research community, we open-source
DeepSeek-R1-Zero, DeepSeek-R1, and six dense models (1.5B, 7B, 8B, 14B, 32B,
70B) distilled from DeepSeek-R1 based on Qwen and Llama.
6791b70a76d05e183a411598
DeepSeek-AI
6791b70a76d05e183a411599
Daya Guo
admin_assigned
2025-01-23T09:23:30.293Z
653df20eaa1f487614da4db1
/avatars/12b27ce2c59f53b7e464039deab36a5d.svg
Daya Guo
user
guoday
6791b70a76d05e183a41159a
Dejian Yang
admin_assigned
2025-01-23T09:23:47.465Z
6225bb44c6e650de3a65dbaa
/avatars/99c99ced2461978df572c27c1b3a4904.svg
DejianYang
user
DejianYang
6791b70a76d05e183a41159b
Haowei Zhang
6791b70a76d05e183a41159c
Junxiao Song
admin_assigned
2025-01-23T09:24:07.882Z
6565a2dd131d13ccc5d8cb12
/avatars/f5c5441ba74791b64c9740911f952bac.svg
Junxiao Song
user
haha-point
6791b70a76d05e183a41159d
Ruoyu Zhang
6791b70a76d05e183a41159e
Runxin Xu
admin_assigned
2025-01-23T09:24:44.711Z
672ddc3bf5257413d3f461a0
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/8NjMAcCHZeVWoOsUCjsto.png
XuRunXin
user
AS-7
6791b70a76d05e183a41159f
Qihao Zhu
admin_assigned
2025-01-23T09:25:09.091Z
63cd76b4374057a338e8e703
https://cdn-avatars.huggingface.co/v1/production/uploads/63cd76b4374057a338e8e703/i4Qk5-0aYx3oRhC8b50aJ.jpeg
zhuqihao
user
zqh11
6791b70a76d05e183a4115a0
Shirong Ma
admin_assigned
2025-01-23T09:25:35.617Z
6482e57a04f67f5f6056a61b
/avatars/b26faf19ba1493b91102ac7978ab3230.svg
Shirong Ma
user
msr2000
6791b70a76d05e183a4115a1
Peiyi Wang
admin_assigned
2025-01-23T09:25:43.509Z
656873f33fd0bf1f82558695
/avatars/7a085da2e2a91d7f41988501a573ebf9.svg
PEIYI, WANG
user
peiyiwang89
6791b70a76d05e183a4115a2
Xiao Bi
6791b70a76d05e183a4115a3
Xiaokang Zhang
6791b70a76d05e183a4115a4
Xingkai Yu
6791b70a76d05e183a4115a5
Yu Wu
6791b70a76d05e183a4115a6
Z. F. Wu
6791b70a76d05e183a4115a7
Zhibin Gou
admin_assigned
2025-01-23T09:26:37.876Z
62dcf5d4169bd1d2ef2ca724
https://cdn-avatars.huggingface.co/v1/production/uploads/62dcf5d4169bd1d2ef2ca724/oRFFmJDJTLYtPRVPCweQ_.jpeg
Zhibin Gou
user
zubingou
6791b70a76d05e183a4115a8
Zhihong Shao
admin_assigned
2025-01-23T09:26:51.359Z
65db64f8b62d242ed8711701
/avatars/753e9f980eb6786c6b53b2f1becbf745.svg
Zhihong Shao
user
ZhihongShao
6791b70a76d05e183a4115a9
Zhuoshu Li
6791b70a76d05e183a4115aa
Ziyi Gao
6791b70a76d05e183a4115ab
Aixin Liu
6791b70a76d05e183a4115ac
Bing Xue
6791b70a76d05e183a4115ad
Bingxuan Wang
admin_assigned
2025-01-23T09:27:32.553Z
6523d81d56fe05f216a559f6
/avatars/07fcf56b5b8a0b64c31bdfe8fbf41cc6.svg
Bingxuan Wang
user
YellowDoge
6791b70a76d05e183a4115ae
Bochao Wu
6791b70a76d05e183a4115af
Bei Feng
6791b70a76d05e183a4115b0
Chengda Lu
6791b70a76d05e183a4115b1
Chenggang Zhao
admin_assigned
2025-01-23T09:28:10.434Z
66053b1f9e3555d648b21c3d
/avatars/c8b33e7f702c4edb17add47f0eafe5e6.svg
Chenggang Zhao
user
LyricZ
6791b70a76d05e183a4115b2
Chengqi Deng
6791b70a76d05e183a4115b3
Chenyu Zhang
6791b70a76d05e183a4115b4
Chong Ruan
admin_assigned
2025-01-23T09:28:32.927Z
6398203609f12714ed1935c2
https://cdn-avatars.huggingface.co/v1/production/uploads/6398203609f12714ed1935c2/uXgl0LgKnFYjq1Wz39-a6.jpeg
Chong Ruan
user
Chester111
6791b70a76d05e183a4115b5
Damai Dai
admin_assigned
2025-01-23T09:28:49.991Z
659389f8de82e1ef7b9a8b13
/avatars/896ed9f4cdbd317493b303d070b7e12a.svg
Damai Dai
user
DeepSeekDDM
6791b70a76d05e183a4115b6
Deli Chen
6791b70a76d05e183a4115b7
Dongjie Ji
admin_assigned
2025-01-23T09:29:12.901Z
65fce397fdc5e8ee7d07ee3b
/avatars/35edef17ecce02939df1e7fdd19b87c8.svg
Dong Jiejie
user
Dj12138
6791b70a76d05e183a4115b8
Erhang Li
6791b70a76d05e183a4115b9
Fangyun Lin
6791b70a76d05e183a4115ba
Fucong Dai
6791b70a76d05e183a4115bb
Fuli Luo
admin_assigned
2025-01-23T09:29:55.378Z
6538815d1bdb3c40db94fbfa
https://cdn-avatars.huggingface.co/v1/production/uploads/6538815d1bdb3c40db94fbfa/id7aSY8JUgKK2agKWLERt.jpeg
Fuli Luo
user
luofuli
6791b70a76d05e183a4115bc
Guangbo Hao
6791b70a76d05e183a4115bd
Guanting Chen
6791b70a76d05e183a4115be
Guowei Li
6791b70a76d05e183a4115bf
H. Zhang
6791b70a76d05e183a4115c0
Han Bao
6791b70a76d05e183a4115c1
Hanwei Xu
6791b70a76d05e183a4115c2
Haocheng Wang
6791b70a76d05e183a4115c3
Honghui Ding
admin_assigned
2025-01-23T09:30:55.666Z
65a5d3d203ed327234be0d3e
/avatars/7a579207214741c4374c3051c7a1f19f.svg
Honghui Ding
user
honghuiding
6791b70a76d05e183a4115c4
Huajian Xin
admin_assigned
2025-01-23T09:31:02.989Z
6532a060a78e70d19c669103
/avatars/3cc9309b0e31da0fb83f1c3ef87dbe9f.svg
HuajianXin
user
HuajianXin
6791b70a76d05e183a4115c5
Huazuo Gao
admin_assigned
2025-01-23T09:31:09.943Z
64e370be59aa5366642ac329
/avatars/0fa1eb6ac6c1aeff3e65bc86a6617f64.svg
Huazuo Gao
user
gaohuazuo
6791b70a76d05e183a4115c6
Hui Qu
6791b70a76d05e183a4115c7
Hui Li
6791b70a76d05e183a4115c8
Jianzhong Guo
6791b70a76d05e183a4115c9
Jiashi Li
admin_assigned
2025-01-23T09:31:28.452Z
64fca5f28d50404bc42ca78a
/avatars/ae01ac0296d6ce1277dacb6894f570b8.svg
Jiashi Li
user
Beginlner
6791b70a76d05e183a4115ca
Jiawei Wang
claimed_verified
2025-03-27T14:26:33.045Z
64060b49a577649430bf6974
/avatars/74d0d6ed656b593e4c101b09edf18c7a.svg
Jiawei Wang
user
Jarvis1111
6791b70a76d05e183a4115cb
Jingchang Chen
6791b70a76d05e183a4115cc
Jingyang Yuan
6791b70a76d05e183a4115cd
Junjie Qiu
6791b70a76d05e183a4115ce
Junlong Li
admin_assigned
2025-01-23T09:32:44.002Z
621e40ac944c7e36aaec2369
https://cdn-avatars.huggingface.co/v1/production/uploads/621e40ac944c7e36aaec2369/Yj-FJRWps3rvsS_B2bnKo.jpeg
Junlong Li
user
lockon
6791b70a76d05e183a4115cf
J. L. Cai
6791b70a76d05e183a4115d0
Jiaqi Ni
6791b70a76d05e183a4115d1
Jian Liang
6791b70a76d05e183a4115d2
Jin Chen
6791b70a76d05e183a4115d3
Kai Dong
6791b70a76d05e183a4115d4
Kai Hu
6791b70a76d05e183a4115d5
Kaige Gao
6791b70a76d05e183a4115d6
Kang Guan
6791b70a76d05e183a4115d7
Kexin Huang
6791b70a76d05e183a4115d8
Kuai Yu
6791b70a76d05e183a4115d9
Lean Wang
6791b70a76d05e183a4115da
Lecong Zhang
6791b70a76d05e183a4115db
Liang Zhao
6791b70a76d05e183a4115dc
Litong Wang
6791b70a76d05e183a4115dd
Liyue Zhang
admin_assigned
2025-01-23T09:32:51.322Z
67367647517b82b436d74930
/avatars/34c1f894a3da9f38816d0b30bfdc6d50.svg
Liyue Zhang
user
Lyriccc
6791b70a76d05e183a4115de
Lei Xu
6791b70a76d05e183a4115df
Leyi Xia
6791b70a76d05e183a4115e0
Mingchuan Zhang
6791b70a76d05e183a4115e1
Minghua Zhang
6791b70a76d05e183a4115e2
Minghui Tang
admin_assigned
2025-01-23T09:33:01.949Z
64ad1b6e616d3eb36149d38d
/avatars/54d0d104ba430f65c04b5259a6423940.svg
Minghui Tang
user
weicfd
6791b70a76d05e183a4115e3
Meng Li
6791b70a76d05e183a4115e4
Miaojun Wang
6791b70a76d05e183a4115e5
Mingming Li
6791b70a76d05e183a4115e6
Ning Tian
6791b70a76d05e183a4115e7
Panpan Huang
6791b70a76d05e183a4115e8
Peng Zhang
6791b70a76d05e183a4115e9
Qiancheng Wang
6791b70a76d05e183a4115ea
Qinyu Chen
6791b70a76d05e183a4115eb
Qiushi Du
6791b70a76d05e183a4115ec
Ruiqi Ge
6791b70a76d05e183a4115ed
Ruisong Zhang
6791b70a76d05e183a4115ee
Ruizhe Pan
6791b70a76d05e183a4115ef
Runji Wang
6791b70a76d05e183a4115f0
R. J. Chen
6791b70a76d05e183a4115f1
R. L. Jin
6791b70a76d05e183a4115f2
Ruyi Chen
6791b70a76d05e183a4115f3
Shanghao Lu
6791b70a76d05e183a4115f4
Shangyan Zhou
6791b70a76d05e183a4115f5
Shanhuang Chen
6791b70a76d05e183a4115f6
Shengfeng Ye
6791b70a76d05e183a4115f7
Shiyu Wang
6791b70a76d05e183a4115f8
Shuiping Yu
6791b70a76d05e183a4115f9
Shunfeng Zhou
6791b70a76d05e183a4115fa
Shuting Pan
6791b70a76d05e183a4115fb
S. S. Li
6791b70a76d05e183a4115fc
Shuang Zhou
6791b70a76d05e183a4115fd
Shaoqing Wu
6791b70a76d05e183a4115fe
Shengfeng Ye
6791b70a76d05e183a4115ff
Tao Yun
6791b70a76d05e183a411600
Tian Pei
6791b70a76d05e183a411601
Tianyu Sun
6791b70a76d05e183a411602
T. Wang
6791b70a76d05e183a411603
Wangding Zeng
6791b70a76d05e183a411604
Wanjia Zhao
6791b70a76d05e183a411605
Wen Liu
claimed_verified
2025-02-05T10:15:38.719Z
63198e8802fb322037332f2d
/avatars/d3f9c206e387df35beb0ed0ef1cdf865.svg
Wen Liu
user
doubility123
6791b70a76d05e183a411606
Wenfeng Liang
6791b70a76d05e183a411607
Wenjun Gao
6791b70a76d05e183a411608
Wenqin Yu
6791b70a76d05e183a411609
Wentao Zhang
6791b70a76d05e183a41160a
W. L. Xiao
6791b70a76d05e183a41160b
Wei An
6791b70a76d05e183a41160c
Xiaodong Liu
6791b70a76d05e183a41160d
Xiaohan Wang
6791b70a76d05e183a41160e
Xiaokang Chen
claimed_verified
2025-02-05T15:55:47.839Z
6635e701420baf7bc3f93561
/avatars/cdbb3085fee73ac520888977e2c575ea.svg
Xiaokang Chen
user
CharlesCXK
6791b70a76d05e183a41160f
Xiaotao Nie
6791b70a76d05e183a411610
Xin Cheng
6791b70a76d05e183a411611
Xin Liu
6791b70a76d05e183a411612
Xin Xie
6791b70a76d05e183a411613
Xingchao Liu
6791b70a76d05e183a411614
Xinyu Yang
6791b70a76d05e183a411615
Xinyuan Li
6791b70a76d05e183a411616
Xuecheng Su
6791b70a76d05e183a411617
Xuheng Lin
6791b70a76d05e183a411618
X. Q. Li
6791b70a76d05e183a411619
Xiangyue Jin
6791b70a76d05e183a41161a
Xiaojin Shen
6791b70a76d05e183a41161b
Xiaosha Chen
6791b70a76d05e183a41161c
Xiaowen Sun
6791b70a76d05e183a41161d
Xiaoxiang Wang
6791b70a76d05e183a41161e
Xinnan Song
6791b70a76d05e183a41161f
Xinyi Zhou
6791b70a76d05e183a411620
Xianzu Wang
6791b70a76d05e183a411621
Xinxia Shan
6791b70a76d05e183a411622
Y. K. Li
6791b70a76d05e183a411623
Y. Q. Wang
6791b70a76d05e183a411624
Y. X. Wei
6791b70a76d05e183a411625
Yang Zhang
6791b70a76d05e183a411626
Yanhong Xu
6791b70a76d05e183a411627
Yao Li
6791b70a76d05e183a411628
Yao Zhao
6791b70a76d05e183a411629
Yaofeng Sun
6791b70a76d05e183a41162a
Yaohui Wang
6791b70a76d05e183a41162b
Yi Yu
6791b70a76d05e183a41162c
Yichao Zhang
6791b70a76d05e183a41162d
Yifan Shi
6791b70a76d05e183a41162e
Yiliang Xiong
6791b70a76d05e183a41162f
Ying He
6791b70a76d05e183a411630
Yishi Piao
6791b70a76d05e183a411631
Yisong Wang
6791b70a76d05e183a411632
Yixuan Tan
6791b70a76d05e183a411633
Yiyang Ma
6791b70a76d05e183a411634
Yiyuan Liu
6791b70a76d05e183a411635
Yongqiang Guo
6791b70a76d05e183a411636
Yuan Ou
6791b70a76d05e183a411637
Yuduan Wang
6791b70a76d05e183a411638
Yue Gong
6791b70a76d05e183a411639
Yuheng Zou
6791b70a76d05e183a41163a
Yujia He
6791b70a76d05e183a41163b
Yunfan Xiong
6791b70a76d05e183a41163c
Yuxiang Luo
6791b70a76d05e183a41163d
Yuxiang You
6791b70a76d05e183a41163e
Yuxuan Liu
6791b70a76d05e183a41163f
Yuyang Zhou
6791b70a76d05e183a411640
Y. X. Zhu
6791b70a76d05e183a411641
Yanhong Xu
6791b70a76d05e183a411642
Yanping Huang
6791b70a76d05e183a411643
Yaohui Li
6791b70a76d05e183a411644
Yi Zheng
6791b70a76d05e183a411645
Yuchen Zhu
6791b70a76d05e183a411646
Yunxian Ma
6791b70a76d05e183a411647
Ying Tang
6791b70a76d05e183a411648
Yukun Zha
6791b70a76d05e183a411649
Yuting Yan
6791b70a76d05e183a41164a
Z. Z. Ren
6791b70a76d05e183a41164b
Zehui Ren
6791b70a76d05e183a41164c
Zhangli Sha
6791b70a76d05e183a41164d
Zhe Fu
6791b70a76d05e183a41164e
Zhean Xu
6791b70a76d05e183a41164f
Zhenda Xie
6791b70a76d05e183a411650
Zhengyan Zhang
6791b70a76d05e183a411651
Zhewen Hao
6791b70a76d05e183a411652
Zhicheng Ma
6791b70a76d05e183a411653
Zhigang Yan
6791b70a76d05e183a411654
Zhiyu Wu
6791b70a76d05e183a411655
Zihui Gu
6791b70a76d05e183a411656
Zijia Zhu
6791b70a76d05e183a411657
Zijun Liu
claimed_verified
2025-01-27T10:43:24.441Z
6468c76bff18750165a64df3
https://cdn-avatars.huggingface.co/v1/production/uploads/6468c76bff18750165a64df3/dHhE62SHOSJZjyU60vgh7.jpeg
Zijun Liu
user
BBQGOD
6791b70a76d05e183a411658
Zilin Li
6791b70a76d05e183a411659
Ziwei Xie
6791b70a76d05e183a41165a
Ziyang Song
6791b70a76d05e183a41165b
Zizheng Pan
6791b70a76d05e183a41165c
Zhen Huang
6791b70a76d05e183a41165d
Zhipeng Xu
6791b70a76d05e183a41165e
Zhongyu Zhang
6791b70a76d05e183a41165f
Zhen Zhang
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via
  Reinforcement Learning
We introduce our first-generation reasoning models, DeepSeek-R1-Zero and
DeepSeek-R1. DeepSeek-R1-Zero, a model trained via large-scale reinforcement
learning (RL) without supervised fine-tuning (SFT) as a preliminary step,
demonstrates remarkable reasoning capabilities. Through RL, DeepSeek-R1-Zero
naturally emerges with numerous powerful and intriguing reasoning behaviors.
However, it encounters challenges such as poor readability, and language
mixing. To address these issues and further enhance reasoning performance, we
introduce DeepSeek-R1, which incorporates multi-stage training and cold-start
data before RL. DeepSeek-R1 achieves performance comparable to OpenAI-o1-1217
on reasoning tasks. To support the research community, we open-source
DeepSeek-R1-Zero, DeepSeek-R1, and six dense models (1.5B, 7B, 8B, 14B, 32B,
70B) distilled from DeepSeek-R1 based on Qwen and Llama.
DeepSeek-R1-Zero and DeepSeek-R1 utilize reinforcement learning and multi-stage training to enhance reasoning capabilities, with DeepSeek-R1 achieving performance comparable to OpenAI-o1-1217.
reinforcement learning multi-stage training cold-start data Qwen Llama