A Survey of Reinforcement Learning for Large Reasoning Models
In this paper, we survey recent advances in Reinforcement Learning (RL) for
reasoning with Large Language Models (LLMs). RL has achieved remarkable success
in advancing the frontier of LLM capabilities, particularly in addressing
complex logical tasks such as mathematics and coding. As a result, RL has
emerged as a foundational methodology for transforming LLMs into LRMs. With the
rapid progress of the field, further scaling of RL for LRMs now faces
foundational challenges not only in computational resources but also in
algorithm design, training data, and infrastructure. To this end, it is timely
to revisit the development of this domain, reassess its trajectory, and explore
strategies to enhance the scalability of RL toward Artificial SuperIntelligence
(ASI). In particular, we examine research applying RL to LLMs and LRMs for
reasoning abilities, especially since the release of DeepSeek-R1, including
foundational components, core problems, training resources, and downstream
applications, to identify future opportunities and directions for this rapidly
evolving area. We hope this review will promote future research on RL for
broader reasoning models. Github:
https://github.com/TsinghuaC3I/Awesome-RL-for-LRMs
68c228e829b8ec9932cd08ca
Kaiyan Zhang
claimed_verified
2025-09-12T16:14:27.714Z
60bc94cd85a3ab33829b6211
/avatars/b57d36c7577fbbb42ea5b963eef4144a.svg
Kaiyan Zhang
user
iseesaw
68c228e829b8ec9932cd08cb
Yuxin Zuo
claimed_verified
2025-09-12T16:14:31.659Z
622474f38dc6b0b64f5e903d
/avatars/d6b60a014277a8ec7d564163c5f644aa.svg
Yuxin Zuo
user
yuxinzuo
68c228e829b8ec9932cd08cc
Bingxiang He
68c228e829b8ec9932cd08cd
Youbang Sun
claimed_verified
2025-09-12T16:14:24.566Z
679ce8c048ebd7903d76a832
/avatars/5f3fecaacfee6e2d5a72dd19fe87055a.svg
Youbang Sun
user
Youbang
68c228e829b8ec9932cd08ce
Runze Liu
claimed_verified
2025-09-12T16:14:20.852Z
667187ba9ab144eb3ac43a1b
/avatars/db5558aa1c5160b9aee8b58573271959.svg
Runze Liu
user
RyanLiu112
68c228e829b8ec9932cd08cf
Che Jiang
68c228e829b8ec9932cd08d0
Yuchen Fan
claimed_verified
2025-09-12T16:14:17.945Z
672c2d7816766a76a747b7b5
/avatars/12c7b26d2b81721ccac3a5c71e32a1a1.svg
Yuchen Fan
user
yuchenFan
68c228e829b8ec9932cd08d1
Kai Tian
68c228e829b8ec9932cd08d2
Guoli Jia
68c228e829b8ec9932cd08d3
Pengfei Li
68c228e829b8ec9932cd08d4
Yu Fu
68c228e829b8ec9932cd08d5
Xingtai Lv
68c228e829b8ec9932cd08d6
Yuchen Zhang
68c228e829b8ec9932cd08d7
Sihang Zeng
68c228e829b8ec9932cd08d8
Shang Qu
68c228e829b8ec9932cd08d9
Haozhan Li
68c228e829b8ec9932cd08da
Shijie Wang
68c228e829b8ec9932cd08db
Yuru Wang
68c228e829b8ec9932cd08dc
Xinwei Long
68c228e829b8ec9932cd08dd
Fangfu Liu
68c228e829b8ec9932cd08de
Xiang Xu
68c228e829b8ec9932cd08df
Jiaze Ma
68c228e829b8ec9932cd08e0
Xuekai Zhu
claimed_verified
2025-09-19T06:50:39.837Z
647ffddeb82adfa7cc1a10d9
/avatars/26aa168d6b2068298ebb16584aa52b6c.svg
zhu
user
xuekai
68c228e829b8ec9932cd08e1
Ermo Hua
68c228e829b8ec9932cd08e2
Yihao Liu
68c228e829b8ec9932cd08e3
Zonglin Li
68c228e829b8ec9932cd08e4
Huayu Chen
68c228e829b8ec9932cd08e5
Xiaoye Qu
68c228e829b8ec9932cd08e6
Yafu Li
68c228e829b8ec9932cd08e7
Weize Chen
68c228e829b8ec9932cd08e8
Zhenzhao Yuan
68c228e829b8ec9932cd08e9
Junqi Gao
68c228e829b8ec9932cd08ea
Dong Li
68c228e829b8ec9932cd08eb
Zhiyuan Ma
68c228e829b8ec9932cd08ec
Ganqu Cui
68c228e829b8ec9932cd08ed
Zhiyuan Liu
68c228e829b8ec9932cd08ee
Biqing Qi
68c228e829b8ec9932cd08ef
Ning Ding
claimed_verified
2025-09-13T14:56:31.179Z
60cf4bcb1ce3775ebb86e5d5
/avatars/12bcd18d215abf91f297f93007733148.svg
Ning Ding
user
stingning
68c228e829b8ec9932cd08f0
Bowen Zhou
A Survey of Reinforcement Learning for Large Reasoning Models
In this paper, we survey recent advances in Reinforcement Learning (RL) for
reasoning with Large Language Models (LLMs). RL has achieved remarkable success
in advancing the frontier of LLM capabilities, particularly in addressing
complex logical tasks such as mathematics and coding. As a result, RL has
emerged as a foundational methodology for transforming LLMs into LRMs. With the
rapid progress of the field, further scaling of RL for LRMs now faces
foundational challenges not only in computational resources but also in
algorithm design, training data, and infrastructure. To this end, it is timely
to revisit the development of this domain, reassess its trajectory, and explore
strategies to enhance the scalability of RL toward Artificial SuperIntelligence
(ASI). In particular, we examine research applying RL to LLMs and LRMs for
reasoning abilities, especially since the release of DeepSeek-R1, including
foundational components, core problems, training resources, and downstream
applications, to identify future opportunities and directions for this rapidly
evolving area. We hope this review will promote future research on RL for
broader reasoning models. Github:
https://github.com/TsinghuaC3I/Awesome-RL-for-LRMs
Reinforcement Learning enhances Large Language Models for complex reasoning tasks, facing challenges in scalability and infrastructure as the field advances.
Reinforcement Learning Large Language Models LRMs DeepSeek-R1 Artificial SuperIntelligence