Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain
  Perspective
Reinforcement learning (RL) has emerged as a promising approach to improve
large language model (LLM) reasoning, yet most open efforts focus narrowly on
math and code, limiting our understanding of its broader applicability to
general reasoning. A key challenge lies in the lack of reliable, scalable RL
reward signals across diverse reasoning domains. We introduce Guru, a curated
RL reasoning corpus of 92K verifiable examples spanning six reasoning
domains--Math, Code, Science, Logic, Simulation, and Tabular--each built
through domain-specific reward design, deduplication, and filtering to ensure
reliability and effectiveness for RL training. Based on Guru, we systematically
revisit established findings in RL for LLM reasoning and observe significant
variation across domains. For example, while prior work suggests that RL
primarily elicits existing knowledge from pretrained models, our results reveal
a more nuanced pattern: domains frequently seen during pretraining (Math, Code,
Science) easily benefit from cross-domain RL training, while domains with
limited pretraining exposure (Logic, Simulation, and Tabular) require in-domain
training to achieve meaningful performance gains, suggesting that RL is likely
to facilitate genuine skill acquisition. Finally, we present Guru-7B and
Guru-32B, two models that achieve state-of-the-art performance among open
models RL-trained with publicly available data, outperforming best baselines by
7.9% and 6.7% on our 17-task evaluation suite across six reasoning domains. We
also show that our models effectively improve the Pass@k performance of their
base models, particularly on complex tasks less likely to appear in pretraining
data. We release data, models, training and evaluation code to facilitate
general-purpose reasoning at: https://github.com/LLM360/Reasoning360
68538be099bf39f9665c79b9
Zhoujun Cheng
68538be099bf39f9665c79ba
Shibo Hao
68538be099bf39f9665c79bb
Tianyang Liu
claimed_verified
2025-06-20T12:19:48.511Z
629e2bcc46b4826be2c57fe3
https://cdn-avatars.huggingface.co/v1/production/uploads/629e2bcc46b4826be2c57fe3/41BiA52XlZi31ABsljFiq.jpeg
Tianyang Liu
user
tianyang
68538be099bf39f9665c79bc
Fan Zhou
claimed_verified
2025-06-20T12:19:46.579Z
628f6e5ab90dde28ef57d293
https://cdn-avatars.huggingface.co/v1/production/uploads/628f6e5ab90dde28ef57d293/AxNzR2nvrND6Rf3RPkYMk.jpeg
Fan Zhou
user
koalazf99
68538be099bf39f9665c79bd
Yutao Xie
68538be099bf39f9665c79be
Feng Yao
claimed_verified
2025-06-20T12:19:50.740Z
64c8b2c5c547ed5243e14a6e
/avatars/96d4a9010f96001c8cff235915926390.svg
Feng Yao
user
fengyao1909
68538be099bf39f9665c79bf
Yuexin Bian
68538be099bf39f9665c79c0
Yonghao Zhuang
68538be099bf39f9665c79c1
Nilabjo Dey
68538be099bf39f9665c79c2
Yuheng Zha
68538be099bf39f9665c79c3
Yi Gu
68538be099bf39f9665c79c4
Kun Zhou
68538be099bf39f9665c79c5
Yuqi Wang
68538be099bf39f9665c79c6
Yuan Li
claimed_verified
2025-06-23T08:17:20.373Z
65a55718680cb2eb94473619
https://cdn-avatars.huggingface.co/v1/production/uploads/65a55718680cb2eb94473619/wtywmAsTLpvdXgq3sFtQL.jpeg
Yuan Li
user
realYuanLi
68538be099bf39f9665c79c7
Richard Fan
68538be099bf39f9665c79c8
Jianshu She
claimed_verified
2025-06-23T08:17:24.551Z
659d3b57e520cf08924a42d5
https://cdn-avatars.huggingface.co/v1/production/uploads/659d3b57e520cf08924a42d5/EAyB9aq8RSNSv1Cfgalxi.jpeg
Jianshu She
user
Jianshu001
68538be099bf39f9665c79c9
Chengqian Gao
68538be099bf39f9665c79ca
Abulhair Saparov
68538be099bf39f9665c79cb
Haonan Li
68538be099bf39f9665c79cc
Taylor W. Killian
claimed_verified
2025-06-23T08:17:18.012Z
66624cec580bb3ee34c52049
https://cdn-avatars.huggingface.co/v1/production/uploads/66624cec580bb3ee34c52049/Ju5dmLw7ZellMJoEWIENm.jpeg
Taylor W. Killian
user
twkillian
68538be099bf39f9665c79cd
Mikhail Yurochkin
claimed_verified
2025-06-23T08:17:22.389Z
6552e5121c6e798ec0d3d52c
https://cdn-avatars.huggingface.co/v1/production/uploads/6552e5121c6e798ec0d3d52c/y30R447PkY2F1_T4HuyMp.jpeg
Mikhail Yurochkin
user
moonfolk
68538be099bf39f9665c79ce
Zhengzhong Liu
68538be099bf39f9665c79cf
Eric P. Xing
68538be099bf39f9665c79d0
Zhiting Hu
Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain
  Perspective
Reinforcement learning (RL) has emerged as a promising approach to improve
large language model (LLM) reasoning, yet most open efforts focus narrowly on
math and code, limiting our understanding of its broader applicability to
general reasoning. A key challenge lies in the lack of reliable, scalable RL
reward signals across diverse reasoning domains. We introduce Guru, a curated
RL reasoning corpus of 92K verifiable examples spanning six reasoning
domains--Math, Code, Science, Logic, Simulation, and Tabular--each built
through domain-specific reward design, deduplication, and filtering to ensure
reliability and effectiveness for RL training. Based on Guru, we systematically
revisit established findings in RL for LLM reasoning and observe significant
variation across domains. For example, while prior work suggests that RL
primarily elicits existing knowledge from pretrained models, our results reveal
a more nuanced pattern: domains frequently seen during pretraining (Math, Code,
Science) easily benefit from cross-domain RL training, while domains with
limited pretraining exposure (Logic, Simulation, and Tabular) require in-domain
training to achieve meaningful performance gains, suggesting that RL is likely
to facilitate genuine skill acquisition. Finally, we present Guru-7B and
Guru-32B, two models that achieve state-of-the-art performance among open
models RL-trained with publicly available data, outperforming best baselines by
7.9% and 6.7% on our 17-task evaluation suite across six reasoning domains. We
also show that our models effectively improve the Pass@k performance of their
base models, particularly on complex tasks less likely to appear in pretraining
data. We release data, models, training and evaluation code to facilitate
general-purpose reasoning at: https://github.com/LLM360/Reasoning360
Guru, a diverse RL reasoning corpus, highlights domain-specific training needs and demonstrates improved performance in complex tasks for RL-enhanced LLMs.
reinforcement learning large language model RL reasoning curated RL reasoning corpus domain-specific reward design dereplication filtering cross-domain RL training in-domain training Guru-7B Guru-32B Pass@k performance