CALM Before the STORM: Unlocking Native Reasoning for Optimization
  Modeling
Large Reasoning Models (LRMs) have demonstrated strong capabilities in
complex multi-step reasoning, opening new opportunities for automating
optimization modeling. However, existing domain adaptation methods, originally
designed for earlier instruction-tuned models, often fail to exploit the
advanced reasoning patterns of modern LRMs -- In particular, we show that
direct fine-tuning on traditional non-reflective datasets leads to
limited gains. To fully leverage LRMs' inherent reasoning abilities, we propose
CALM (Corrective Adaptation with Lightweight Modification), a
framework that progressively refines LRMs within their native reasoning modes
for optimization modeling tasks. In CALM, an expert intervener identifies
reasoning flaws and provides concise corrective hints, which the LRM
incorporates to produce improved reasoning trajectories. These interventions
modify fewer than 2.6\% of generated tokens, but generate high-quality data for
soft adaptation through supervised fine-tuning. The adapted model is then
further improved through reinforcement learning. Building on CALM, we develop
STORM (Smart Thinking Optimization Reasoning Model), a
4B-parameter LRM that achieves a new state-of-the-art average accuracy of
68.9\% across five popular optimization modeling benchmarks, matching the
performance of a 671B LRM. These results demonstrate that dynamic, hint-based
data synthesis both preserves and amplifies the native reasoning patterns of
modern LRMs, offering a more effective and scalable path towards expert-level
performance on challenging optimization modeling tasks.
68e511f0f9af2f6567eab8f8
Zhengyang Tang
claimed_verified
2025-10-08T11:49:10.098Z
64912976b95c3f0a1e6233cb
/avatars/3e338c5eef2514055ed98ae6141a5d1a.svg
Zhengyang Tang
user
tangzhy
68e511f0f9af2f6567eab8f9
Zihan Ye
68e511f0f9af2f6567eab8fa
Chenyu Huang
68e511f0f9af2f6567eab8fb
Xuhan Huang
claimed_verified
2025-10-10T09:38:15.508Z
658afac6cffe7d2208657bcd
/avatars/0861bd6d394373cd9c03f207a019bc17.svg
Xuhan Huang
user
XuhanH
68e511f0f9af2f6567eab8fc
Chengpeng Li
68e511f0f9af2f6567eab8fd
Sihang Li
68e511f0f9af2f6567eab8fe
Guanhua Chen
68e511f0f9af2f6567eab8ff
Ming Yan
68e511f0f9af2f6567eab900
Zizhuo Wang
68e511f0f9af2f6567eab901
Hongyuan Zha
68e511f0f9af2f6567eab902
Dayiheng Liu
68e511f0f9af2f6567eab903
Benyou Wang
CALM Before the STORM: Unlocking Native Reasoning for Optimization
  Modeling
Large Reasoning Models (LRMs) have demonstrated strong capabilities in
complex multi-step reasoning, opening new opportunities for automating
optimization modeling. However, existing domain adaptation methods, originally
designed for earlier instruction-tuned models, often fail to exploit the
advanced reasoning patterns of modern LRMs -- In particular, we show that
direct fine-tuning on traditional non-reflective datasets leads to
limited gains. To fully leverage LRMs' inherent reasoning abilities, we propose
CALM (Corrective Adaptation with Lightweight Modification), a
framework that progressively refines LRMs within their native reasoning modes
for optimization modeling tasks. In CALM, an expert intervener identifies
reasoning flaws and provides concise corrective hints, which the LRM
incorporates to produce improved reasoning trajectories. These interventions
modify fewer than 2.6\% of generated tokens, but generate high-quality data for
soft adaptation through supervised fine-tuning. The adapted model is then
further improved through reinforcement learning. Building on CALM, we develop
STORM (Smart Thinking Optimization Reasoning Model), a
4B-parameter LRM that achieves a new state-of-the-art average accuracy of
68.9\% across five popular optimization modeling benchmarks, matching the
performance of a 671B LRM. These results demonstrate that dynamic, hint-based
data synthesis both preserves and amplifies the native reasoning patterns of
modern LRMs, offering a more effective and scalable path towards expert-level
performance on challenging optimization modeling tasks.
CALM framework uses expert interventions to refine LRM reasoning for optimization tasks, achieving high accuracy with fewer modifications compared to traditional methods.
Large Reasoning Models domain adaptation fine-tuning non-reflective datasets CALM corrective adaptation lightweight modification reasoning flaws corrective hints reasoning trajectories soft adaptation supervised fine-tuning reinforcement learning STORM Smart Thinking Optimization Reasoning Model