Test-time Computing: from System-1 Thinking to System-2 Thinking
The remarkable performance of the o1 model in complex reasoning demonstrates
that test-time computing scaling can further unlock the model's potential,
enabling powerful System-2 thinking. However, there is still a lack of
comprehensive surveys for test-time computing scaling. We trace the concept of
test-time computing back to System-1 models. In System-1 models, test-time
computing addresses distribution shifts and improves robustness and
generalization through parameter updating, input modification, representation
editing, and output calibration. In System-2 models, it enhances the model's
reasoning ability to solve complex problems through repeated sampling,
self-correction, and tree search. We organize this survey according to the
trend of System-1 to System-2 thinking, highlighting the key role of test-time
computing in the transition from System-1 models to weak System-2 models, and
then to strong System-2 models. We also point out a few possible future
directions.
677ca7db0c9718b04a426305
Yixin Ji
extracted_confirmed
2025-01-07T04:53:11.414Z
63412a43a7582111c3f1cadd
/avatars/033e809a7aa3d9c4b1326e9195290f65.svg
Yixin Ji
user
Yisam
677ca7db0c9718b04a426306
Juntao Li
admin_assigned
2025-01-07T09:51:35.155Z
6670e285b0c03c4e9d6e0985
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/uCZHm4gKSHZ2b0hpHWgZv.jpeg
Juntao Li
user
douvleplus
677ca7db0c9718b04a426307
Hai Ye
claimed_verified
2025-01-07T13:02:02.646Z
6239888e7fef05b7bdd5fcff
/avatars/54fcc756b8c0936b6bb410c6e0e02d75.svg
Hai Ye
user
oceanpty
677ca7db0c9718b04a426308
Kaixin Wu
claimed_verified
2025-01-09T10:07:22.984Z
677f1a2926d2ab07cfc7b37e
/avatars/fca140098b3aa41b93107603b941f35f.svg
Wu Kaixin
user
daniel-wkx
677ca7db0c9718b04a426309
Jia Xu
677ca7db0c9718b04a42630a
Linjian Mo
677ca7db0c9718b04a42630b
Min Zhang
Test-time Computing: from System-1 Thinking to System-2 Thinking
The remarkable performance of the o1 model in complex reasoning demonstrates
that test-time computing scaling can further unlock the model's potential,
enabling powerful System-2 thinking. However, there is still a lack of
comprehensive surveys for test-time computing scaling. We trace the concept of
test-time computing back to System-1 models. In System-1 models, test-time
computing addresses distribution shifts and improves robustness and
generalization through parameter updating, input modification, representation
editing, and output calibration. In System-2 models, it enhances the model's
reasoning ability to solve complex problems through repeated sampling,
self-correction, and tree search. We organize this survey according to the
trend of System-1 to System-2 thinking, highlighting the key role of test-time
computing in the transition from System-1 models to weak System-2 models, and
then to strong System-2 models. We also point out a few possible future
directions.
Test-time computing scaling enhances complex reasoning in models, improving robustness, generalization, and problem-solving from System-1 to System-2 thinking through various mechanisms.
test-time computing System-1 models distribution shifts robustness generalization parameter updating input modification representation editing output calibration System-2 models repeated sampling self-correction tree search