OpenThinkIMG: Learning to Think with Images via Visual Tool
  Reinforcement Learning
While humans can flexibly leverage interactive visual cognition for complex
problem-solving, enabling Large Vision-Language Models (LVLMs) to learn
similarly adaptive behaviors with visual tools remains challenging. A
significant hurdle is the current lack of standardized infrastructure, which
hinders integrating diverse tools, generating rich interaction data, and
training robust agents effectively. To address these gaps, we introduce
OpenThinkIMG, the first open-source, comprehensive end-to-end framework for
tool-augmented LVLMs. It features standardized vision tool interfaces, scalable
trajectory generation for policy initialization, and a flexible training
environment. Furthermore, considering supervised fine-tuning (SFT) on static
demonstrations offers limited policy generalization for dynamic tool
invocation, we propose a novel reinforcement learning (RL) framework V-ToolRL
to train LVLMs to learn adaptive policies for invoking external vision tools.
V-ToolRL enables LVLMs to autonomously discover optimal tool-usage strategies
by directly optimizing for task success using feedback from tool interactions.
We empirically validate V-ToolRL on challenging chart reasoning tasks. Our
RL-trained agent, built upon a Qwen2-VL-2B, significantly outperforms its
SFT-initialized counterpart (+28.83 points) and surpasses established
supervised tool-learning baselines like Taco and CogCom by an average of +12.7
points. Notably, it also surpasses prominent closed-source models like GPT-4.1
by +8.68 accuracy points. We hope OpenThinkIMG can serve as a foundational
framework for advancing dynamic, tool-augmented visual reasoning, helping the
community develop AI agents that can genuinely "think with images".
6826aa068caf98415c50897f
Zhaochen Su
admin_assigned
2025-05-16T14:12:13.472Z
64264095ba51f8a2136946a0
https://cdn-avatars.huggingface.co/v1/production/uploads/64264095ba51f8a2136946a0/FR33boVpkDXcrvGMBmprF.jpeg
Zhaochen Su
user
Warrieryes
6826aa068caf98415c508980
Linjie Li
admin_assigned
2025-05-16T14:12:27.963Z
63db16fff03c3d71ef397206
/avatars/bfb7e0d730b7d03302799d5d2828d97d.svg
Linjie Li
user
linjieli222
6826aa068caf98415c508981
Mingyang Song
admin_assigned
2025-05-16T14:12:40.890Z
66aca01e33f6b27979856f6f
https://cdn-avatars.huggingface.co/v1/production/uploads/66aca01e33f6b27979856f6f/IyOxv89TudwscGH7tdue3.jpeg
Mingyang Song
user
hitsmy
6826aa068caf98415c508982
Yunzhuo Hao
admin_assigned
2025-05-16T14:12:47.552Z
653dd16277c2f09452ad37cd
/avatars/a95f9527722845a5414d86180c8e945d.svg
Yunzhuo Hao
user
luckychao
6826aa068caf98415c508983
Zhengyuan Yang
admin_assigned
2025-05-16T14:12:53.296Z
630713411801ecc7d2592a7c
/avatars/fb36f69f03421c3a2a7f72ba0858fa60.svg
Zhengyuan Yang
user
zyang39
6826aa068caf98415c508984
Jun Zhang
6826aa068caf98415c508985
Guanjie Chen
admin_assigned
2025-05-16T14:13:01.061Z
653a5ae21e1140b0c7d7f8f0
/avatars/2b839aad010bcd9364eed396e19f3700.svg
Guanjie Chen
user
GuanjieChen
6826aa068caf98415c508986
Jiawei Gu
claimed_verified
2025-05-21T15:17:51.248Z
645b4819f9d4ec91fdd54852
/avatars/e12efb8e030688a0afcc72176b453fb3.svg
Jiawei Gu
user
kuvvi
6826aa068caf98415c508987
Juntao Li
admin_assigned
2025-05-16T14:13:16.466Z
6670e285b0c03c4e9d6e0985
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/uCZHm4gKSHZ2b0hpHWgZv.jpeg
Juntao Li
user
douvleplus
6826aa068caf98415c508988
Xiaoye Qu
claimed_verified
2025-05-18T08:47:28.507Z
64cb54da1af278541d663708
/avatars/c44507cc92bb2e83154bad31b90ce6dd.svg
Xiaoye Qu
user
Xiaoye08
6826aa068caf98415c508989
Yu Cheng
claimed_verified
2025-06-02T07:49:48.175Z
67017abfe4d49b157ac534d9
/avatars/997e1b9f54b27a7728a9d4abfee4ba91.svg
Yu Cheng
user
ych133
OpenThinkIMG: Learning to Think with Images via Visual Tool
  Reinforcement Learning
While humans can flexibly leverage interactive visual cognition for complex
problem-solving, enabling Large Vision-Language Models (LVLMs) to learn
similarly adaptive behaviors with visual tools remains challenging. A
significant hurdle is the current lack of standardized infrastructure, which
hinders integrating diverse tools, generating rich interaction data, and
training robust agents effectively. To address these gaps, we introduce
OpenThinkIMG, the first open-source, comprehensive end-to-end framework for
tool-augmented LVLMs. It features standardized vision tool interfaces, scalable
trajectory generation for policy initialization, and a flexible training
environment. Furthermore, considering supervised fine-tuning (SFT) on static
demonstrations offers limited policy generalization for dynamic tool
invocation, we propose a novel reinforcement learning (RL) framework V-ToolRL
to train LVLMs to learn adaptive policies for invoking external vision tools.
V-ToolRL enables LVLMs to autonomously discover optimal tool-usage strategies
by directly optimizing for task success using feedback from tool interactions.
We empirically validate V-ToolRL on challenging chart reasoning tasks. Our
RL-trained agent, built upon a Qwen2-VL-2B, significantly outperforms its
SFT-initialized counterpart (+28.83 points) and surpasses established
supervised tool-learning baselines like Taco and CogCom by an average of +12.7
points. Notably, it also surpasses prominent closed-source models like GPT-4.1
by +8.68 accuracy points. We hope OpenThinkIMG can serve as a foundational
framework for advancing dynamic, tool-augmented visual reasoning, helping the
community develop AI agents that can genuinely "think with images".
OpenThinkIMG and V-ToolRL enable LVLMs to learn adaptive policies for using external vision tools, outperforming existing methods on chart reasoning tasks.
Large Vision-Language Models LVLMs OpenThinkIMG vision tool interfaces scalable trajectory generation reinforcement learning RL V-ToolRL adaptive policies task success Qwen2-VL-2B supervised fine-tuning SFT chart reasoning tasks Taco CogCom GPT-4.1