Scaling Agents via Continual Pre-training
Large language models (LLMs) have evolved into agentic systems capable of
autonomous tool use and multi-step reasoning for complex problem-solving.
However, post-training approaches building upon general-purpose foundation
models consistently underperform in agentic tasks, particularly in open-source
implementations. We identify the root cause: the absence of robust agentic
foundation models forces models during post-training to simultaneously learn
diverse agentic behaviors while aligning them to expert demonstrations, thereby
creating fundamental optimization tensions. To this end, we are the first to
propose incorporating Agentic Continual Pre-training (Agentic CPT) into the
deep research agents training pipeline to build powerful agentic foundational
models. Based on this approach, we develop a deep research agent model named
AgentFounder. We evaluate our AgentFounder-30B on 10 benchmarks and achieve
state-of-the-art performance while retains strong tool-use ability, notably
39.9% on BrowseComp-en, 43.3% on BrowseComp-zh, and 31.5% Pass@1 on HLE.
68ca3cbe6e0073c09bd1df42
Liangcai Su
claimed_verified
2025-09-17T12:47:38.981Z
677f945ea82c316db164a180
/avatars/50ec99d971564944de3b1d9c17d50cfd.svg
Liangcai Su
user
HKU-Liangcai
68ca3cbe6e0073c09bd1df43
Zhen Zhang
68ca3cbe6e0073c09bd1df44
Guangyu Li
68ca3cbe6e0073c09bd1df45
Zhuo Chen
68ca3cbe6e0073c09bd1df46
Chenxi Wang
68ca3cbe6e0073c09bd1df47
Maojia Song
admin_assigned
2025-09-19T06:57:11.131Z
650bfb96d564b800cc7fde73
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/DoFM731uaoaNDue1Nm_Zp.png
Maojia Song
user
OrangeEye
68ca3cbe6e0073c09bd1df48
Xinyu Wang
68ca3cbe6e0073c09bd1df49
Kuan Li
68ca3cbe6e0073c09bd1df4a
Jialong Wu
claimed_verified
2025-09-17T12:47:36.751Z
644a4fbc2166258fccc664bc
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/8k3b44MbhQiWuo6i8BnYl.jpeg
Jialong Wu
user
callanwu
68ca3cbe6e0073c09bd1df4b
Xuanzhong Chen
claimed_verified
2025-09-17T12:47:41.195Z
65e6970d135c27ea806526fe
/avatars/4aced113d9cab055ae06f3945869a280.svg
Xuanzhong Chen
user
chenxz
68ca3cbe6e0073c09bd1df4c
Zile Qiao
68ca3cbe6e0073c09bd1df4d
Zhongwang Zhang
admin_assigned
2025-09-19T06:57:25.158Z
657c4e471fa4e4e152d31b40
/avatars/0a375c40b7eb75987f4aed958f55c967.svg
zhongwang zhang
user
0123zzw666
68ca3cbe6e0073c09bd1df4e
Huifeng Yin
68ca3cbe6e0073c09bd1df4f
Shihao Cai
68ca3cbe6e0073c09bd1df50
Runnan Fang
admin_assigned
2025-09-19T06:57:44.220Z
63d32cd7b734eaa4d4fa410b
/avatars/68acb80f62bc6493e1ad26506999b6c4.svg
Runnan Fang
user
Runnaning
68ca3cbe6e0073c09bd1df51
Zhengwei Tao
68ca3cbe6e0073c09bd1df52
Wenbiao Yin
admin_assigned
2025-09-19T06:57:57.820Z
63fc4c00a3c067e62899d32b
/avatars/b54f2a406afdbbe2cd305d4d9f88ced2.svg
Wenbiao Yin
user
NLPblue
68ca3cbe6e0073c09bd1df53
Chenxiong Qian
68ca3cbe6e0073c09bd1df54
Yong Jiang
68ca3cbe6e0073c09bd1df55
Pengjun Xie
admin_assigned
2025-09-19T06:58:16.396Z
63a091e42fabbbb89991f5ce
/avatars/d55485b06461764c36c9edf9d6e8892c.svg
pengjun xie
user
xpjandy
68ca3cbe6e0073c09bd1df56
Fei Huang
68ca3cbe6e0073c09bd1df57
Jingren Zhou
Scaling Agents via Continual Pre-training
Large language models (LLMs) have evolved into agentic systems capable of
autonomous tool use and multi-step reasoning for complex problem-solving.
However, post-training approaches building upon general-purpose foundation
models consistently underperform in agentic tasks, particularly in open-source
implementations. We identify the root cause: the absence of robust agentic
foundation models forces models during post-training to simultaneously learn
diverse agentic behaviors while aligning them to expert demonstrations, thereby
creating fundamental optimization tensions. To this end, we are the first to
propose incorporating Agentic Continual Pre-training (Agentic CPT) into the
deep research agents training pipeline to build powerful agentic foundational
models. Based on this approach, we develop a deep research agent model named
AgentFounder. We evaluate our AgentFounder-30B on 10 benchmarks and achieve
state-of-the-art performance while retains strong tool-use ability, notably
39.9% on BrowseComp-en, 43.3% on BrowseComp-zh, and 31.5% Pass@1 on HLE.
AgentFounder, a deep research agent model incorporating Agentic Continual Pre-training, achieves state-of-the-art performance in agentic tasks while maintaining strong tool-use ability.
Large language models agentic systems autonomous tool use multi-step reasoning post-training approaches general-purpose foundation models agentic foundation models Agentic Continual Pre-training deep research agents AgentFounder BrowseComp-en BrowseComp-zh HLE