Symbolic Learning Enables Self-Evolving Agents
The AI community has been exploring a pathway to artificial general
intelligence (AGI) by developing "language agents", which are complex large
language models (LLMs) pipelines involving both prompting techniques and tool
usage methods. While language agents have demonstrated impressive capabilities
for many real-world tasks, a fundamental limitation of current language agents
research is that they are model-centric, or engineering-centric. That's to say,
the progress on prompts, tools, and pipelines of language agents requires
substantial manual engineering efforts from human experts rather than
automatically learning from data. We believe the transition from model-centric,
or engineering-centric, to data-centric, i.e., the ability of language agents
to autonomously learn and evolve in environments, is the key for them to
possibly achieve AGI.
  In this work, we introduce agent symbolic learning, a systematic framework
that enables language agents to optimize themselves on their own in a
data-centric way using symbolic optimizers. Specifically, we consider agents as
symbolic networks where learnable weights are defined by prompts, tools, and
the way they are stacked together. Agent symbolic learning is designed to
optimize the symbolic network within language agents by mimicking two
fundamental algorithms in connectionist learning: back-propagation and gradient
descent. Instead of dealing with numeric weights, agent symbolic learning works
with natural language simulacrums of weights, loss, and gradients. We conduct
proof-of-concept experiments on both standard benchmarks and complex real-world
tasks and show that agent symbolic learning enables language agents to update
themselves after being created and deployed in the wild, resulting in
"self-evolving agents".
667d40359e4c6361d6a5a6f4
Wangchunshu Zhou
admin_assigned
2024-06-27T18:48:20.949Z
628c8598ef14f971b698107f
/avatars/3a4ad87e6b5f9e836a1160d869df1447.svg
Zhou
user
Wangchunshu
667d40359e4c6361d6a5a6f5
Yixin Ou
claimed_verified
2025-06-13T07:44:04.662Z
6241749cf80bd930bd99f3dd
https://cdn-avatars.huggingface.co/v1/production/uploads/1669210243382-6241749cf80bd930bd99f3dd.jpeg
Ou Yixin
user
OE-Heart
667d40359e4c6361d6a5a6f6
Shengwei Ding
667d40359e4c6361d6a5a6f7
Long Li
claimed_verified
2024-10-25T09:31:45.896Z
6365d83ce7a78348d82572b0
/avatars/d50587902cced2c3640fd5de82ff78dd.svg
ll
user
jianghuyihei
667d40359e4c6361d6a5a6f8
Jialong Wu
claimed_verified
2024-10-21T07:54:04.232Z
644a4fbc2166258fccc664bc
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/8k3b44MbhQiWuo6i8BnYl.jpeg
Jialong Wu
user
callanwu
667d40359e4c6361d6a5a6f9
Tiannan Wang
admin_assigned
2024-06-27T18:53:25.973Z
632bfaebea6e62428ab0e9c2
/avatars/344aaf371bbba9aea091b12741c451e5.svg
Tiannan Wang
user
WTNswaggy
667d40359e4c6361d6a5a6fa
Jiamin Chen
667d40359e4c6361d6a5a6fb
Shuai Wang
claimed_verified
2024-10-21T14:03:13.802Z
668a17447d3f73951ed2ab84
/avatars/2a1785af3b1b02e495304d2b118accb0.svg
Shuai Wang
user
Shuaiii
667d40359e4c6361d6a5a6fc
Xiaohua Xu
667d40359e4c6361d6a5a6fd
Ningyu Zhang
admin_assigned
2024-06-27T18:54:41.026Z
620b3bbb0668e435407c8d0a
/avatars/e0fccbb2577d76088e09f054c35cffbc.svg
Ningyu Zhang
user
Ningyu
667d40359e4c6361d6a5a6fe
Huajun Chen
667d40359e4c6361d6a5a6ff
Yuchen Eleanor Jiang
admin_assigned
2024-06-27T18:50:07.782Z
62c872ff5a87d76d88fdba75
/avatars/d4696529d1d135e5e2774eb74776ec58.svg
Yuchen Eleanor Jiang
user
eleanorjiang
Symbolic Learning Enables Self-Evolving Agents
The AI community has been exploring a pathway to artificial general
intelligence (AGI) by developing "language agents", which are complex large
language models (LLMs) pipelines involving both prompting techniques and tool
usage methods. While language agents have demonstrated impressive capabilities
for many real-world tasks, a fundamental limitation of current language agents
research is that they are model-centric, or engineering-centric. That's to say,
the progress on prompts, tools, and pipelines of language agents requires
substantial manual engineering efforts from human experts rather than
automatically learning from data. We believe the transition from model-centric,
or engineering-centric, to data-centric, i.e., the ability of language agents
to autonomously learn and evolve in environments, is the key for them to
possibly achieve AGI.
  In this work, we introduce agent symbolic learning, a systematic framework
that enables language agents to optimize themselves on their own in a
data-centric way using symbolic optimizers. Specifically, we consider agents as
symbolic networks where learnable weights are defined by prompts, tools, and
the way they are stacked together. Agent symbolic learning is designed to
optimize the symbolic network within language agents by mimicking two
fundamental algorithms in connectionist learning: back-propagation and gradient
descent. Instead of dealing with numeric weights, agent symbolic learning works
with natural language simulacrums of weights, loss, and gradients. We conduct
proof-of-concept experiments on both standard benchmarks and complex real-world
tasks and show that agent symbolic learning enables language agents to update
themselves after being created and deployed in the wild, resulting in
"self-evolving agents".
Agent symbolic learning enables language agents to autonomously optimize and evolve through symbolic representations of connectionist learning algorithms, facilitating their adaptation in real-world environments.
agent symbolic learning symbolic optimizers symbolic networks back-propagation gradient descent self-evolving agents