AgentGym: Evolving Large Language Model-based Agents across Diverse
  Environments
Building generalist agents that can handle diverse tasks and evolve
themselves across different environments is a long-term goal in the AI
community. Large language models (LLMs) are considered a promising foundation
to build such agents due to their generalized capabilities. Current approaches
either have LLM-based agents imitate expert-provided trajectories step-by-step,
requiring human supervision, which is hard to scale and limits environmental
exploration; or they let agents explore and learn in isolated environments,
resulting in specialist agents with limited generalization. In this paper, we
take the first step towards building generally-capable LLM-based agents with
self-evolution ability. We identify a trinity of ingredients: 1) diverse
environments for agent exploration and learning, 2) a trajectory set to equip
agents with basic capabilities and prior knowledge, and 3) an effective and
scalable evolution method. We propose AgentGym, a new framework featuring a
variety of environments and tasks for broad, real-time, uni-format, and
concurrent agent exploration. AgentGym also includes a database with expanded
instructions, a benchmark suite, and high-quality trajectories across
environments. Next, we propose a novel method, AgentEvol, to investigate the
potential of agent self-evolution beyond previously seen data across tasks and
environments. Experimental results show that the evolved agents can achieve
results comparable to SOTA models. We release the AgentGym suite, including the
platform, dataset, benchmark, checkpoints, and algorithm implementations. The
AgentGym suite is available on https://github.com/WooooDyy/AgentGym.
666272df4de7d7f4dc428a33
Zhiheng Xi
admin_assigned
2024-06-07T13:34:27.205Z
653a6e5cae155b92bae77b74
https://cdn-avatars.huggingface.co/v1/production/uploads/653a6e5cae155b92bae77b74/TA5FWKAUsB249ux4MzD_R.jpeg
Zhiheng Xi
user
WooooDyy
666272df4de7d7f4dc428a34
Yiwen Ding
claimed_verified
2024-06-11T06:59:37.353Z
650819ad95c45596854271a3
/avatars/9517fd62eef104c33884dfb3f64249bf.svg
wen
user
cindywen
666272df4de7d7f4dc428a35
Wenxiang Chen
admin_assigned
2024-06-07T13:34:50.431Z
663b26c7e14047f710f90410
/avatars/5c856e9b05e5d87f6e555b37f58e8240.svg
chenwenxiang
user
alexchen777
666272df4de7d7f4dc428a36
Boyang Hong
admin_assigned
2024-06-07T13:35:03.183Z
6407d786a7bc7c3865ae01c5
/avatars/96d8c2591b8aa8f6fa03e7e091500cc4.svg
hby
user
hongboyang
666272df4de7d7f4dc428a37
Honglin Guo
admin_assigned
2024-06-07T13:35:24.900Z
638ef0b0c67af472d31674a6
/avatars/02df97d15a0f46b47f9162221733b121.svg
Honglin Guo
user
KYLN24
666272df4de7d7f4dc428a38
Junzhe Wang
admin_assigned
2024-06-07T13:35:31.503Z
653ab4a69a2aeec4a2dedde5
/avatars/273195db2f40f42ea6f9ad50be27c259.svg
Junzhe Wang
user
jwang69
666272df4de7d7f4dc428a39
Dingwen Yang
666272df4de7d7f4dc428a3a
Chenyang Liao
admin_assigned
2024-06-07T13:35:45.386Z
6617f65501ad3a0642afd03b
/avatars/440c26059fc87660ee00e5a1cbd6cfae.svg
Chenyang Liao
user
Marr0N
666272df4de7d7f4dc428a3b
Xin Guo
666272df4de7d7f4dc428a3c
Wei He
claimed_verified
2024-10-25T09:31:49.210Z
66ecee857264238429a1211f
https://cdn-avatars.huggingface.co/v1/production/uploads/66ecee857264238429a1211f/TbuM7ToLBrSxDF8mOccpK.jpeg
Wei He
user
hewei2001
666272df4de7d7f4dc428a3d
Songyang Gao
666272df4de7d7f4dc428a3e
Lu Chen
666272df4de7d7f4dc428a3f
Rui Zheng
666272df4de7d7f4dc428a40
Yicheng Zou
admin_assigned
2024-06-07T13:38:43.003Z
6234238485575ce6ff1f169a
/avatars/e5fff05f21cdea4e5aebc8ba426fac29.svg
Yicheng Zou
user
RowitZou
666272df4de7d7f4dc428a41
Tao Gui
666272df4de7d7f4dc428a42
Qi Zhang
666272df4de7d7f4dc428a43
Xipeng Qiu
admin_assigned
2024-06-07T13:39:06.969Z
61457b8deff2c9fdb4de4988
https://cdn-avatars.huggingface.co/v1/production/uploads/1632381702899-61457b8deff2c9fdb4de4988.jpeg
Xipeng Qiu
user
xpqiu
666272df4de7d7f4dc428a44
Xuanjing Huang
666272df4de7d7f4dc428a45
Zuxuan Wu
666272df4de7d7f4dc428a46
Yu-Gang Jiang
AgentGym: Evolving Large Language Model-based Agents across Diverse
  Environments
Building generalist agents that can handle diverse tasks and evolve
themselves across different environments is a long-term goal in the AI
community. Large language models (LLMs) are considered a promising foundation
to build such agents due to their generalized capabilities. Current approaches
either have LLM-based agents imitate expert-provided trajectories step-by-step,
requiring human supervision, which is hard to scale and limits environmental
exploration; or they let agents explore and learn in isolated environments,
resulting in specialist agents with limited generalization. In this paper, we
take the first step towards building generally-capable LLM-based agents with
self-evolution ability. We identify a trinity of ingredients: 1) diverse
environments for agent exploration and learning, 2) a trajectory set to equip
agents with basic capabilities and prior knowledge, and 3) an effective and
scalable evolution method. We propose AgentGym, a new framework featuring a
variety of environments and tasks for broad, real-time, uni-format, and
concurrent agent exploration. AgentGym also includes a database with expanded
instructions, a benchmark suite, and high-quality trajectories across
environments. Next, we propose a novel method, AgentEvol, to investigate the
potential of agent self-evolution beyond previously seen data across tasks and
environments. Experimental results show that the evolved agents can achieve
results comparable to SOTA models. We release the AgentGym suite, including the
platform, dataset, benchmark, checkpoints, and algorithm implementations. The
AgentGym suite is available on https://github.com/WooooDyy/AgentGym.
AgentGym is a framework that facilitates the development of self-evolving LLM-based agents capable of handling diverse tasks across various environments without extensive human supervision.
large language models (LLMs) agent exploration trajectory set diverse environments basic capabilities prior knowledge effective and scalable evolution method AgentGym real-time exploration uni-format exploration concurrent exploration AgentEvol high-quality trajectories SOTA models