APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated
  Agent-Human Interplay
Training effective AI agents for multi-turn interactions requires
high-quality data that captures realistic human-agent dynamics, yet such data
is scarce and expensive to collect manually. We introduce APIGen-MT, a
two-phase framework that generates verifiable and diverse multi-turn agent
data. In the first phase, our agentic pipeline produces detailed task
blueprints with ground-truth actions, leveraging a committee of LLM reviewers
and iterative feedback loops. These blueprints are then transformed into
complete interaction trajectories through simulated human-agent interplay. We
train a family of models -- the xLAM-2-fc-r series with sizes ranging from 1B
to 70B parameters. Our models outperform frontier models such as GPT-4o and
Claude 3.5 on tau-bench and BFCL benchmarks, with the smaller models
surpassing their larger counterparts, particularly in multi-turn settings,
while maintaining superior consistency across multiple trials. Comprehensive
experiments demonstrate that our verified blueprint-to-details approach yields
high-quality training data, enabling the development of more reliable,
efficient, and capable agents. We open-source both the synthetic data collected
and the trained xLAM-2-fc-r models to advance research in AI agents. Models are
available on HuggingFace at
https://huggingface.co/collections/Salesforce/xlam-2-67ef5be12949d8dcdae354c4
and project website is https://apigen-mt.github.io
67f36505e11bd4b05579afbf
Akshara Prabhakar
claimed_verified
2025-04-08T06:53:00.880Z
6475718de0b188d3cb25f346
/avatars/b0cdca7e19bbc1dbac00ea664108b51e.svg
Akshara Prabhakar
user
aksh555
67f36505e11bd4b05579afc0
Zuxin Liu
67f36505e11bd4b05579afc1
Weiran Yao
claimed_verified
2025-10-08T08:05:02.393Z
661573234c2f29635e93bb71
/avatars/fba95e382454485766b6349d6281b715.svg
Weiran Yao
user
weiranyao
67f36505e11bd4b05579afc2
Jianguo Zhang
67f36505e11bd4b05579afc3
Ming Zhu
67f36505e11bd4b05579afc4
Shiyu Wang
67f36505e11bd4b05579afc5
Zhiwei Liu
67f36505e11bd4b05579afc6
Tulika Awalgaonkar
67f36505e11bd4b05579afc7
Haolin Chen
claimed_verified
2025-10-10T10:12:01.054Z
65e0c21ebd0c59bbf271004c
/avatars/3210f41fd433d798fd7857c943288625.svg
Haolin Chen
user
hlnchen
67f36505e11bd4b05579afc8
Thai Hoang
67f36505e11bd4b05579afc9
Juan Carlos Niebles
67f36505e11bd4b05579afca
Shelby Heinecke
67f36505e11bd4b05579afcb
Huan Wang
67f36505e11bd4b05579afcc
Silvio Savarese
67f36505e11bd4b05579afcd
Caiming Xiong
APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated
  Agent-Human Interplay
Training effective AI agents for multi-turn interactions requires
high-quality data that captures realistic human-agent dynamics, yet such data
is scarce and expensive to collect manually. We introduce APIGen-MT, a
two-phase framework that generates verifiable and diverse multi-turn agent
data. In the first phase, our agentic pipeline produces detailed task
blueprints with ground-truth actions, leveraging a committee of LLM reviewers
and iterative feedback loops. These blueprints are then transformed into
complete interaction trajectories through simulated human-agent interplay. We
train a family of models -- the xLAM-2-fc-r series with sizes ranging from 1B
to 70B parameters. Our models outperform frontier models such as GPT-4o and
Claude 3.5 on tau-bench and BFCL benchmarks, with the smaller models
surpassing their larger counterparts, particularly in multi-turn settings,
while maintaining superior consistency across multiple trials. Comprehensive
experiments demonstrate that our verified blueprint-to-details approach yields
high-quality training data, enabling the development of more reliable,
efficient, and capable agents. We open-source both the synthetic data collected
and the trained xLAM-2-fc-r models to advance research in AI agents. Models are
available on HuggingFace at
https://huggingface.co/collections/Salesforce/xlam-2-67ef5be12949d8dcdae354c4
and project website is https://apigen-mt.github.io
The APIGen-MT framework generates high-quality multi-turn agent data using detailed task blueprints and simulated human-agent interactions, leading to superior model performance and consistency.
APIGen-MT agentic pipeline task blueprints ground-truth actions LLM reviewers iterative feedback loops interaction trajectories xLAM-2-fc-r model training $\tau$-bench BFCL benchmarks multi-turn settings synthetic data HuggingFace