Verbal Process Supervision Elicits Better Coding Agents
The emergence of large language models and their applications as AI agents
have significantly advanced state-of-the-art code generation benchmarks,
transforming modern software engineering tasks. However, even with test-time
computed reasoning models, these systems still struggle with complex software
engineering challenges. This work introduces CURA, a code understanding and
reasoning agent system enhanced with verbal process supervision (VPS),
achieving a 3.65\% improvement over baseline models on challenging benchmarks
like BigCodeBench. Furthermore, CURA, when paired with the o3-mini model and
VPS techniques, attains state-of-the-art performance. This work represents a
step forward in integrating reasoning-driven architectures with LLM-based code
generation, enabling agentic reasoning for language models to solve complex
software engineering tasks.
67e21a81e2e69ea26eee4f67
Hao-Yuan Chen
claimed_verified
2025-03-25T08:20:30.277Z
65bef46337491e7adc5ee7c9
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/bQ2WY0bU65IQ3IBn6SrnA.png
Hao-Yuan Chen
user
MarkChenX
67e21a81e2e69ea26eee4f68
Cheng-Pong Huang
67e21a81e2e69ea26eee4f69
Jui-Ming Yao
Verbal Process Supervision Elicits Better Coding Agents
The emergence of large language models and their applications as AI agents
have significantly advanced state-of-the-art code generation benchmarks,
transforming modern software engineering tasks. However, even with test-time
computed reasoning models, these systems still struggle with complex software
engineering challenges. This work introduces CURA, a code understanding and
reasoning agent system enhanced with verbal process supervision (VPS),
achieving a 3.65\% improvement over baseline models on challenging benchmarks
like BigCodeBench. Furthermore, CURA, when paired with the o3-mini model and
VPS techniques, attains state-of-the-art performance. This work represents a
step forward in integrating reasoning-driven architectures with LLM-based code
generation, enabling agentic reasoning for language models to solve complex
software engineering tasks.
CURA, an enhanced code understanding and reasoning agent with verbal process supervision, significantly improves code generation benchmarks, especially when integrated with the o3-mini model.
CURA code understanding reasoning agent verbal process supervision BigCodeBench o3-mini model reasoning-driven architectures LLM-based code generation