Papers
arxiv:2610.27227

Which Agent's Skill Should Change? Group-Relative Credit Assignment for Evolving Multi-Agent Teams

Published on Oct 19
ยท Submitted by
yanan ma
on Oct 22
Authors:
,
,
,
,
,
,
,
,

Abstract

GRSE improves cooperative language agents by comparing repeated executions to correctly assign behavioral credit to agent-skill pairs, outperforming prior methods on multi-hop reasoning and recovering from harmful skills.

Cooperative language-model agents can improve without weight updates by revising reusable skills, but only if a shared team reward is traced to the responsible agent and skill. Existing methods credit the skills present in each trajectory, yet presence is not responsibility: a harmful skill active in successful runs still earns positive credit. We present GRSE, Group-Relative Skill Evolution, which assigns behavioral credit by comparison: inspired by GRPO, it executes each question several times under the same skill libraries and contrasts the executions to credit agent--skill pairs, with structured diagnosis of failures. On HotpotQA and LoCoMo with two open-weight actors, GRSE outperforms MASkills, the closest prior method, on HotpotQA and every LoCoMo category except open-domain, with the largest gains on multi-hop questions (+6.7 and +3.2 F1). Its gains rest on better-grounded retrieval rather than answers given without evidence, and its learned skills transfer between the multi-hop tasks. GRSE is robust to corrupted libraries: starting from planted harmful skills, it credits every planted skill with the correct sign and recovers the score of a clean library (+6.3 points), whereas MASkills misattributes two and falls below its starting point.

Community

Paper submitter

๐Ÿš€ We present GRSE (Group-Relative Skill Evolution), a framework that tackles a fundamental question in multi-agent learning:

When a team succeeds or fails, which agent's skill should actually change?

Instead of rewarding all skills involved in successful trajectories, GRSE performs group-relative credit assignment across multiple executions to identify the skills that truly drive outcomes.

Key highlights:

๐ŸŽฏ Assigns credit at the agent-skill level
๐Ÿ” Identifies causal contributors through trajectory comparison
๐Ÿค Supports continual multi-agent skill evolution
๐Ÿ“ˆ Outperforms existing skill-learning methods on HotpotQA and LoCoMo
๐Ÿ›ก๏ธ Remains robust under noisy and corrupted skill libraries

We believe GRSE is an important step toward scalable and self-improving multi-agent systems.

๐Ÿ“„ Paper: https://arxiv.org/abs/2610.27227
๐Ÿ’ป Code: https://github.com/yananma1029/GRSE-Skills

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.27227
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.27227 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.27227 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.27227 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.