Group Think: Multiple Concurrent Reasoning Agents Collaborating at Token
  Level Granularity
Recent advances in large language models (LLMs) have demonstrated the power
of reasoning through self-generated chains of thought. Multiple reasoning
agents can collaborate to raise joint reasoning quality above individual
outcomes. However, such agents typically interact in a turn-based manner,
trading increased latency for improved quality. In this paper, we propose Group
Think--a single LLM that acts as multiple concurrent reasoning agents, or
thinkers. With shared visibility into each other's partial generation progress,
Group Think introduces a new concurrent-reasoning paradigm in which multiple
reasoning trajectories adapt dynamically to one another at the token level. For
example, a reasoning thread may shift its generation mid-sentence upon
detecting that another thread is better positioned to continue. This
fine-grained, token-level collaboration enables Group Think to reduce redundant
reasoning and improve quality while achieving significantly lower latency.
Moreover, its concurrent nature allows for efficient utilization of idle
computational resources, making it especially suitable for edge inference,
where very small batch size often underutilizes local~GPUs. We give a simple
and generalizable modification that enables any existing LLM to perform Group
Think on a local GPU. We also present an evaluation strategy to benchmark
reasoning latency and empirically demonstrate latency improvements using
open-source LLMs that were not explicitly trained for Group Think. We hope this
work paves the way for future LLMs to exhibit more sophisticated and more
efficient collaborative behavior for higher quality generation.
682ad96cdc6d7453624831b9
Chan-Jan Hsu
claimed_verified
2025-05-19T07:23:15.798Z
6213410828005421265b27d3
/avatars/930ac20daf640ca31fab713bf00c3268.svg
許湛然
user
Splend1dchan
682ad96cdc6d7453624831ba
Davide Buffelli
682ad96cdc6d7453624831bb
Jamie McGowan
admin_assigned
2025-05-19T14:20:45.715Z
633ee7834be90e06da1ea244
/avatars/9cbe45ad57834c1b1ae140ebe21775f0.svg
Jamie McGowan
user
jamie-mcg
682ad96cdc6d7453624831bc
Feng-Ting Liao
admin_assigned
2025-05-19T14:20:58.111Z
643fb7332397d8eef5b844cd
/avatars/e403a19fc13e478d5929c67028230b0e.svg
Feng-Ting Liao
user
FengTing
682ad96cdc6d7453624831bd
Yi-Chang Chen
claimed_verified
2025-05-20T07:22:58.006Z
63808c5d187bda141fbaf2b6
https://cdn-avatars.huggingface.co/v1/production/uploads/63808c5d187bda141fbaf2b6/erN99QrKT3kQ5q0Ta_nS2.jpeg
Yi-Chang (YC) Chen
user
YC-Chen
682ad96cdc6d7453624831be
Sattar Vakili
admin_assigned
2025-05-19T14:21:12.208Z
64c242ce129617dbaba8d439
/avatars/947cf4330ed1ce2cbdd5252cd91c9024.svg
Sattar Vakili
user
sattar-vakili
682ad96cdc6d7453624831bf
Da-shan Shiu
admin_assigned
2025-05-19T14:21:22.352Z
6811b1294119e4ecc92fc93b
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/srmY2yyzOg9KRDSLYXJKf.png
Dashan Shiu
user
dsshiu
Group Think: Multiple Concurrent Reasoning Agents Collaborating at Token
  Level Granularity
Recent advances in large language models (LLMs) have demonstrated the power
of reasoning through self-generated chains of thought. Multiple reasoning
agents can collaborate to raise joint reasoning quality above individual
outcomes. However, such agents typically interact in a turn-based manner,
trading increased latency for improved quality. In this paper, we propose Group
Think--a single LLM that acts as multiple concurrent reasoning agents, or
thinkers. With shared visibility into each other's partial generation progress,
Group Think introduces a new concurrent-reasoning paradigm in which multiple
reasoning trajectories adapt dynamically to one another at the token level. For
example, a reasoning thread may shift its generation mid-sentence upon
detecting that another thread is better positioned to continue. This
fine-grained, token-level collaboration enables Group Think to reduce redundant
reasoning and improve quality while achieving significantly lower latency.
Moreover, its concurrent nature allows for efficient utilization of idle
computational resources, making it especially suitable for edge inference,
where very small batch size often underutilizes local~GPUs. We give a simple
and generalizable modification that enables any existing LLM to perform Group
Think on a local GPU. We also present an evaluation strategy to benchmark
reasoning latency and empirically demonstrate latency improvements using
open-source LLMs that were not explicitly trained for Group Think. We hope this
work paves the way for future LLMs to exhibit more sophisticated and more
efficient collaborative behavior for higher quality generation.
A concurrent reasoning paradigm using a single LLM, called Group Think, enhances reasoning quality and reduces latency by allowing multiple reasoning threads to dynamically collaborate at the token level.
large language models (LLMs) reasoning through self-generated chains of thought reasoning agents concurrent-reasoning paradigm token-level collaboration