Statler: State-Maintaining Language Models for Embodied Reasoning
Large language models (LLMs) provide a promising tool that enable robots to
perform complex robot reasoning tasks. However, the limited context window of
contemporary LLMs makes reasoning over long time horizons difficult. Embodied
tasks such as those that one might expect a household robot to perform
typically require that the planner consider information acquired a long time
ago (e.g., properties of the many objects that the robot previously encountered
in the environment). Attempts to capture the world state using an LLM's
implicit internal representation is complicated by the paucity of task- and
environment-relevant information available in a robot's action history, while
methods that rely on the ability to convey information via the prompt to the
LLM are subject to its limited context window. In this paper, we propose
Statler, a framework that endows LLMs with an explicit representation of the
world state as a form of ``memory'' that is maintained over time. Integral to
Statler is its use of two instances of general LLMs -- a world-model reader and
a world-model writer -- that interface with and maintain the world state. By
providing access to this world state ``memory'', Statler improves the ability
of existing LLMs to reason over longer time horizons without the constraint of
context length. We evaluate the effectiveness of our approach on three
simulated table-top manipulation domains and a real robot domain, and show that
it improves the state-of-the-art in LLM-based robot reasoning. Project website:
https://statler-lm.github.io/
64a2337dd94c3f9ccec83524
Takuma Yoneda
claimed_verified
2023-07-03T15:22:42.545Z
646c2f2bb1202bc77c14bab7
https://cdn-avatars.huggingface.co/v1/production/uploads/646c2f2bb1202bc77c14bab7/IiqAh-5WXFX5ug-t6012v.jpeg
Takuma Yoneda
user
takuma-yoneda
64a2337dd94c3f9ccec83525
Jiading Fang
claimed_verified
2023-07-04T07:24:49.235Z
62e0a153080ca8e21491eb1e
https://cdn-avatars.huggingface.co/v1/production/uploads/62e0a153080ca8e21491eb1e/6C6Bs-43oUsq5D52x_pZ_.jpeg
Jiading Fang
user
fjd
64a2337dd94c3f9ccec83526
Peng Li
claimed_verified
2023-07-03T11:47:31.616Z
64553fd9b27940efcb9627c8
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/B_QAqe4urR9FwGP53pKoA.jpeg
Peng Li
user
artistpli
64a2337dd94c3f9ccec83527
Huanyu Zhang
64a2337dd94c3f9ccec83528
Tianchong Jiang
64a2337dd94c3f9ccec83529
Shengjie Lin
64a2337dd94c3f9ccec8352a
Ben Picker
claimed_verified
2023-07-27T17:32:38.270Z
64c2a461ae66cb547e4f48b8
/avatars/62a654bfa7518e66a81cb7d1fd38fc61.svg
Ben Picker
user
benpicker
64a2337dd94c3f9ccec8352b
David Yunis
claimed_verified
2025-05-15T10:41:53.184Z
66ec895d9cbe309858f714a5
/avatars/b96f1949708746554bdd3f8ffbc210bc.svg
David
user
dyunis
64a2337dd94c3f9ccec8352c
Hongyuan Mei
64a2337dd94c3f9ccec8352d
Matthew R. Walter
claimed_verified
2023-07-04T07:24:46.632Z
64653ac5200b583e1e518b9a
/avatars/0ef81b1d9b194651ef54b2c9b18b13de.svg
Matthew Walter
user
mwalter
Statler: State-Maintaining Language Models for Embodied Reasoning
Large language models (LLMs) provide a promising tool that enable robots to
perform complex robot reasoning tasks. However, the limited context window of
contemporary LLMs makes reasoning over long time horizons difficult. Embodied
tasks such as those that one might expect a household robot to perform
typically require that the planner consider information acquired a long time
ago (e.g., properties of the many objects that the robot previously encountered
in the environment). Attempts to capture the world state using an LLM's
implicit internal representation is complicated by the paucity of task- and
environment-relevant information available in a robot's action history, while
methods that rely on the ability to convey information via the prompt to the
LLM are subject to its limited context window. In this paper, we propose
Statler, a framework that endows LLMs with an explicit representation of the
world state as a form of ``memory'' that is maintained over time. Integral to
Statler is its use of two instances of general LLMs -- a world-model reader and
a world-model writer -- that interface with and maintain the world state. By
providing access to this world state ``memory'', Statler improves the ability
of existing LLMs to reason over longer time horizons without the constraint of
context length. We evaluate the effectiveness of our approach on three
simulated table-top manipulation domains and a real robot domain, and show that
it improves the state-of-the-art in LLM-based robot reasoning. Project website:
https://statler-lm.github.io/
Statler framework enhances LLMs' ability to reason over long time horizons by integrating an explicit world state memory using two LLM instances.
Large language models LLMs robot reasoning context window world state memory world-model reader world-model writer table-top manipulation real robot domain