Internal Consistency and Self-Feedback in Large Language Models: A
  Survey
Large language models (LLMs) are expected to respond accurately but often
exhibit deficient reasoning or generate hallucinatory content. To address
these, studies prefixed with ``Self-'' such as Self-Consistency, Self-Improve,
and Self-Refine have been initiated. They share a commonality: involving LLMs
evaluating and updating itself to mitigate the issues. Nonetheless, these
efforts lack a unified perspective on summarization, as existing surveys
predominantly focus on categorization without examining the motivations behind
these works.
  In this paper, we summarize a theoretical framework, termed Internal
Consistency, which offers unified explanations for phenomena such as the lack
of reasoning and the presence of hallucinations. Internal Consistency assesses
the coherence among LLMs' latent layer, decoding layer, and response layer
based on sampling methodologies. Expanding upon the Internal Consistency
framework, we introduce a streamlined yet effective theoretical framework
capable of mining Internal Consistency, named Self-Feedback. The Self-Feedback
framework consists of two modules: Self-Evaluation and Self-Update. This
framework has been employed in numerous studies.
  We systematically classify these studies by tasks and lines of work;
summarize relevant evaluation methods and benchmarks; and delve into the
concern, ``Does Self-Feedback Really Work?'' We propose several critical
viewpoints, including the ``Hourglass Evolution of Internal Consistency'',
``Consistency Is (Almost) Correctness'' hypothesis, and ``The Paradox of Latent
and Explicit Reasoning''. Furthermore, we outline promising directions for
future research. We have open-sourced the experimental code, reference list,
and statistical data, available at
https://github.com/IAAR-Shanghai/ICSFSurvey.
669dc5402dbf53ccd21d38dc
Xun Liang
669dc5402dbf53ccd21d38dd
Shichao Song
claimed_verified
2024-07-22T07:09:42.057Z
656f339a5273668d5b946b33
https://cdn-avatars.huggingface.co/v1/production/uploads/656f339a5273668d5b946b33/o2nBvQiOKKP5IfDmnpHP2.jpeg
Shichao Song
user
Ki-Seki
669dc5402dbf53ccd21d38de
Zifan Zheng
claimed_verified
2024-07-22T07:08:48.248Z
656f47ba2f058b368c0b1611
https://cdn-avatars.huggingface.co/v1/production/uploads/656f47ba2f058b368c0b1611/mrmcmA8bxaDNUhuJQQ7T1.png
Zifan Zheng
user
fan2goa1
669dc5402dbf53ccd21d38df
Hanyu Wang
claimed_verified
2024-07-22T07:51:15.056Z
669e0b93c7cb0568dac6e92e
/avatars/a39ea77d7391f164af8a80f94f85f2ca.svg
hanyu Wang
user
UglyToilet
669dc5402dbf53ccd21d38e0
Qingchen Yu
claimed_verified
2024-07-22T12:27:06.557Z
6455ff584095c967f9a847bb
https://cdn-avatars.huggingface.co/v1/production/uploads/6455ff584095c967f9a847bb/A5wjtWsudC73fLVmgASBr.jpeg
Qingchen Yu
user
Duguce
669dc5402dbf53ccd21d38e1
Xunkai Li
admin_assigned
2024-07-22T14:46:06.667Z
669e0047dc9c86e6ab8ff35c
/avatars/b6d2c2a31d8cd1340277468dcd39b028.svg
Xunkai Li
user
DrinkIcee
669dc5402dbf53ccd21d38e2
Rong-Hua Li
669dc5402dbf53ccd21d38e3
Feiyu Xiong
669dc5402dbf53ccd21d38e4
Zhiyu Li
Internal Consistency and Self-Feedback in Large Language Models: A
  Survey
Large language models (LLMs) are expected to respond accurately but often
exhibit deficient reasoning or generate hallucinatory content. To address
these, studies prefixed with ``Self-'' such as Self-Consistency, Self-Improve,
and Self-Refine have been initiated. They share a commonality: involving LLMs
evaluating and updating itself to mitigate the issues. Nonetheless, these
efforts lack a unified perspective on summarization, as existing surveys
predominantly focus on categorization without examining the motivations behind
these works.
  In this paper, we summarize a theoretical framework, termed Internal
Consistency, which offers unified explanations for phenomena such as the lack
of reasoning and the presence of hallucinations. Internal Consistency assesses
the coherence among LLMs' latent layer, decoding layer, and response layer
based on sampling methodologies. Expanding upon the Internal Consistency
framework, we introduce a streamlined yet effective theoretical framework
capable of mining Internal Consistency, named Self-Feedback. The Self-Feedback
framework consists of two modules: Self-Evaluation and Self-Update. This
framework has been employed in numerous studies.
  We systematically classify these studies by tasks and lines of work;
summarize relevant evaluation methods and benchmarks; and delve into the
concern, ``Does Self-Feedback Really Work?'' We propose several critical
viewpoints, including the ``Hourglass Evolution of Internal Consistency'',
``Consistency Is (Almost) Correctness'' hypothesis, and ``The Paradox of Latent
and Explicit Reasoning''. Furthermore, we outline promising directions for
future research. We have open-sourced the experimental code, reference list,
and statistical data, available at
https://github.com/IAAR-Shanghai/ICSFSurvey.
A theoretical framework called Internal Consistency and a Self-Feedback framework with Self-Evaluation and Self-Update modules are presented to address reasoning and hallucination in large language models by assessing coherence across model layers.
large language models self-consistency self-improve self-refine internal consistency latent layer decoding layer response layer self-feedback self-evaluation self-update hourglass evolution consistency hypothesis latent reasoning explicit reasoning