Knowledge Mechanisms in Large Language Models: A Survey and Perspective
Understanding knowledge mechanisms in Large Language Models (LLMs) is crucial
for advancing towards trustworthy AGI. This paper reviews knowledge mechanism
analysis from a novel taxonomy including knowledge utilization and evolution.
Knowledge utilization delves into the mechanism of memorization, comprehension
and application, and creation. Knowledge evolution focuses on the dynamic
progression of knowledge within individual and group LLMs. Moreover, we discuss
what knowledge LLMs have learned, the reasons for the fragility of parametric
knowledge, and the potential dark knowledge (hypothesis) that will be
challenging to address. We hope this work can help understand knowledge in LLMs
and provide insights for future research.
669f466e98ba26df964c1676
Mengru Wang
admin_assigned
2024-07-23T07:56:18.581Z
64bf898d979949d2e2585c9a
/avatars/da77c856ec997e2b812c06272a01c8b2.svg
mengruwang
user
mengru
669f466e98ba26df964c1677
Yunzhi Yao
admin_assigned
2024-07-23T07:56:28.162Z
6122fbe636a4c36a99dbea7b
/avatars/c0cd2c1ef58e315d9adda9d26000f625.svg
Yunzhi Yao
user
cowTodd
669f466e98ba26df964c1678
Ziwen Xu
admin_assigned
2024-07-23T07:56:43.237Z
6549caee44e75a7de4fee2fa
/avatars/5aea69671eb1299aaaa948d888b4b64f.svg
Xu Ziwen
user
xzwnlp
669f466e98ba26df964c1679
Shuofei Qiao
claimed_verified
2024-07-23T07:47:13.003Z
6447800f30fa4ecb85ddad80
https://cdn-avatars.huggingface.co/v1/production/uploads/6447800f30fa4ecb85ddad80/NsmXIaMsWctmTNA7tFVkX.jpeg
Shuofei Qiao
user
GoooDte
669f466e98ba26df964c167a
Shumin Deng
admin_assigned
2024-07-23T07:57:30.718Z
6441f1d2603214724ec0c1c2
/avatars/d3c4b759e6a5635e37ff715fae52e5ba.svg
Shumin Deng
user
231sm
669f466e98ba26df964c167b
Peng Wang
claimed_verified
2024-07-23T12:00:57.782Z
62f220ccee7d7af44979efc7
https://cdn-avatars.huggingface.co/v1/production/uploads/62f220ccee7d7af44979efc7/RImNglMumGCpAKB5gin6k.jpeg
Peng Wang
user
ZJUPeng
669f466e98ba26df964c167c
Xiang Chen
admin_assigned
2024-07-23T07:58:01.930Z
64c073417255ff868721fb54
/avatars/c2a00114598aa89f071b937f0af4077f.svg
Xiang CHEN
user
xiangchen-dvi
669f466e98ba26df964c167d
Jia-Chen Gu
admin_assigned
2024-07-23T07:58:15.460Z
66783dbb97ab4b3bc141c43c
/avatars/84bfca1b98f6479d94dfdbc0780e106b.svg
jiachen
user
JiachenGu
669f466e98ba26df964c167e
Yong Jiang
claimed_verified
2025-01-20T09:31:20.943Z
678ddd806aa55e76bfffb953
/avatars/f447936c286a6a2d2874a760210b2f17.svg
Yong Jiang
user
yongjiangNLP
669f466e98ba26df964c167f
Pengjun Xie
admin_assigned
2024-07-23T07:58:28.066Z
63a091e42fabbbb89991f5ce
/avatars/d55485b06461764c36c9edf9d6e8892c.svg
pengjun xie
user
xpjandy
669f466e98ba26df964c1680
Fei Huang
669f466e98ba26df964c1681
Huajun Chen
admin_assigned
2024-07-23T07:58:43.813Z
64931296137833d7ec7689cd
https://cdn-avatars.huggingface.co/v1/production/uploads/64931296137833d7ec7689cd/TBihNdp1ZwIWjhfAWjRr6.jpeg
Huajun Chen
user
huajunsir
669f466e98ba26df964c1682
Ningyu Zhang
claimed_verified
2024-07-23T07:47:15.618Z
620b3bbb0668e435407c8d0a
/avatars/e0fccbb2577d76088e09f054c35cffbc.svg
Ningyu Zhang
user
Ningyu
Knowledge Mechanisms in Large Language Models: A Survey and Perspective
Understanding knowledge mechanisms in Large Language Models (LLMs) is crucial
for advancing towards trustworthy AGI. This paper reviews knowledge mechanism
analysis from a novel taxonomy including knowledge utilization and evolution.
Knowledge utilization delves into the mechanism of memorization, comprehension
and application, and creation. Knowledge evolution focuses on the dynamic
progression of knowledge within individual and group LLMs. Moreover, we discuss
what knowledge LLMs have learned, the reasons for the fragility of parametric
knowledge, and the potential dark knowledge (hypothesis) that will be
challenging to address. We hope this work can help understand knowledge in LLMs
and provide insights for future research.
The paper examines knowledge mechanisms in Large Language Models, focusing on utilization (memorization, comprehension, application, and creation) and evolution, addressing the fragility of parametric knowledge and potential dark knowledge.
Large Language Models knowledge utilization memorization comprehension application creation knowledge evolution parametric knowledge dark knowledge AGI