Personalization of Large Language Models: A Survey
Personalization of Large Language Models (LLMs) has recently become
increasingly important with a wide range of applications. Despite the
importance and recent progress, most existing works on personalized LLMs have
focused either entirely on (a) personalized text generation or (b) leveraging
LLMs for personalization-related downstream applications, such as
recommendation systems. In this work, we bridge the gap between these two
separate main directions for the first time by introducing a taxonomy for
personalized LLM usage and summarizing the key differences and challenges. We
provide a formalization of the foundations of personalized LLMs that
consolidates and expands notions of personalization of LLMs, defining and
discussing novel facets of personalization, usage, and desiderata of
personalized LLMs. We then unify the literature across these diverse fields and
usage scenarios by proposing systematic taxonomies for the granularity of
personalization, personalization techniques, datasets, evaluation methods, and
applications of personalized LLMs. Finally, we highlight challenges and
important open problems that remain to be addressed. By unifying and surveying
recent research using the proposed taxonomies, we aim to provide a clear guide
to the existing literature and different facets of personalization in LLMs,
empowering both researchers and practitioners.
672849f29b9d58f33ed9c3c0
Zhehao Zhang
admin_assigned
2024-11-04T14:25:03.447Z
631704b80dc3e0e8bc003465
/avatars/40563024267f5ca389b6d24d8c83c704.svg
Zhehao Zhang
user
zzh12138
672849f29b9d58f33ed9c3c1
Ryan A. Rossi
admin_assigned
2024-11-04T14:25:09.499Z
62a3ab83e4dd6252344d27cd
/avatars/7ca8510f70a58dc207b104240e30c35c.svg
Ryan A. Rossi
user
ryanrossi
672849f29b9d58f33ed9c3c2
Branislav Kveton
672849f29b9d58f33ed9c3c3
Yijia Shao
admin_assigned
2024-11-04T17:01:03.163Z
6171514808b4ddb7392f2eb0
https://cdn-avatars.huggingface.co/v1/production/uploads/6171514808b4ddb7392f2eb0/6TjLoLeKwos0JoGcTueeI.jpeg
Yijia Shao
user
EchoShao8899
672849f29b9d58f33ed9c3c4
Diyi Yang
672849f29b9d58f33ed9c3c5
Hamed Zamani
672849f29b9d58f33ed9c3c6
Franck Dernoncourt
claimed_verified
2024-11-04T09:35:53.045Z
62c5947524171688a9feb992
/avatars/5a151713b9eae8dc566f5957acee3475.svg
Franck Dernoncourt
user
Franck-Dernoncourt
672849f29b9d58f33ed9c3c7
Joe Barrow
admin_assigned
2024-11-04T17:06:42.701Z
64b71b089ebb7e6c7dce4d38
/avatars/b5601682b6500f30369ad7660e88bb55.svg
Joe Barrow
user
jbarrow
672849f29b9d58f33ed9c3c8
Tong Yu
672849f29b9d58f33ed9c3c9
Sungchul Kim
admin_assigned
2024-11-04T17:09:16.533Z
6250611d2f9acc6168e42737
/avatars/1e053d3fa387d81b45a2435e4a633ad1.svg
Sungchul Kim
user
subright
672849f29b9d58f33ed9c3ca
Ruiyi Zhang
admin_assigned
2024-11-04T17:09:43.428Z
64668f982da1abc242355cbb
/avatars/c9a248b8d70b1a8f7b78265c98690570.svg
Ruiyi Zhang
user
zhangry868
672849f29b9d58f33ed9c3cb
Jiuxiang Gu
admin_assigned
2024-11-04T17:10:29.066Z
642467708d97ce93878e8124
/avatars/f0e464ddb4bd790f470fc0f10275fa26.svg
Jiuxiang Gu
user
JoshuaGu
672849f29b9d58f33ed9c3cc
Tyler Derr
672849f29b9d58f33ed9c3cd
Hongjie Chen
672849f29b9d58f33ed9c3ce
Junda Wu
admin_assigned
2024-11-04T17:08:23.829Z
616c0cd640e2f69baa1c7adf
/avatars/9ad6ada73b3fb2d5fb696ec91f8edb1b.svg
Junda Wu
user
JoshuaW1997
672849f29b9d58f33ed9c3cf
Xiang Chen
admin_assigned
2024-11-04T17:07:42.337Z
64c073417255ff868721fb54
/avatars/c2a00114598aa89f071b937f0af4077f.svg
Xiang CHEN
user
xiangchen-dvi
672849f29b9d58f33ed9c3d0
Zichao Wang
admin_assigned
2024-11-04T17:07:33.074Z
65927de243edad216977754e
/avatars/b1b41bfe8a9066f0450e806cd2252225.svg
wangzichao
user
wangzichao2018
672849f29b9d58f33ed9c3d1
Subrata Mitra
admin_assigned
2024-11-04T17:07:20.658Z
664d2ecd567cb471effcde31
/avatars/c99296e5d4a172de739e378b67fcc51d.svg
Subrata M
user
subratam
672849f29b9d58f33ed9c3d2
Nedim Lipka
672849f29b9d58f33ed9c3d3
Nesreen Ahmed
admin_assigned
2024-11-04T17:07:02.327Z
663e588ccca86c8371a913d9
https://cdn-avatars.huggingface.co/v1/production/uploads/663e588ccca86c8371a913d9/wgVGw5U77cqwtjovhsXyR.jpeg
Nesreen Ahmed
user
nkahmed
672849f29b9d58f33ed9c3d4
Yu Wang
Personalization of Large Language Models: A Survey
Personalization of Large Language Models (LLMs) has recently become
increasingly important with a wide range of applications. Despite the
importance and recent progress, most existing works on personalized LLMs have
focused either entirely on (a) personalized text generation or (b) leveraging
LLMs for personalization-related downstream applications, such as
recommendation systems. In this work, we bridge the gap between these two
separate main directions for the first time by introducing a taxonomy for
personalized LLM usage and summarizing the key differences and challenges. We
provide a formalization of the foundations of personalized LLMs that
consolidates and expands notions of personalization of LLMs, defining and
discussing novel facets of personalization, usage, and desiderata of
personalized LLMs. We then unify the literature across these diverse fields and
usage scenarios by proposing systematic taxonomies for the granularity of
personalization, personalization techniques, datasets, evaluation methods, and
applications of personalized LLMs. Finally, we highlight challenges and
important open problems that remain to be addressed. By unifying and surveying
recent research using the proposed taxonomies, we aim to provide a clear guide
to the existing literature and different facets of personalization in LLMs,
empowering both researchers and practitioners.
A taxonomy is introduced to bridge the gap between personalized text generation and personalization in LLMs for downstream applications, providing a comprehensive view of personalization techniques, datasets, and challenges.
Large Language Models (LLMs) personalized text generation recommendation systems taxonomy personalization techniques datasets evaluation methods applications