The Impact of Copyrighted Material on Large Language Models: A Norwegian
  Perspective
The use of copyrighted materials in training generative language models
raises critical legal and ethical questions. This paper presents a framework
for and the results of empirically assessing the impact of copyrighted
materials on the performance of large language models (LLMs) for Norwegian. We
found that both books and newspapers contribute positively when the models are
evaluated on a diverse set of Norwegian benchmarks, while fiction works
possibly lead to decreased performance. Our experiments could inform the
creation of a compensation scheme for authors whose works contribute to AI
development.
675be4b8f005d9ae8b86a802
Javier de la Rosa
claimed_verified
2024-12-13T15:15:36.269Z
5ef3829e518622264685b0cd
https://cdn-avatars.huggingface.co/v1/production/uploads/1593016943046-noauth.jpeg
Javier de la Rosa
user
versae
675be4b8f005d9ae8b86a803
Vladislav Mikhailov
admin_assigned
2024-12-16T10:54:09.144Z
630dd441c0eca3037afcfe8e
/avatars/a7f6e6dcec9b23808360f33e816c65e8.svg
Vladislav Mikhailov
user
vmkhlv
675be4b8f005d9ae8b86a804
Lemei Zhang
admin_assigned
2024-12-16T10:54:16.356Z
63a2fac7c8a2aa5d9e870904
/avatars/9474406e385f37e69ca712661bf3b937.svg
Lemei Zhang
user
lemei
675be4b8f005d9ae8b86a805
Freddy Wetjen
admin_assigned
2024-12-16T10:54:24.348Z
60c7c8507d0e2aa24b5bddec
/avatars/e6b382ca64afb68f114f7184a078d6db.svg
freddy wetjen
user
freddy
675be4b8f005d9ae8b86a806
David Samuel
admin_assigned
2024-12-16T10:54:46.700Z
63f3bef6520c1461892aca4e
https://cdn-avatars.huggingface.co/v1/production/uploads/63f3bef6520c1461892aca4e/Kh2xFsySz5Y2ZyjUkFO8E.jpeg
David Samuel
user
Davidsamuel101
675be4b8f005d9ae8b86a807
Peng Liu
675be4b8f005d9ae8b86a808
Rolv-Arild Braaten
admin_assigned
2024-12-16T10:55:18.303Z
618267afea117aaafc040790
https://cdn-avatars.huggingface.co/v1/production/uploads/618267afea117aaafc040790/F68eFRDJZMdYk1SwTPMt5.png
Rolv-Arild
user
Rolv-Arild
675be4b8f005d9ae8b86a809
Petter Mæhlum
admin_assigned
2024-12-16T10:55:24.980Z
636e2d018ba65db4a0945f3f
https://cdn-avatars.huggingface.co/v1/production/uploads/636e2d018ba65db4a0945f3f/ofTREKEb7Jb1iZXVxp4UI.jpeg
Petter Mæhlum
user
pettemae
675be4b8f005d9ae8b86a80a
Magnus Breder Birkenes
admin_assigned
2024-12-16T10:55:30.664Z
65dc7bc3c5f46bf23b06b2e8
/avatars/d0e7146ed2b9976999c455ef938271f3.svg
Magnus Breder Birkenes
user
magbb
675be4b8f005d9ae8b86a80b
Andrey Kutuzov
675be4b8f005d9ae8b86a80c
Tita Enstad
admin_assigned
2024-12-16T10:55:40.380Z
65bbb74634050a925a5ef2b1
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/Bw965jRtgpDc9_SRVml_g.png
Tita Enstad
user
titae
675be4b8f005d9ae8b86a80d
Svein Arne Brygfjeld
admin_assigned
2024-12-16T10:55:47.937Z
5fd88f3a6ad187936c447ece
/avatars/e0fe01780a7823e9ab7eded3bf56536e.svg
Svein Arne Brygfjeld
user
Brygfjeld
675be4b8f005d9ae8b86a80e
Jon Atle Gulla
admin_assigned
2024-12-16T10:55:54.040Z
6656eabd72362ed320443d17
/avatars/3831e8bd3e62b42192af16d27212d84c.svg
Jon Atle Gulla
user
jonatlegulla
675be4b8f005d9ae8b86a80f
Stephan Oepen
admin_assigned
2024-12-16T10:55:59.862Z
650d4fc5ced77e2bacb914a2
/avatars/2f4c63a58e1561a8a58daccc40e99cda.svg
Stephan Oepen
user
oepen
675be4b8f005d9ae8b86a810
Erik Velldal
admin_assigned
2024-12-16T10:56:05.529Z
63ef69c804b0e373992a4f20
/avatars/c337721bc79c852a6dad90140891cdc4.svg
Erik Velldal
user
erikve
675be4b8f005d9ae8b86a811
Wilfred Østgulen
admin_assigned
2024-12-16T10:56:11.274Z
66fd3fe6af63bfe2be1d75e9
/avatars/eabf00b493411bad38a28894d68123a5.svg
Wilfred Østgulen
user
wildpeace
675be4b8f005d9ae8b86a812
Liljia Øvrelid
675be4b8f005d9ae8b86a813
Aslak Sira Myhre
The Impact of Copyrighted Material on Large Language Models: A Norwegian
  Perspective
The use of copyrighted materials in training generative language models
raises critical legal and ethical questions. This paper presents a framework
for and the results of empirically assessing the impact of copyrighted
materials on the performance of large language models (LLMs) for Norwegian. We
found that both books and newspapers contribute positively when the models are
evaluated on a diverse set of Norwegian benchmarks, while fiction works
possibly lead to decreased performance. Our experiments could inform the
creation of a compensation scheme for authors whose works contribute to AI
development.
Empirical evaluation shows that using-books and newspapers in training large language models for Norwegian improves performance, whereas fiction works may decrease it.
large language models LLMs