Plutus: Benchmarking Large Language Models in Low-Resource Greek Finance
Despite Greece's pivotal role in the global economy, large language models
(LLMs) remain underexplored for Greek financial context due to the linguistic
complexity of Greek and the scarcity of domain-specific datasets. Previous
efforts in multilingual financial natural language processing (NLP) have
exposed considerable performance disparities, yet no dedicated Greek financial
benchmarks or Greek-specific financial LLMs have been developed until now. To
bridge this gap, we introduce Plutus-ben, the first Greek Financial Evaluation
Benchmark, and Plutus-8B, the pioneering Greek Financial LLM, fine-tuned with
Greek domain-specific data. Plutus-ben addresses five core financial NLP tasks
in Greek: numeric and textual named entity recognition, question answering,
abstractive summarization, and topic classification, thereby facilitating
systematic and reproducible LLM assessments. To underpin these tasks, we
present three novel, high-quality Greek financial datasets, thoroughly
annotated by expert native Greek speakers, augmented by two existing resources.
Our comprehensive evaluation of 22 LLMs on Plutus-ben reveals that Greek
financial NLP remains challenging due to linguistic complexity, domain-specific
terminology, and financial reasoning gaps. These findings underscore the
limitations of cross-lingual transfer, the necessity for financial expertise in
Greek-trained models, and the challenges of adapting financial LLMs to Greek
text. We release Plutus-ben, Plutus-8B, and all associated datasets publicly to
promote reproducible research and advance Greek financial NLP, fostering
broader multilingual inclusivity in finance.
67bfc297ca6e3c22b6d99c78
Xueqing Peng
claimed_verified
2025-06-03T08:55:40.500Z
63a0c0803c8841cfe2cd1f15
/avatars/bbe216db7a33612f23d23ce4ed4ba3f9.svg
Xueqing Peng
user
Xueqing
67bfc297ca6e3c22b6d99c79
Triantafillos Papadopoulos
67bfc297ca6e3c22b6d99c7a
Efstathia Soufleri
extracted_confirmed
2025-03-27T12:32:14.175Z
66f2bdfc6b77fc07fa2b6266
https://cdn-avatars.huggingface.co/v1/production/uploads/66f2bdfc6b77fc07fa2b6266/LC764XEIYbSmln4ncl3CQ.jpeg
Efstathia Soufleri
user
esoufleri
67bfc297ca6e3c22b6d99c7b
Polydoros Giannouris
claimed_verified
2025-02-28T13:24:53.698Z
673354dc5b8d4dccb4da9b63
/avatars/ae6bd67a1d93fee89bf5c576fd8ddc39.svg
Polydoros Giannouris
user
PolydorosG
67bfc297ca6e3c22b6d99c7c
Ruoyu Xiang
67bfc297ca6e3c22b6d99c7d
Yan Wang
claimed_verified
2025-05-28T19:15:16.758Z
65d76cc5b9b7b8bf88faa916
/avatars/d95232cd0c307efab6197ade1a66190b.svg
Yan Wang
user
YanAdjeNole
67bfc297ca6e3c22b6d99c7e
Lingfei Qian
claimed_verified
2025-06-11T20:21:32.069Z
65d50fd888f4a90589017398
/avatars/5e58259399ffe0d4e2e5a8c81fe65b30.svg
Lingfei Qian
user
lfqian
67bfc297ca6e3c22b6d99c7f
Jimin Huang
extracted_pending
2025-02-27T01:40:40.189Z
63b58ed5889aa6707f0bb0f4
https://cdn-avatars.huggingface.co/v1/production/uploads/63b58ed5889aa6707f0bb0f4/znl74_aMswlV8VtHrfj3G.jpeg
Jimin Huang
user
jiminHuang
67bfc297ca6e3c22b6d99c80
Qianqian Xie
67bfc297ca6e3c22b6d99c81
Sophia Ananiadou
Plutus: Benchmarking Large Language Models in Low-Resource Greek Finance
Despite Greece's pivotal role in the global economy, large language models
(LLMs) remain underexplored for Greek financial context due to the linguistic
complexity of Greek and the scarcity of domain-specific datasets. Previous
efforts in multilingual financial natural language processing (NLP) have
exposed considerable performance disparities, yet no dedicated Greek financial
benchmarks or Greek-specific financial LLMs have been developed until now. To
bridge this gap, we introduce Plutus-ben, the first Greek Financial Evaluation
Benchmark, and Plutus-8B, the pioneering Greek Financial LLM, fine-tuned with
Greek domain-specific data. Plutus-ben addresses five core financial NLP tasks
in Greek: numeric and textual named entity recognition, question answering,
abstractive summarization, and topic classification, thereby facilitating
systematic and reproducible LLM assessments. To underpin these tasks, we
present three novel, high-quality Greek financial datasets, thoroughly
annotated by expert native Greek speakers, augmented by two existing resources.
Our comprehensive evaluation of 22 LLMs on Plutus-ben reveals that Greek
financial NLP remains challenging due to linguistic complexity, domain-specific
terminology, and financial reasoning gaps. These findings underscore the
limitations of cross-lingual transfer, the necessity for financial expertise in
Greek-trained models, and the challenges of adapting financial LLMs to Greek
text. We release Plutus-ben, Plutus-8B, and all associated datasets publicly to
promote reproducible research and advance Greek financial NLP, fostering
broader multilingual inclusivity in finance.
The first Greek Financial Evaluation Benchmark (Plutus-ben) and Greek Financial LLM (Plutus-8B) address the challenges of financial NLP in Greek due to linguistic complexity and lack of domain-specific data.
large language models multilingual financial natural language processing Greek Financial Evaluation Benchmark Greek Financial LLM named entity recognition question answering abstractive summarization topic classification Greek financial datasets cross-lingual transfer financial expertise