LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models
Efficient fine-tuning is vital for adapting large language models (LLMs) to
downstream tasks. However, it requires non-trivial efforts to implement these
methods on different models. We present LlamaFactory, a unified framework that
integrates a suite of cutting-edge efficient training methods. It allows users
to flexibly customize the fine-tuning of 100+ LLMs without the need for coding
through the built-in web UI LlamaBoard. We empirically validate the efficiency
and effectiveness of our framework on language modeling and text generation
tasks. It has been released at https://github.com/hiyouga/LLaMA-Factory and
already received over 13,000 stars and 1,600 forks.
65fbae8adfd0ff86aa7a217a
Yaowei Zheng
admin_assigned
2024-03-21T09:11:34.746Z
642fef28a043f0ac7defa8a9
https://cdn-avatars.huggingface.co/v1/production/uploads/642fef28a043f0ac7defa8a9/RwOEkuj3fOnOA54tGR7Ea.png
Yaowei Zheng
user
hiyouga
65fbae8adfd0ff86aa7a217b
Richong Zhang
65fbae8adfd0ff86aa7a217c
Junhao Zhang
admin_assigned
2024-03-21T09:33:46.449Z
6524d66966ebe0519873c4c5
/avatars/18a52cf9cf90f9ff309284a1c9cae6ac.svg
Junhao Zhang
user
OnlyAR
65fbae8adfd0ff86aa7a217d
Yanhan Ye
claimed_verified
2024-03-21T10:02:39.082Z
65fc00206529e3fcc230b820
https://cdn-avatars.huggingface.co/v1/production/uploads/65fc00206529e3fcc230b820/IeZjMvHYZeZn8-igQ45R8.jpeg
Yanhan Ye
user
CoolColoury
65fbae8adfd0ff86aa7a217e
Zheyan Luo
LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models
Efficient fine-tuning is vital for adapting large language models (LLMs) to
downstream tasks. However, it requires non-trivial efforts to implement these
methods on different models. We present LlamaFactory, a unified framework that
integrates a suite of cutting-edge efficient training methods. It allows users
to flexibly customize the fine-tuning of 100+ LLMs without the need for coding
through the built-in web UI LlamaBoard. We empirically validate the efficiency
and effectiveness of our framework on language modeling and text generation
tasks. It has been released at https://github.com/hiyouga/LLaMA-Factory and
already received over 13,000 stars and 1,600 forks.
LlamaFactory is a unified framework enabling efficient fine-tuning of large language models across various tasks using a web-based user interface.
efficient fine-tuning large language models LLaMA LlamaFactory LlamaBoard language modeling text generation