Leveraging Open Knowledge for Advancing Task Expertise in Large Language
  Models
The cultivation of expertise for large language models (LLMs) to solve tasks
of specific areas often requires special-purpose tuning with calibrated
behaviors on the expected stable outputs. To avoid huge cost brought by manual
preparation of instruction datasets and training resources up to hundreds of
hours, the exploitation of open knowledge including a wealth of low rank
adaptation (LoRA) models and instruction datasets serves as a good starting
point. However, existing methods on model and data selection focus on the
performance of general-purpose capabilities while neglecting the knowledge gap
exposed in domain-specific deployment. In the present study, we propose to
bridge such gap by introducing few human-annotated samples (i.e., K-shot) for
advancing task expertise of LLMs with open knowledge. Specifically, we develop
an efficient and scalable pipeline to cost-efficiently produce task experts
where K-shot data intervene in selecting the most promising expert candidates
and the task-relevant instructions. A mixture-of-expert (MoE) system is built
to make the best use of individual-yet-complementary knowledge between multiple
experts. We unveil the two keys to the success of a MoE system, 1) the abidance
by K-shot, and 2) the insistence on diversity. For the former, we ensure that
models that truly possess problem-solving abilities on K-shot are selected
rather than those blind guessers. Besides, during data selection, instructions
that share task-relevant contexts with K-shot are prioritized. For the latter,
we highlight the diversity of constituting experts and that of the fine-tuning
instructions throughout the model and data selection process. Extensive
experimental results confirm the superiority of our approach over existing
methods on utilization of open knowledge across various tasks. Codes and models
will be released later.
66cfd6e1fa19e148bab3f534
Yuncheng Yang
66cfd6e1fa19e148bab3f535
Yulei Qin
extracted_confirmed
2024-08-29T02:03:46.581Z
6390525c00fb8ec4a424e0ff
/avatars/4302571e2ef4a9875491221aa630a329.svg
Yulei Qin
user
yolay
66cfd6e1fa19e148bab3f536
Tong Wu
66cfd6e1fa19e148bab3f537
Zihan Xu
66cfd6e1fa19e148bab3f538
Gang Li
claimed_verified
2024-08-29T07:23:15.001Z
648c17fc17c7ceb9b4200d31
/avatars/abc5b025dd682935056c33a9e1e362f0.svg
Gang Li
user
ligang-cs
66cfd6e1fa19e148bab3f539
Pengcheng Guo
admin_assigned
2024-08-29T07:38:42.185Z
6177f7212a5804028ecc498a
/avatars/a2a8b88b818d5b9e6869c52a970f9a62.svg
Pengcheng Guo
user
pcguo
66cfd6e1fa19e148bab3f53a
Hang Shao
66cfd6e1fa19e148bab3f53b
Yucheng Shi
admin_assigned
2024-08-29T07:38:55.104Z
64beb6b6140491ca9f803ebf
/avatars/0daa2e813a13668b8b708cd8c12763d9.svg
Yucheng SHi
user
YuchengShi
66cfd6e1fa19e148bab3f53c
Ke Li
claimed_verified
2025-01-09T10:11:41.474Z
63280915eeee4dd858083092
/avatars/78347af4af42527d53e88d9969c5c934.svg
Ke Li
user
tristanli
66cfd6e1fa19e148bab3f53d
Xing Sun
claimed_verified
2025-08-18T07:01:54.145Z
647401e50da364bd0d002f2a
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/vPuPn7EV092mLBOM2YZXd.png
XING SUN
user
tedsun
66cfd6e1fa19e148bab3f53e
Jie Yang
66cfd6e1fa19e148bab3f53f
Yun Gu
extracted_pending
2025-05-08T02:24:36.692Z
681c15cb4e8877d583db8656
/avatars/517f4c88a714a1fbea394decb253045b.svg
yun
user
geron762
Leveraging Open Knowledge for Advancing Task Expertise in Large Language
  Models
The cultivation of expertise for large language models (LLMs) to solve tasks
of specific areas often requires special-purpose tuning with calibrated
behaviors on the expected stable outputs. To avoid huge cost brought by manual
preparation of instruction datasets and training resources up to hundreds of
hours, the exploitation of open knowledge including a wealth of low rank
adaptation (LoRA) models and instruction datasets serves as a good starting
point. However, existing methods on model and data selection focus on the
performance of general-purpose capabilities while neglecting the knowledge gap
exposed in domain-specific deployment. In the present study, we propose to
bridge such gap by introducing few human-annotated samples (i.e., K-shot) for
advancing task expertise of LLMs with open knowledge. Specifically, we develop
an efficient and scalable pipeline to cost-efficiently produce task experts
where K-shot data intervene in selecting the most promising expert candidates
and the task-relevant instructions. A mixture-of-expert (MoE) system is built
to make the best use of individual-yet-complementary knowledge between multiple
experts. We unveil the two keys to the success of a MoE system, 1) the abidance
by K-shot, and 2) the insistence on diversity. For the former, we ensure that
models that truly possess problem-solving abilities on K-shot are selected
rather than those blind guessers. Besides, during data selection, instructions
that share task-relevant contexts with K-shot are prioritized. For the latter,
we highlight the diversity of constituting experts and that of the fine-tuning
instructions throughout the model and data selection process. Extensive
experimental results confirm the superiority of our approach over existing
methods on utilization of open knowledge across various tasks. Codes and models
will be released later.
An efficient pipeline using few human-annotated samples and a mixture-of-experts system enhances the domain-specific capabilities of large language models with open knowledge.
large language models (LLMs) low rank adaptation (LoRA) few-shot learning (K-shot) mixture-of-experts (MoE) task expertise open knowledge model selection data selection diversity