TCIA: A Task-Centric Instruction Augmentation Method for Instruction
  Finetuning
Diverse instruction data is vital for effective instruction tuning of large
language models, as it enables the model to generalize across different types
of inputs . Building such diversified instruction dataset is an essential step
in this process. Existing approaches often leverage large language models to
automatically explore and generate diverse instructions, ensuring both data
diversity and quality. However, they tend to overlook an important factor in
real-world applications: on-task relevance. In practice, only a few real-world
applications require a truly general-purpose model; most benefit from
task-specific knowledge tailored to their particular use case. Therefore, it is
vital to develop instruction augmentation methods that not only maintain
diversity but are also optimized for specific, real-world scenarios.
  We thus introduce Task Centric Instruction Augmentation (TCIA), a framework
that systematically expands instructions while preserving both diversity and
task alignment. By representing instructions in a discrete query-constraints
space, TCIA creates a rich set of task-relevant instructions and enables models
to generalize to these task-specific instructions without sacrificing overall
performance. Experiments show that TCIA improves open-source LLMs' performance
by an average of 8.7% across four real-world, task-specific applications, and
in some cases outperforming leading closed-source models. These improvements do
not compromise general instruction-following ability, making TCIA a scalable
and efficient solution for adapting LLMs to real-world, task-focused
applications.
68b11ef0b19c5400014849ae
Simin Ma
68b11ef0b19c5400014849af
Shujian Liu
claimed_verified
2025-08-29T08:01:45.976Z
67d0574cc2ef59a2ab641b80
/avatars/31362733e6b8e745ac3d0586909a7d55.svg
Shujian
user
shujian2025
68b11ef0b19c5400014849b0
Jun Tan
68b11ef0b19c5400014849b1
Yebowen Hu
claimed_verified
2025-08-29T08:01:41.414Z
61638ee4877577e50b485cd4
https://cdn-avatars.huggingface.co/v1/production/uploads/1633914587203-noauth.jpeg
Yebowen Hu
user
huuuyeah
68b11ef0b19c5400014849b2
Song Wang
claimed_verified
2025-08-29T08:01:38.795Z
624be9911fb0c140d4e8768a
/avatars/fe8a253f2f4fcdf9c60eead7bb90180a.svg
SongW
user
songwang41
68b11ef0b19c5400014849b3
Sathish Reddy Indurthi
68b11ef0b19c5400014849b4
Sanqiang Zhao
68b11ef0b19c5400014849b5
Liwei Wu
68b11ef0b19c5400014849b6
Jianbing Han
68b11ef0b19c5400014849b7
Kaiqiang Song
claimed_verified
2025-08-29T08:01:43.795Z
63a261f13c003e409322c191
/avatars/dc4be6ce1983d0d32620275df124fe45.svg
Kaiqiang Song
user
kqsong
TCIA: A Task-Centric Instruction Augmentation Method for Instruction
  Finetuning
Diverse instruction data is vital for effective instruction tuning of large
language models, as it enables the model to generalize across different types
of inputs . Building such diversified instruction dataset is an essential step
in this process. Existing approaches often leverage large language models to
automatically explore and generate diverse instructions, ensuring both data
diversity and quality. However, they tend to overlook an important factor in
real-world applications: on-task relevance. In practice, only a few real-world
applications require a truly general-purpose model; most benefit from
task-specific knowledge tailored to their particular use case. Therefore, it is
vital to develop instruction augmentation methods that not only maintain
diversity but are also optimized for specific, real-world scenarios.
  We thus introduce Task Centric Instruction Augmentation (TCIA), a framework
that systematically expands instructions while preserving both diversity and
task alignment. By representing instructions in a discrete query-constraints
space, TCIA creates a rich set of task-relevant instructions and enables models
to generalize to these task-specific instructions without sacrificing overall
performance. Experiments show that TCIA improves open-source LLMs' performance
by an average of 8.7% across four real-world, task-specific applications, and
in some cases outperforming leading closed-source models. These improvements do
not compromise general instruction-following ability, making TCIA a scalable
and efficient solution for adapting LLMs to real-world, task-focused
applications.
Task Centric Instruction Augmentation (TCIA) enhances large language models' performance on specific tasks while maintaining general instruction-following ability.
instruction tuning large language models instruction dataset data diversity task-specific knowledge instruction augmentation discrete query-constraints space task-relevant instructions open-source LLMs closed-source models