DNAGPT: A Generalized Pre-trained Tool for Versatile DNA Sequence
  Analysis Tasks
Pre-trained large language models demonstrate potential in extracting
information from DNA sequences, yet adapting to a variety of tasks and data
modalities remains a challenge. To address this, we propose DNAGPT, a
generalized DNA pre-training model trained on over 200 billion base pairs from
all mammals. By enhancing the classic GPT model with a binary classification
task (DNA sequence order), a numerical regression task (guanine-cytosine
content prediction), and a comprehensive token language, DNAGPT can handle
versatile DNA analysis tasks while processing both sequence and numerical data.
Our evaluation of genomic signal and region recognition, mRNA abundance
regression, and artificial genomes generation tasks demonstrates DNAGPT's
superior performance compared to existing models designed for specific
downstream tasks, benefiting from pre-training using the newly designed model
structure.
64af7ecde1a1a94474dcbc33
Daoan Zhang
claimed_verified
2024-10-30T09:57:14.328Z
64ee52837ce493905c82bed5
/avatars/1f9f0db4eee887f9ed03dffc8c36ea23.svg
DaoanZhang
user
DwanZhang
64af7ecde1a1a94474dcbc34
Weitong Zhang
64af7ecde1a1a94474dcbc35
Bing He
64af7ecde1a1a94474dcbc36
Jianguo Zhang
64af7ecde1a1a94474dcbc37
Chenchen Qin
64af7ecde1a1a94474dcbc38
Jianhua Yao
DNAGPT: A Generalized Pre-trained Tool for Versatile DNA Sequence
  Analysis Tasks
Pre-trained large language models demonstrate potential in extracting
information from DNA sequences, yet adapting to a variety of tasks and data
modalities remains a challenge. To address this, we propose DNAGPT, a
generalized DNA pre-training model trained on over 200 billion base pairs from
all mammals. By enhancing the classic GPT model with a binary classification
task (DNA sequence order), a numerical regression task (guanine-cytosine
content prediction), and a comprehensive token language, DNAGPT can handle
versatile DNA analysis tasks while processing both sequence and numerical data.
Our evaluation of genomic signal and region recognition, mRNA abundance
regression, and artificial genomes generation tasks demonstrates DNAGPT's
superior performance compared to existing models designed for specific
downstream tasks, benefiting from pre-training using the newly designed model
structure.
DNAGPT is a generalized pre-trained model for DNA analysis that excels in various tasks through enhanced GPT architecture and diverse training objectives.
GPT binary classification numerical regression token language genomic signal region recognition mRNA abundance regression artificial genomes generation