readme: update bib entry and links - GENA in NAR
Browse files
README.md
CHANGED
|
@@ -19,7 +19,7 @@ Differences between GENA-LM (`gena-lm-bigbird-base-sparse-t2t`) and DNABERT:
|
|
| 19 |
|
| 20 |
Source code and data: https://github.com/AIRI-Institute/GENA_LM
|
| 21 |
|
| 22 |
-
Paper: https://
|
| 23 |
|
| 24 |
## Installation
|
| 25 |
`gena-lm-bigbird-base-sparse-t2t` sparse ops require DeepSpeed.
|
|
@@ -103,19 +103,22 @@ GENA-LM (`gena-lm-bigbird-base-sparse-t2t`) model is trained in a masked languag
|
|
| 103 |
We pre-trained `gena-lm-bigbird-base-sparse-t2t` using the latest T2T human genome assembly (https://www.ncbi.nlm.nih.gov/assembly/GCA_009914755.3/). The data was augmented by sampling mutations from 1000-genome SNPs (gnomAD dataset). Pre-training was performed for 800,000 iterations with batch size 256. We modified Transformer with [Pre-Layer normalization](https://arxiv.org/abs/2002.04745).
|
| 104 |
|
| 105 |
## Evaluation
|
| 106 |
-
For evaluation results, see our paper: https://
|
| 107 |
|
| 108 |
## Citation
|
| 109 |
```bibtex
|
| 110 |
@article{GENA_LM,
|
| 111 |
-
|
| 112 |
-
|
| 113 |
-
|
| 114 |
-
|
| 115 |
-
|
| 116 |
-
|
| 117 |
-
|
| 118 |
-
|
| 119 |
-
|
|
|
|
|
|
|
|
|
|
| 120 |
}
|
| 121 |
```
|
|
|
|
| 19 |
|
| 20 |
Source code and data: https://github.com/AIRI-Institute/GENA_LM
|
| 21 |
|
| 22 |
+
Paper: https://academic.oup.com/nar/article/53/2/gkae1310/7954523
|
| 23 |
|
| 24 |
## Installation
|
| 25 |
`gena-lm-bigbird-base-sparse-t2t` sparse ops require DeepSpeed.
|
|
|
|
| 103 |
We pre-trained `gena-lm-bigbird-base-sparse-t2t` using the latest T2T human genome assembly (https://www.ncbi.nlm.nih.gov/assembly/GCA_009914755.3/). The data was augmented by sampling mutations from 1000-genome SNPs (gnomAD dataset). Pre-training was performed for 800,000 iterations with batch size 256. We modified Transformer with [Pre-Layer normalization](https://arxiv.org/abs/2002.04745).
|
| 104 |
|
| 105 |
## Evaluation
|
| 106 |
+
For evaluation results, see our paper: https://academic.oup.com/nar/article/53/2/gkae1310/7954523
|
| 107 |
|
| 108 |
## Citation
|
| 109 |
```bibtex
|
| 110 |
@article{GENA_LM,
|
| 111 |
+
author = {Fishman, Veniamin and Kuratov, Yuri and Shmelev, Aleksei and Petrov, Maxim and Penzar, Dmitry and Shepelin, Denis and Chekanov, Nikolay and Kardymon, Olga and Burtsev, Mikhail},
|
| 112 |
+
title = {GENA-LM: a family of open-source foundational DNA language models for long sequences},
|
| 113 |
+
journal = {Nucleic Acids Research},
|
| 114 |
+
volume = {53},
|
| 115 |
+
number = {2},
|
| 116 |
+
pages = {gkae1310},
|
| 117 |
+
year = {2025},
|
| 118 |
+
month = {01},
|
| 119 |
+
issn = {0305-1048},
|
| 120 |
+
doi = {10.1093/nar/gkae1310},
|
| 121 |
+
url = {https://doi.org/10.1093/nar/gkae1310},
|
| 122 |
+
eprint = {https://academic.oup.com/nar/article-pdf/53/2/gkae1310/61443229/gkae1310.pdf},
|
| 123 |
}
|
| 124 |
```
|