yurakuratov
commited on
readme: update bib entry and links - GENA in NAR
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ Differences between GENA-LM (`gena-lm-bert-base-lastln-t2t-lastln-t2t`) and DNAB
|
|
17 |
|
18 |
Source code and data: https://github.com/AIRI-Institute/GENA_LM
|
19 |
|
20 |
-
Paper: https://
|
21 |
|
22 |
## Examples
|
23 |
|
@@ -73,20 +73,23 @@ GENA-LM (`gena-lm-bert-base-lastln-t2t-lastln-t2t`) model is trained in a masked
|
|
73 |
We pre-trained `gena-lm-bert-base-lastln-t2t-lastln-t2t` using the latest T2T human genome assembly (https://www.ncbi.nlm.nih.gov/assembly/GCA_009914755.3/). The data was augmented by sampling mutations from 1000-genome SNPs (gnomAD dataset). Pre-training was performed for 2,100,000 iterations with batch size 256 and sequence length was equal to 512 tokens. We modified Transformer with [Pre-Layer normalization](https://arxiv.org/abs/2002.04745).
|
74 |
|
75 |
## Evaluation
|
76 |
-
For evaluation results, see our paper: https://
|
77 |
|
78 |
|
79 |
## Citation
|
80 |
```bibtex
|
81 |
@article{GENA_LM,
|
82 |
-
|
83 |
-
|
84 |
-
|
85 |
-
|
86 |
-
|
87 |
-
|
88 |
-
|
89 |
-
|
90 |
-
|
|
|
|
|
|
|
91 |
}
|
92 |
```
|
|
|
17 |
|
18 |
Source code and data: https://github.com/AIRI-Institute/GENA_LM
|
19 |
|
20 |
+
Paper: https://academic.oup.com/nar/article/53/2/gkae1310/7954523
|
21 |
|
22 |
## Examples
|
23 |
|
|
|
73 |
We pre-trained `gena-lm-bert-base-lastln-t2t-lastln-t2t` using the latest T2T human genome assembly (https://www.ncbi.nlm.nih.gov/assembly/GCA_009914755.3/). The data was augmented by sampling mutations from 1000-genome SNPs (gnomAD dataset). Pre-training was performed for 2,100,000 iterations with batch size 256 and sequence length was equal to 512 tokens. We modified Transformer with [Pre-Layer normalization](https://arxiv.org/abs/2002.04745).
|
74 |
|
75 |
## Evaluation
|
76 |
+
For evaluation results, see our paper: https://academic.oup.com/nar/article/53/2/gkae1310/7954523
|
77 |
|
78 |
|
79 |
## Citation
|
80 |
```bibtex
|
81 |
@article{GENA_LM,
|
82 |
+
author = {Fishman, Veniamin and Kuratov, Yuri and Shmelev, Aleksei and Petrov, Maxim and Penzar, Dmitry and Shepelin, Denis and Chekanov, Nikolay and Kardymon, Olga and Burtsev, Mikhail},
|
83 |
+
title = {GENA-LM: a family of open-source foundational DNA language models for long sequences},
|
84 |
+
journal = {Nucleic Acids Research},
|
85 |
+
volume = {53},
|
86 |
+
number = {2},
|
87 |
+
pages = {gkae1310},
|
88 |
+
year = {2025},
|
89 |
+
month = {01},
|
90 |
+
issn = {0305-1048},
|
91 |
+
doi = {10.1093/nar/gkae1310},
|
92 |
+
url = {https://doi.org/10.1093/nar/gkae1310},
|
93 |
+
eprint = {https://academic.oup.com/nar/article-pdf/53/2/gkae1310/61443229/gkae1310.pdf},
|
94 |
}
|
95 |
```
|