Update README.md
Browse files
README.md
CHANGED
|
@@ -6,9 +6,9 @@ tags:
|
|
| 6 |
- DNA
|
| 7 |
---
|
| 8 |
|
| 9 |
-
# Model Card for Mistral-DNA-v1-
|
| 10 |
|
| 11 |
-
The Mistral-DNA-v1-
|
| 12 |
It is derived from Mixtral-8x7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
| 13 |
The model was pretrained using 10kb DNA sequences from 5 cow race genome assemblies.
|
| 14 |
|
|
@@ -26,8 +26,8 @@ Like Mixtral-8x7B-v0.1, it is a transformer model, with the following architectu
|
|
| 26 |
import torch
|
| 27 |
from transformers import AutoTokenizer, AutoModel
|
| 28 |
|
| 29 |
-
tokenizer = AutoTokenizer.from_pretrained("RaphaelMourad/Mistral-DNA-v1-
|
| 30 |
-
model = AutoModel.from_pretrained("RaphaelMourad/Mistral-DNA-v1-
|
| 31 |
```
|
| 32 |
|
| 33 |
## Calculate the embedding of a DNA sequence
|
|
@@ -48,7 +48,7 @@ Ensure you are utilizing a stable version of Transformers, 4.34.0 or newer.
|
|
| 48 |
|
| 49 |
## Notice
|
| 50 |
|
| 51 |
-
Mistral-DNA-v1-
|
| 52 |
|
| 53 |
## Contact
|
| 54 |
|
|
|
|
| 6 |
- DNA
|
| 7 |
---
|
| 8 |
|
| 9 |
+
# Model Card for Mistral-DNA-v1-17M-cow-5races (Mistral for DNA)
|
| 10 |
|
| 11 |
+
The Mistral-DNA-v1-17M-cow-5races Large Language Model (LLM) is a pretrained generative DNA sequence model with 138M parameters.
|
| 12 |
It is derived from Mixtral-8x7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
| 13 |
The model was pretrained using 10kb DNA sequences from 5 cow race genome assemblies.
|
| 14 |
|
|
|
|
| 26 |
import torch
|
| 27 |
from transformers import AutoTokenizer, AutoModel
|
| 28 |
|
| 29 |
+
tokenizer = AutoTokenizer.from_pretrained("RaphaelMourad/Mistral-DNA-v1-17M-cow-5races", trust_remote_code=True)
|
| 30 |
+
model = AutoModel.from_pretrained("RaphaelMourad/Mistral-DNA-v1-17M-cow-5races", trust_remote_code=True)
|
| 31 |
```
|
| 32 |
|
| 33 |
## Calculate the embedding of a DNA sequence
|
|
|
|
| 48 |
|
| 49 |
## Notice
|
| 50 |
|
| 51 |
+
Mistral-DNA-v1-17M-cow-5races is a pretrained base model for DNA.
|
| 52 |
|
| 53 |
## Contact
|
| 54 |
|