gbrixi commited on
Commit
65a220d
·
verified ·
1 Parent(s): 08e5d38

Add README

Browse files
Files changed (1) hide show
  1. README.md +55 -0
README.md ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - stripedhyena
5
+ - long context
6
+ - deep signal processing
7
+ - hybrid
8
+ - biology
9
+ - genomics
10
+ - phage
11
+ - microviridae
12
+ ---
13
+
14
+ # Evo 1 - Microviridae
15
+
16
+ <p align="center">
17
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/62a1306bbe7fa896d2c8de44/JoEHcvLTUlHoMcgh3mmAz.png" width="70%" />
18
+ </p>
19
+
20
+ ## About
21
+
22
+ This is a fine-tuned version of Evo 1, a biological foundation model capable of long-context modeling and design, specifically adapted for Microviridae phage sequences.
23
+
24
+ Evo uses the [StripedHyena architecture](https://github.com/togethercomputer/stripedhyena) to enable modeling of sequences at a single-nucleotide, byte-level resolution with near-linear scaling of compute and memory relative to context length.
25
+
26
+ ## Model Details
27
+
28
+ - **Base Model**: Evo 1 7B 131K base
29
+ - **Fine-tuning**: 5,000 steps on Microviridae bacteriophage genomes
30
+ - **Architecture**: StripedHyena
31
+ - **Context Length**: 131,072 tokens
32
+ - **Parameters**: 7B
33
+
34
+ ## Usage
35
+
36
+ This model uses the StripedHyena architecture. For loading and generation, please refer to the [Evo repository](https://github.com/evo-design/evo).
37
+
38
+ ```python
39
+ # Example usage with Evo framework
40
+ from evo import Evo
41
+
42
+ # Load base model and apply fine-tuned weights
43
+ model = Evo('evo-1-131k-base')
44
+ # Load the fine-tuned checkpoint
45
+ checkpoint = torch.load('pytorch_model.bin')
46
+ model.load_state_dict(checkpoint)
47
+ ```
48
+
49
+ ## Training
50
+
51
+ Fine-tuned from `evo-1-131k-base` on Microviridae phage sequences for 5,000 steps.
52
+
53
+ ## License
54
+
55
+ Apache 2.0