Update README.md
Browse files
README.md
CHANGED
|
@@ -34,7 +34,7 @@ We release two adapted model versions:
|
|
| 34 |
These models are both trained on top of OLMo 1.7 7b 'Nitro':
|
| 35 |
| Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
|
| 36 |
|------|--------|---------|-------------|-----------------|----------------|
|
| 37 |
-
| [OLMo 1.7 7B](https://huggingface.co/allenai/OLMo-1.7-7B-hf) |
|
| 38 |
|
| 39 |
|
| 40 |
### Model Description
|
|
@@ -58,9 +58,7 @@ These models are both trained on top of OLMo 1.7 7b 'Nitro':
|
|
| 58 |
- Evaluation code: https://github.com/allenai/OLMo-Eval
|
| 59 |
- Further fine-tuning code: https://github.com/allenai/open-instruct
|
| 60 |
- **Paper:** [Link](https://arxiv.org/abs/2402.00838)
|
| 61 |
-
|
| 62 |
-
- **W&B Logs:** ?
|
| 63 |
-
<!-- - **Press release:** TODO -->
|
| 64 |
|
| 65 |
### Inference
|
| 66 |
|
|
|
|
| 34 |
These models are both trained on top of OLMo 1.7 7b 'Nitro':
|
| 35 |
| Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
|
| 36 |
|------|--------|---------|-------------|-----------------|----------------|
|
| 37 |
+
| [OLMo 1.7 7B](https://huggingface.co/allenai/OLMo-1.7-7B-hf) | 2.7T |32 | 4096 | 32 | 4096 |
|
| 38 |
|
| 39 |
|
| 40 |
### Model Description
|
|
|
|
| 58 |
- Evaluation code: https://github.com/allenai/OLMo-Eval
|
| 59 |
- Further fine-tuning code: https://github.com/allenai/open-instruct
|
| 60 |
- **Paper:** [Link](https://arxiv.org/abs/2402.00838)
|
| 61 |
+
|
|
|
|
|
|
|
| 62 |
|
| 63 |
### Inference
|
| 64 |
|