Update README.md
Browse files
README.md
CHANGED
|
@@ -18,9 +18,9 @@ datasets:
|
|
| 18 |
|
| 19 |
# Llama3 8B Wordcel
|
| 20 |
|
| 21 |
-
Wordcel is a Llama3 fine-tune intended to be used as a mid-training checkpoint for more specific
|
| 22 |
|
| 23 |
-
It has been trained from Llama3 8B Base on a composite dataset that highlights reasoning, (uncensored) stories, classic literature, and assorted interpersonal intelligence tasks.
|
| 24 |
|
| 25 |
Components of the composite dataset include [OpenHermes-2.5](https://huggingface.co/datasets/teknium/OpenHermes-2.5), and [Grimulkan](https://huggingface.co/grimulkan)'s [Theory of Mind](https://huggingface.co/datasets/grimulkan/theory-of-mind) and [Physical Reasoning](https://huggingface.co/datasets/grimulkan/physical-reasoning) datasets.
|
| 26 |
|
|
|
|
| 18 |
|
| 19 |
# Llama3 8B Wordcel
|
| 20 |
|
| 21 |
+
Wordcel is a Llama3 fine-tune intended to be used as a mid-training checkpoint for more specific RP/storywriting/creative applications.
|
| 22 |
|
| 23 |
+
It has been trained from Llama3 8B Base on a composite dataset of ~100M tokens that highlights reasoning, (uncensored) stories, classic literature, and assorted interpersonal intelligence tasks.
|
| 24 |
|
| 25 |
Components of the composite dataset include [OpenHermes-2.5](https://huggingface.co/datasets/teknium/OpenHermes-2.5), and [Grimulkan](https://huggingface.co/grimulkan)'s [Theory of Mind](https://huggingface.co/datasets/grimulkan/theory-of-mind) and [Physical Reasoning](https://huggingface.co/datasets/grimulkan/physical-reasoning) datasets.
|
| 26 |
|