Update README.md
Browse files
README.md
CHANGED
|
@@ -16,66 +16,40 @@ datasets:
|
|
| 16 |
- mlabonne/chatml_dpo_pairs
|
| 17 |
base_model: JackFram/llama-68m
|
| 18 |
widget:
|
| 19 |
-
-
|
| 20 |
-
|
| 21 |
-
You are a
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
Hi!
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
I
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
-
|
| 52 |
-
|
| 53 |
-
You are a helpful assistant who provides concise responses.<|im_end|>
|
| 54 |
-
|
| 55 |
-
<|im_start|>user
|
| 56 |
-
|
| 57 |
-
Hi!<|im_end|>
|
| 58 |
-
|
| 59 |
-
<|im_start|>assistant
|
| 60 |
-
|
| 61 |
-
Hello there! How may I help you?<|im_end|>
|
| 62 |
-
|
| 63 |
-
<|im_start|>user
|
| 64 |
-
|
| 65 |
-
I need to build a simple website. Where should I start learning about web development?<|im_end|>
|
| 66 |
-
|
| 67 |
-
<|im_start|>assistant'
|
| 68 |
-
- text: '<|im_start|>system
|
| 69 |
-
|
| 70 |
-
You are a very creative assistant. User will give you a task, which you should
|
| 71 |
-
complete with all your knowledge.<|im_end|>
|
| 72 |
-
|
| 73 |
-
<|im_start|>user
|
| 74 |
-
|
| 75 |
-
Write the background story of an RPG game about wizards and dragons in a sci-fi
|
| 76 |
-
world.<|im_end|>
|
| 77 |
-
|
| 78 |
-
<|im_start|>assistant'
|
| 79 |
inference:
|
| 80 |
parameters:
|
| 81 |
max_new_tokens: 64
|
|
@@ -220,7 +194,8 @@ penalty_alpha: 0.5
|
|
| 220 |
top_k: 4
|
| 221 |
```
|
| 222 |
|
| 223 |
-
|
|
|
|
| 224 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Felladrin__Llama-68M-Chat-v1)
|
| 225 |
|
| 226 |
| Metric |Value|
|
|
@@ -232,4 +207,3 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
|
|
| 232 |
|TruthfulQA (0-shot) |47.27|
|
| 233 |
|Winogrande (5-shot) |54.30|
|
| 234 |
|GSM8k (5-shot) | 0.00|
|
| 235 |
-
|
|
|
|
| 16 |
- mlabonne/chatml_dpo_pairs
|
| 17 |
base_model: JackFram/llama-68m
|
| 18 |
widget:
|
| 19 |
+
- messages:
|
| 20 |
+
- role: system
|
| 21 |
+
content: You are a career counselor. The user will provide you with an individual
|
| 22 |
+
looking for guidance in their professional life, and your task is to assist
|
| 23 |
+
them in determining what careers they are most suited for based on their skills,
|
| 24 |
+
interests, and experience. You should also conduct research into the various
|
| 25 |
+
options available, explain the job market trends in different industries, and
|
| 26 |
+
advice on which qualifications would be beneficial for pursuing particular fields.
|
| 27 |
+
- role: user
|
| 28 |
+
content: Heya!
|
| 29 |
+
- role: assistant
|
| 30 |
+
content: Hi! How may I help you?
|
| 31 |
+
- role: user
|
| 32 |
+
content: I am interested in developing a career in software engineering. What
|
| 33 |
+
would you recommend me to do?
|
| 34 |
+
- messages:
|
| 35 |
+
- role: system
|
| 36 |
+
content: You are a knowledgeable assistant. Help the user as much as you can.
|
| 37 |
+
- role: user
|
| 38 |
+
content: How to become healthier?
|
| 39 |
+
- messages:
|
| 40 |
+
- role: system
|
| 41 |
+
content: You are a helpful assistant who provides concise responses.
|
| 42 |
+
- role: user
|
| 43 |
+
content: Hi!
|
| 44 |
+
- role: assistant
|
| 45 |
+
content: Hello there! How may I help you?
|
| 46 |
+
- role: user
|
| 47 |
+
content: I need to build a simple website. Where should I start learning about web development?
|
| 48 |
+
- messages:
|
| 49 |
+
- role: system
|
| 50 |
+
content: You are a very creative assistant. User will give you a task, which you should complete with all your knowledge.
|
| 51 |
+
- role: user
|
| 52 |
+
content: Write the background story of an RPG game about wizards and dragons in a sci-fi world.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
inference:
|
| 54 |
parameters:
|
| 55 |
max_new_tokens: 64
|
|
|
|
| 194 |
top_k: 4
|
| 195 |
```
|
| 196 |
|
| 197 |
+
## [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 198 |
+
|
| 199 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Felladrin__Llama-68M-Chat-v1)
|
| 200 |
|
| 201 |
| Metric |Value|
|
|
|
|
| 207 |
|TruthfulQA (0-shot) |47.27|
|
| 208 |
|Winogrande (5-shot) |54.30|
|
| 209 |
|GSM8k (5-shot) | 0.00|
|
|
|