Hugging Face's logo

prithivMLmods
/
Calcium-Opus-14B-Elite

Text Generation
Transformers
Safetensors
English
qwen2
opus
elite
14B
calcium
qwq
trl
conversational
Eval Results
text-generation-inference
Model card Files
xet
Community
3
prithivMLmods commited on
Commit
29f580d
·
verified ·
1 Parent(s): c8717aa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -8
README.md CHANGED
@@ -12,6 +12,7 @@ tags:
12
  - 14B
13
  - calcium
14
  - qwq
 
15
  model-index:
16
  - name: Calcium-Opus-14B-Elite
17
  results:
@@ -29,7 +30,8 @@ model-index:
29
  value: 60.64
30
  name: averaged accuracy
31
  source:
32
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
33
  name: Open LLM Leaderboard
34
  - task:
35
  type: text-generation
@@ -45,7 +47,8 @@ model-index:
45
  value: 46.53
46
  name: normalized accuracy
47
  source:
48
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
49
  name: Open LLM Leaderboard
50
  - task:
51
  type: text-generation
@@ -61,7 +64,8 @@ model-index:
61
  value: 37.08
62
  name: exact match
63
  source:
64
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
65
  name: Open LLM Leaderboard
66
  - task:
67
  type: text-generation
@@ -77,7 +81,8 @@ model-index:
77
  value: 16.44
78
  name: acc_norm
79
  source:
80
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
81
  name: Open LLM Leaderboard
82
  - task:
83
  type: text-generation
@@ -92,7 +97,8 @@ model-index:
92
  value: 20.95
93
  name: acc_norm
94
  source:
95
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
96
  name: Open LLM Leaderboard
97
  - task:
98
  type: text-generation
@@ -109,7 +115,8 @@ model-index:
109
  value: 47.85
110
  name: accuracy
111
  source:
112
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
 
113
  name: Open LLM Leaderboard
114
  ---
115
  ![opus.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/BELYApcX2oNMRsOW6nIyR.gif)
@@ -233,5 +240,4 @@ Summarized results can be found [here](https://huggingface.co/datasets/open-llm-
233
  |MATH Lvl 5 (4-Shot)| 47.89|
234
  |GPQA (0-shot) | 16.55|
235
  |MuSR (0-shot) | 20.78|
236
- |MMLU-PRO (5-shot) | 47.80|
237
-
 
12
  - 14B
13
  - calcium
14
  - qwq
15
+ - trl
16
  model-index:
17
  - name: Calcium-Opus-14B-Elite
18
  results:
 
30
  value: 60.64
31
  name: averaged accuracy
32
  source:
33
+ url: >-
34
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
35
  name: Open LLM Leaderboard
36
  - task:
37
  type: text-generation
 
47
  value: 46.53
48
  name: normalized accuracy
49
  source:
50
+ url: >-
51
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
52
  name: Open LLM Leaderboard
53
  - task:
54
  type: text-generation
 
64
  value: 37.08
65
  name: exact match
66
  source:
67
+ url: >-
68
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
69
  name: Open LLM Leaderboard
70
  - task:
71
  type: text-generation
 
81
  value: 16.44
82
  name: acc_norm
83
  source:
84
+ url: >-
85
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
86
  name: Open LLM Leaderboard
87
  - task:
88
  type: text-generation
 
97
  value: 20.95
98
  name: acc_norm
99
  source:
100
+ url: >-
101
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
102
  name: Open LLM Leaderboard
103
  - task:
104
  type: text-generation
 
115
  value: 47.85
116
  name: accuracy
117
  source:
118
+ url: >-
119
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FCalcium-Opus-14B-Elite
120
  name: Open LLM Leaderboard
121
  ---
122
  ![opus.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/BELYApcX2oNMRsOW6nIyR.gif)
 
240
  |MATH Lvl 5 (4-Shot)| 47.89|
241
  |GPQA (0-shot) | 16.55|
242
  |MuSR (0-shot) | 20.78|
243
+ |MMLU-PRO (5-shot) | 47.80|