Adding Evaluation Results

#1
Files changed (1) hide show
  1. README.md +113 -5
README.md CHANGED
@@ -1,14 +1,108 @@
1
  ---
 
 
 
 
2
  base_model:
3
  - LeroyDyer/_Spydaz_Web_AI_AGI_R1_OmG_Coder
4
  - LeroyDyer/_Spydaz_Web_AI_AGI_R1_Math_AdvancedStudent
5
  - LeroyDyer/LCARS_TOP_SCORE
6
  - LeroyDyer/_Spydaz_Web_AI_AGI_R1_Math_001
7
- library_name: transformers
8
- tags:
9
- - mergekit
10
- - merge
11
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
  Rank 1588 - TOP MISTRAL 7B
14
  # Winners create more winners, while losers do the opposite.
@@ -64,3 +158,17 @@ Turing's test evaluates AI by its ability to mimic human behavior convincingly,
64
 
65
  Russell and Norvig advocate for AI that acts rationally to achieve the best outcomes, integrating reasoning and adaptability to environments.
66
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: transformers
3
+ tags:
4
+ - mergekit
5
+ - merge
6
  base_model:
7
  - LeroyDyer/_Spydaz_Web_AI_AGI_R1_OmG_Coder
8
  - LeroyDyer/_Spydaz_Web_AI_AGI_R1_Math_AdvancedStudent
9
  - LeroyDyer/LCARS_TOP_SCORE
10
  - LeroyDyer/_Spydaz_Web_AI_AGI_R1_Math_001
11
+ model-index:
12
+ - name: _Spydaz_Web_AI_AGI_R1_Top_Student
13
+ results:
14
+ - task:
15
+ type: text-generation
16
+ name: Text Generation
17
+ dataset:
18
+ name: IFEval (0-Shot)
19
+ type: HuggingFaceH4/ifeval
20
+ args:
21
+ num_few_shot: 0
22
+ metrics:
23
+ - type: inst_level_strict_acc and prompt_level_strict_acc
24
+ value: 60.4
25
+ name: strict accuracy
26
+ source:
27
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/_Spydaz_Web_AI_AGI_R1_Top_Student
28
+ name: Open LLM Leaderboard
29
+ - task:
30
+ type: text-generation
31
+ name: Text Generation
32
+ dataset:
33
+ name: BBH (3-Shot)
34
+ type: BBH
35
+ args:
36
+ num_few_shot: 3
37
+ metrics:
38
+ - type: acc_norm
39
+ value: 29.31
40
+ name: normalized accuracy
41
+ source:
42
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/_Spydaz_Web_AI_AGI_R1_Top_Student
43
+ name: Open LLM Leaderboard
44
+ - task:
45
+ type: text-generation
46
+ name: Text Generation
47
+ dataset:
48
+ name: MATH Lvl 5 (4-Shot)
49
+ type: hendrycks/competition_math
50
+ args:
51
+ num_few_shot: 4
52
+ metrics:
53
+ - type: exact_match
54
+ value: 7.25
55
+ name: exact match
56
+ source:
57
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/_Spydaz_Web_AI_AGI_R1_Top_Student
58
+ name: Open LLM Leaderboard
59
+ - task:
60
+ type: text-generation
61
+ name: Text Generation
62
+ dataset:
63
+ name: GPQA (0-shot)
64
+ type: Idavidrein/gpqa
65
+ args:
66
+ num_few_shot: 0
67
+ metrics:
68
+ - type: acc_norm
69
+ value: 3.02
70
+ name: acc_norm
71
+ source:
72
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/_Spydaz_Web_AI_AGI_R1_Top_Student
73
+ name: Open LLM Leaderboard
74
+ - task:
75
+ type: text-generation
76
+ name: Text Generation
77
+ dataset:
78
+ name: MuSR (0-shot)
79
+ type: TAUR-Lab/MuSR
80
+ args:
81
+ num_few_shot: 0
82
+ metrics:
83
+ - type: acc_norm
84
+ value: 29.37
85
+ name: acc_norm
86
+ source:
87
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/_Spydaz_Web_AI_AGI_R1_Top_Student
88
+ name: Open LLM Leaderboard
89
+ - task:
90
+ type: text-generation
91
+ name: Text Generation
92
+ dataset:
93
+ name: MMLU-PRO (5-shot)
94
+ type: TIGER-Lab/MMLU-Pro
95
+ config: main
96
+ split: test
97
+ args:
98
+ num_few_shot: 5
99
+ metrics:
100
+ - type: acc
101
+ value: 22.49
102
+ name: accuracy
103
+ source:
104
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/_Spydaz_Web_AI_AGI_R1_Top_Student
105
+ name: Open LLM Leaderboard
106
  ---
107
  Rank 1588 - TOP MISTRAL 7B
108
  # Winners create more winners, while losers do the opposite.
 
158
 
159
  Russell and Norvig advocate for AI that acts rationally to achieve the best outcomes, integrating reasoning and adaptability to environments.
160
 
161
+
162
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
163
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/LeroyDyer___Spydaz_Web_AI_AGI_R1_Top_Student-details)
164
+
165
+ | Metric |Value|
166
+ |-------------------|----:|
167
+ |Avg. |25.31|
168
+ |IFEval (0-Shot) |60.40|
169
+ |BBH (3-Shot) |29.31|
170
+ |MATH Lvl 5 (4-Shot)| 7.25|
171
+ |GPQA (0-shot) | 3.02|
172
+ |MuSR (0-shot) |29.37|
173
+ |MMLU-PRO (5-shot) |22.49|
174
+