OPEA
/

Llama-3.3-70B-Instruct-int2-sym-inc

Model card Files Files and versions

cicdatopea commited on Mar 26

Commit

90984ae

·

verified ·

1 Parent(s): 7c29e48

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -120,8 +120,9 @@ lm-eval --model hf --model_args pretrained=OPEA/Llama-3.3-70B-Instruct-int2-sym-
 |          arc_easy          |          0.8624          | 0.8367                    |                               |      0.8064       |
 |     leaderboard_ifeval     | 0.6661=(0.7110+0.6211)/2 | 0.61235=(0.6739+0.5508)/2 |                               | (0.5959+0.4603)/2 |
 |       arc_challenge        |          0.6109          | 0.5580                    |                               |      0.5188       |
-| gsm8k(5shot) strict match  |          0.9083          | 0.8575                    |                               |                   |
 ## Generate the model

 |          arc_easy          |          0.8624          | 0.8367                    |                               |      0.8064       |
 |     leaderboard_ifeval     | 0.6661=(0.7110+0.6211)/2 | 0.61235=(0.6739+0.5508)/2 |                               | (0.5959+0.4603)/2 |
 |       arc_challenge        |          0.6109          | 0.5580                    |                               |      0.5188       |
+| gsm8k(5shot) strict match?  |          0.9083          | 0.8575                    |                               |                   |
+gsm8k data is not correct, probably flexible-extract
 ## Generate the model