Eval requests: Gemma 3 27B finetunes
#410
by
oshikuru08
- opened
Hello! With the new categories on the leaderboard, it looks like Gemma 3 27B now sits at the top of the list for models around 24-32B, at least in terms of natural intelligence for its size.
It would be interesting to see how these finetunes compare to it. If you could please evaluate these ones, that would be great.
https://huggingface.co/TheDrummer/Fallen-Gemma3-27B-v1
https://huggingface.co/TheDrummer/Gemma-3-R1-27B-v1
https://huggingface.co/TheDrummer/Gemmasutra-27B-v3
oshikuru08
changed discussion title from
Eval Requests - Gemma 3 27B Finetunes
to Eval requests - Gemma 3 27B finetunes
oshikuru08
changed discussion title from
Eval requests - Gemma 3 27B finetunes
to Eval requests: Gemma 3 27B finetunes
I can't get Fallen-Gemma3-27B-v1 to run using vllm. It just always gives me an error no matter how much I change around the config file settings.
DontPlanToEnd
changed discussion status to
closed