What tool/framework to test .gguf models?
#4
by
bobchenyx
- opened
Hi, thanks for all those great quantization versions!
I would like to inquire what kind of tools / frameworks to use, if I'd like to test the performances of certain model? (ex. math. q&a.. etc)
I think llama.cpp only supports ppl?
bobchenyx
changed discussion status to
closed