please release AWQ version
😎
1
1
#17 opened 6 months ago
by
classdemo
A quick test using M1 Max (64G) and Word
#16 opened 6 months ago
by
gptlocalhost
Awesome model! Can we get a version with a larger context window?
1
#15 opened 6 months ago
by
seall0
It supports Serbo-Croatian language very well!
🤯
2
2
#13 opened 6 months ago
by
JLouisBiz
GPTQ or AWQ Quants
🚀
1
3
#12 opened 6 months ago
by
guialfaro
Great job, thanks for this model.
👍
6
4
#11 opened 6 months ago
by
Dampfinchen
recommended sampling parameters?
👀
👍
5
1
#10 opened 6 months ago
by
AaronFeng753
Can we have some more popular benchmarks
1
#8 opened 6 months ago
by
rombodawg
The model is the best for coding.
❤️
🔥
5
3
#7 opened 7 months ago
by
AekDevDev
When running with a single GPU, I get an error saying the VRAM is insufficient. However, when using multiple GPUs on a single machine, there are many errors. My vllm version is 0.8.4.
1
#6 opened 7 months ago
by
hanson888
BitsAndBytes quantization inference error
1
#5 opened 7 months ago
by
chengfy
Some bug when using function call with vllm==0.8.4
2
#4 opened 7 months ago
by
waple
SimpleQA Scores Are WAY off
🔥
5
5
#3 opened 7 months ago
by
phil111
Need fp8 version for inerface
1
#2 opened 7 months ago
by
iwaitu
RuntimeError: CUDA error: device-side assert triggered
#1 opened 7 months ago
by
DsnTgr