Any plan for other model or quantization method?
#1
by
swearofwind
- opened
This model is excellent. Thank you for your contribution.
I want to ask that is there any plan for other model or method?
e.g. Deepseek-V3-0324 int4 and int8 mix?
e.g. AWQ mix int4 and int8 precision?