Christian Otto Stelter PRO

stelterlab's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in stelterlab/Qwen3-30B-A3B-Instruct-2507-AWQ 11 days ago

Qwen3.5-35B-A3B AWQ quant planned?

2

#1 opened 15 days ago by

amidwestnoob

New activity in RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic 25 days ago

Which transformer version did you use?

#3 opened 25 days ago by

stelterlab

New activity in stelterlab/NVIDIA-Nemotron-3-Nano-30B-A3B-AWQ 26 days ago

tokenizer_config.json missing chat_template field (tool calling broken without workaround)

1

#1 opened 26 days ago by

seanthomaswilliams

Updated tokenizer_config.json now w/ chat_template included

#2 opened 26 days ago by

stelterlab

New activity in mistralai/Ministral-3-14B-Instruct-2512 4 months ago

NVFP4 / AWQ Quants or llm-compressor recipe

🤗 1

1

#1 opened 4 months ago by

stelterlab

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit 4 months ago

vLLM v0.11.1 seems to work, but v0.11.2 fails

👍❤️ 2

9

#3 opened 4 months ago by

stelterlab

New activity in cyankiwi/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 6 months ago

Error when running in VLLM

👍 2

21

#1 opened 6 months ago by

d8rt8v

New activity in stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ 8 months ago

Unable to run the model in VLLM: KeyError: 'layers.14.mlp.gate.qweight'

3

#1 opened 8 months ago by

fredericodeveloper

New activity in stelterlab/DeepSeek-R1-0528-Qwen3-8B-AWQ 8 months ago

Rope Scaling pre-applied?

6

#1 opened 8 months ago by

the1dv

New activity in mistralai/Mistral-Small-3.2-24B-Instruct-2506 8 months ago

AWQ version

👍 14

13

#8 opened 9 months ago by

celsowm

New activity in OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym 9 months ago

How did you use auto-round to quantize?

3

#4 opened 9 months ago by

stelterlab

New activity in stelterlab/Mistral-Small-24B-Instruct-2501-AWQ 9 months ago

please update to Mistral-Small-3.2-24B-Instruct-2506

1

#5 opened 9 months ago by

celsowm

New activity in stelterlab/Mistral-Small-24B-Instruct-2501-AWQ 10 months ago

Tool Calling issue with stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

1

#4 opened 10 months ago by

sbhatt765

New activity in stelterlab/Qwen3-32B-AWQ 11 months ago

Do you any plan to quantize the Qwen3-30B-A3B-AWQ model?

1

#2 opened 11 months ago by

Jeanxx

New activity in stelterlab/Qwen3-8B-AWQ 11 months ago

Could you share the code script that convert the original Qwen3-8B to Qwen3-8B-AWQ?

1

#1 opened 11 months ago by

wenmin-wu

New activity in stelterlab/Qwen3-32B-AWQ 11 months ago

gpqa diamond

1

#1 opened 11 months ago by

madferit421

New activity in stelterlab/DeepSeek-R1-Distill-Qwen-14B-AWQ 11 months ago

How to reduce "Think" responses when using vLLM for inference?

1

#1 opened 11 months ago by

rjsng0904

New activity in stelterlab/Mistral-Small-24B-Instruct-2501-AWQ 11 months ago

Really good work

🔥 2

11

#1 opened about 1 year ago by

divmgl

New activity in mistralai/Mistral-Small-3.1-24B-Instruct-2503 12 months ago

FP8 Dynamic/W8A16 Quants Please

4

#44 opened 12 months ago by

rjmehta

New activity in stelterlab/openhands-lm-32b-v0.1-AWQ 12 months ago

i love you

1

#1 opened 12 months ago by

nisten