Mungert
/

SmallThinker-21BA3B-Instruct-GGUF

Text Generation

Mixture of Experts

Model card Files Files and versions

SmallThinker-21BA3B-Instruct-GGUF

366 GB

2 contributors

History: 1 commit

Mungert's picture

johnbridges's picture

Super-squash history to reclaim storage

9da27a5 verified about 1 month ago

.gitattributes

4.83 kB

Super-squash history to reclaim storage about 1 month ago
README.md

11.8 kB

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-bf16.gguf

43 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-bf16_q8_0.gguf

24.1 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-f16_q8_0.gguf

24.1 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-imatrix.gguf

81.4 MB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq1_m.gguf

6.21 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq1_s.gguf

5.7 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq2_m.gguf

7.84 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq2_s.gguf

7.48 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq2_xs.gguf

6.95 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq2_xxs.gguf

6.51 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq3_m.gguf

10.3 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq3_xs.gguf

9.16 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq3_xxs.gguf

9.11 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq4_nl.gguf.tmp

556 MB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-iq4_xs.gguf

11.6 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q2_k_m.gguf

8.21 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q2_k_s.gguf

8.17 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q3_k_m.gguf

10.9 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q3_k_s.gguf

10.7 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q4_0.gguf

12.1 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q4_1.gguf

13.5 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q4_k_m.gguf

13.6 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q4_k_s.gguf

12.9 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q5_0.gguf

14.8 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q5_1.gguf

16.2 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q5_k_m.gguf

15.8 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q5_k_s.gguf

15.5 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q6_k_m.gguf

17.7 GB
xet

Super-squash history to reclaim storage about 1 month ago
SmallThinker-21BA3B-Instruct-q8_0.gguf

22.9 GB
xet

Super-squash history to reclaim storage about 1 month ago