Hugging Face's logo

featherless-ai-quants
/
allura-org-Qwen2.5-32b-RP-Ink-GGUF

Text Generation
GGUF
conversational
Model card Files
xet
Community
m8than commited on
Commit
1c508ab
·
verified ·
1 Parent(s): c416142

Upload folder using huggingface_hub

Browse files
Files changed (26) hide show
  1. .gitattributes +24 -0
  2. README.md +47 -0
  3. allura-org-Qwen2.5-32b-RP-Ink-IQ4_XS.gguf +3 -0
  4. allura-org-Qwen2.5-32b-RP-Ink-Q2_K.gguf +3 -0
  5. allura-org-Qwen2.5-32b-RP-Ink-Q3_K_L.gguf +3 -0
  6. allura-org-Qwen2.5-32b-RP-Ink-Q3_K_M.gguf +3 -0
  7. allura-org-Qwen2.5-32b-RP-Ink-Q3_K_S.gguf +3 -0
  8. allura-org-Qwen2.5-32b-RP-Ink-Q4_K_M.gguf +3 -0
  9. allura-org-Qwen2.5-32b-RP-Ink-Q4_K_S.gguf +3 -0
  10. allura-org-Qwen2.5-32b-RP-Ink-Q5_K_M.gguf +3 -0
  11. allura-org-Qwen2.5-32b-RP-Ink-Q5_K_S.gguf +3 -0
  12. allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00001-of-00006.gguf +3 -0
  13. allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00002-of-00006.gguf +3 -0
  14. allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00003-of-00006.gguf +3 -0
  15. allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00004-of-00006.gguf +3 -0
  16. allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00005-of-00006.gguf +3 -0
  17. allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00006-of-00006.gguf +3 -0
  18. allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00001-of-00008.gguf +3 -0
  19. allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00002-of-00008.gguf +3 -0
  20. allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00003-of-00008.gguf +3 -0
  21. allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00004-of-00008.gguf +3 -0
  22. allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00005-of-00008.gguf +3 -0
  23. allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00006-of-00008.gguf +3 -0
  24. allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00007-of-00008.gguf +3 -0
  25. allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00008-of-00008.gguf +3 -0
  26. featherless-quants.png +3 -0
.gitattributes CHANGED
@@ -33,3 +33,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ allura-org-Qwen2.5-32b-RP-Ink-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ allura-org-Qwen2.5-32b-RP-Ink-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ allura-org-Qwen2.5-32b-RP-Ink-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ allura-org-Qwen2.5-32b-RP-Ink-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ allura-org-Qwen2.5-32b-RP-Ink-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ allura-org-Qwen2.5-32b-RP-Ink-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ allura-org-Qwen2.5-32b-RP-Ink-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ allura-org-Qwen2.5-32b-RP-Ink-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ allura-org-Qwen2.5-32b-RP-Ink-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
46
+ allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
47
+ allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
48
+ allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
49
+ allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
50
+ allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
51
+ allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
52
+ allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
53
+ allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
54
+ allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
55
+ allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
56
+ allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
57
+ allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
58
+ allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
59
+ featherless-quants.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: allura-org/Qwen2.5-32b-RP-Ink
3
+ pipeline_tag: text-generation
4
+ quantized_by: featherless-ai-quants
5
+ ---
6
+
7
+ # allura-org/Qwen2.5-32b-RP-Ink GGUF Quantizations 🚀
8
+
9
+ ![Featherless AI Quants](./featherless-quants.png)
10
+
11
+ *Optimized GGUF quantization files for enhanced model performance*
12
+
13
+ > Powered by [Featherless AI](https://featherless.ai) - run any model you'd like for a simple small fee.
14
+ ---
15
+
16
+ ## Available Quantizations 📊
17
+
18
+ | Quantization Type | File | Size |
19
+ |-------------------|------|------|
20
+ | IQ4_XS | [allura-org-Qwen2.5-32b-RP-Ink-IQ4_XS.gguf](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/blob/main/allura-org-Qwen2.5-32b-RP-Ink-IQ4_XS.gguf) | 17042.26 MB |
21
+ | Q2_K | [allura-org-Qwen2.5-32b-RP-Ink-Q2_K.gguf](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/blob/main/allura-org-Qwen2.5-32b-RP-Ink-Q2_K.gguf) | 11742.69 MB |
22
+ | Q3_K_L | [allura-org-Qwen2.5-32b-RP-Ink-Q3_K_L.gguf](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/blob/main/allura-org-Qwen2.5-32b-RP-Ink-Q3_K_L.gguf) | 16448.10 MB |
23
+ | Q3_K_M | [allura-org-Qwen2.5-32b-RP-Ink-Q3_K_M.gguf](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/blob/main/allura-org-Qwen2.5-32b-RP-Ink-Q3_K_M.gguf) | 15196.85 MB |
24
+ | Q3_K_S | [allura-org-Qwen2.5-32b-RP-Ink-Q3_K_S.gguf](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/blob/main/allura-org-Qwen2.5-32b-RP-Ink-Q3_K_S.gguf) | 13725.60 MB |
25
+ | Q4_K_M | [allura-org-Qwen2.5-32b-RP-Ink-Q4_K_M.gguf](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/blob/main/allura-org-Qwen2.5-32b-RP-Ink-Q4_K_M.gguf) | 18931.71 MB |
26
+ | Q4_K_S | [allura-org-Qwen2.5-32b-RP-Ink-Q4_K_S.gguf](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/blob/main/allura-org-Qwen2.5-32b-RP-Ink-Q4_K_S.gguf) | 17914.21 MB |
27
+ | Q5_K_M | [allura-org-Qwen2.5-32b-RP-Ink-Q5_K_M.gguf](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/blob/main/allura-org-Qwen2.5-32b-RP-Ink-Q5_K_M.gguf) | 22184.52 MB |
28
+ | Q5_K_S | [allura-org-Qwen2.5-32b-RP-Ink-Q5_K_S.gguf](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/blob/main/allura-org-Qwen2.5-32b-RP-Ink-Q5_K_S.gguf) | 21589.52 MB |
29
+ | Q6_K | [allura-org-Qwen2.5-32b-RP-Ink-Q6_K](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/tree/main/allura-org-Qwen2.5-32b-RP-Ink-Q6_K) | 25640.64 MB (folder) |
30
+ | Q8_0 | [allura-org-Qwen2.5-32b-RP-Ink-Q8_0](https://huggingface.co/featherless-ai-quants/allura-org-Qwen2.5-32b-RP-Ink-GGUF/tree/main/allura-org-Qwen2.5-32b-RP-Ink-Q8_0) | 33207.78 MB (folder) |
31
+
32
+
33
+ ---
34
+
35
+ ## ⚡ Powered by [Featherless AI](https://featherless.ai)
36
+
37
+ ### Key Features
38
+
39
+ - 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
40
+ - 🛠️ **Zero Infrastructure** - No server setup or maintenance required
41
+ - 📚 **Vast Compatibility** - Support for 2400+ models and counting
42
+ - 💎 **Affordable Pricing** - Starting at just $10/month
43
+
44
+ ---
45
+
46
+ **Links:**
47
+ [Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)
allura-org-Qwen2.5-32b-RP-Ink-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07094097764fd05268b3be33d24ef7841693008fa742e2aa26343dade5428016
3
+ size 17870101024
allura-org-Qwen2.5-32b-RP-Ink-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7d904b071a78916be43836d1a8acb36b5e1c629eb5a4ac1640aaa312ea84e3a
3
+ size 12313098784
allura-org-Qwen2.5-32b-RP-Ink-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05471bfb7445b8401cb9ad4ee11500b06441f0ea672bfa9312abf0c5545083e5
3
+ size 17247078944
allura-org-Qwen2.5-32b-RP-Ink-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa03e271e1ff29f8f0bc88676f0fae3852514eddefd09cdcaa4131e5da653986
3
+ size 15935048224
allura-org-Qwen2.5-32b-RP-Ink-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ef40a57b15bd3d77bca1892ac889d3fdb5a4e414c9a71615ddd1c7a3ed9eacb
3
+ size 14392330784
allura-org-Qwen2.5-32b-RP-Ink-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce198b47082ac9271828741965d8367f4a4eecee78cc4817dc042273cf2f6af5
3
+ size 19851336224
allura-org-Qwen2.5-32b-RP-Ink-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac4feff2102d6e949b746517db9b7f46199e9c879d54d46cb7074f773c4d8e88
3
+ size 18784410144
allura-org-Qwen2.5-32b-RP-Ink-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d656572fd2a027c5b02527a6712df8e66fb497206ce42c234c212896af82eb5
3
+ size 23262157344
allura-org-Qwen2.5-32b-RP-Ink-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:418b3ddd24793ffa8cda39005a485e0203cf0b735d2a551182444791713f436b
3
+ size 22638254624
allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00001-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f092376fd10399725896c70fb9911359647f9d0cafe5a39592cb607248cdc34
3
+ size 4928973664
allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00002-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d62de73e2218f6a3be575f3e6f5b23cbce8d4f098fa891261955fd677c3ca09d
3
+ size 4916678944
allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00003-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e5035bab0d4a359f2dc304d5988b2e57096af48e46189f0ff2d035de6255a98
3
+ size 4916658432
allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00004-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7ac2067aaa7272c03942c08d48e635a08bbbe4e7ca33b856cdde0e9883d4166
3
+ size 4916658432
allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00005-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f3f4a5000a3e4d4c7fa2776fa25667cf5512b57670dd1d0d5f885d2e4cd0e07
3
+ size 4968338144
allura-org-Qwen2.5-32b-RP-Ink-Q6_K/allura-org-Qwen2.5-32b-RP-Ink-Q6_K-00006-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cfbbbfa57a8e8441fe8f423ca3524ee84daf7930da57bb256e22d0b4f02ff38
3
+ size 2238847840
allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b978bf56891ec593e092a6d5c781e295deb661125cc7b5fd48b0f3995b26b67
3
+ size 4978242528
allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28916968f6cc15bd960f451b6f6e6abd23ab7a14577d89170cf22861166d6372
3
+ size 4964002048
allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f283722dee2653eff665a07891cf560313ccca6eff663e3c85cda35a71f4c2d
3
+ size 4880513760
allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:548cf9f21dfa0761ab326779a371872d996d2b473cf630c8659f96cb82ba8664
3
+ size 4964002080
allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae6901e3be55da7fb9a5342fce48648c8fa9a1aaa782d5b958f82567bb908acb
3
+ size 4880513760
allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:788bfebe7b65911b43407789d5e456f317ae9ac03f79a920171856bb9a0471b6
3
+ size 4964002080
allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99cd450ee828ec1999b0a95f9ba391c794d83bbe725c8c17fe4dc246aba7c212
3
+ size 4972287520
allura-org-Qwen2.5-32b-RP-Ink-Q8_0/allura-org-Qwen2.5-32b-RP-Ink-Q8_0-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:597b88a981e8f2c8f9108bcecf4a0c6b8d0f56846e624231f758d6fbd4249f0a
3
+ size 217322144
featherless-quants.png ADDED

Git LFS Details

  • SHA256: 2e1b4d66c8306c7b0614089381fdf86ea4efb02dffb78d22767a084cb8b88d6b
  • Pointer size: 132 Bytes
  • Size of remote file: 1.61 MB