Hugging Face's logo

featherless-ai-quants
/
mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF

Text Generation
GGUF
conversational
Model card Files
xet
Community
m8than commited on
Commit
79af350
·
verified ·
1 Parent(s): c8ec81c

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +104 -0
  2. README.md +47 -0
  3. featherless-quants.png +3 -0
  4. mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00001-of-00008.gguf +3 -0
  5. mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00002-of-00008.gguf +3 -0
  6. mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00003-of-00008.gguf +3 -0
  7. mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00004-of-00008.gguf +3 -0
  8. mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00005-of-00008.gguf +3 -0
  9. mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00006-of-00008.gguf +3 -0
  10. mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00007-of-00008.gguf +3 -0
  11. mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00008-of-00008.gguf +3 -0
  12. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00001-of-00006.gguf +3 -0
  13. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00002-of-00006.gguf +3 -0
  14. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00003-of-00006.gguf +3 -0
  15. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00004-of-00006.gguf +3 -0
  16. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00005-of-00006.gguf +3 -0
  17. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00006-of-00006.gguf +3 -0
  18. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00001-of-00008.gguf +3 -0
  19. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00002-of-00008.gguf +3 -0
  20. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00003-of-00008.gguf +3 -0
  21. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00004-of-00008.gguf +3 -0
  22. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00005-of-00008.gguf +3 -0
  23. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00006-of-00008.gguf +3 -0
  24. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00007-of-00008.gguf +3 -0
  25. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00008-of-00008.gguf +3 -0
  26. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00001-of-00007.gguf +3 -0
  27. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00002-of-00007.gguf +3 -0
  28. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00003-of-00007.gguf +3 -0
  29. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00004-of-00007.gguf +3 -0
  30. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00005-of-00007.gguf +3 -0
  31. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00006-of-00007.gguf +3 -0
  32. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00007-of-00007.gguf +3 -0
  33. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00001-of-00007.gguf +3 -0
  34. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00002-of-00007.gguf +3 -0
  35. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00003-of-00007.gguf +3 -0
  36. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00004-of-00007.gguf +3 -0
  37. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00005-of-00007.gguf +3 -0
  38. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00006-of-00007.gguf +3 -0
  39. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00007-of-00007.gguf +3 -0
  40. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00001-of-00009.gguf +3 -0
  41. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00002-of-00009.gguf +3 -0
  42. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00003-of-00009.gguf +3 -0
  43. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00004-of-00009.gguf +3 -0
  44. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00005-of-00009.gguf +3 -0
  45. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00006-of-00009.gguf +3 -0
  46. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00007-of-00009.gguf +3 -0
  47. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00008-of-00009.gguf +3 -0
  48. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00009-of-00009.gguf +3 -0
  49. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00001-of-00009.gguf +3 -0
  50. mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00002-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,107 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ featherless-quants.png filter=lfs diff=lfs merge=lfs -text
37
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
38
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
39
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
40
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
41
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
42
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
43
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
44
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
45
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
46
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
47
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
48
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
49
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
50
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
51
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
52
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
53
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
54
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
55
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
56
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
57
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
58
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
59
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
60
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
61
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
62
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
63
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
64
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
65
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
66
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
67
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
68
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
69
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
70
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
71
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
72
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
73
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
74
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
75
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
76
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
77
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
78
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
79
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
80
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
81
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
82
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
83
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
84
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
85
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
86
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
87
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
88
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
89
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
90
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
91
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00001-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
92
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00002-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
93
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00003-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
94
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00004-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
95
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00005-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
96
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00006-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
97
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00007-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
98
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00008-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
99
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00009-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
100
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00010-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
101
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M-00011-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
102
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S-00001-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
103
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S-00002-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
104
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S-00003-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
105
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S-00004-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
106
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S-00005-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
107
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S-00006-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
108
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S-00007-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
109
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
110
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
111
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
112
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00001-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
113
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00002-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
114
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00003-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
115
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00004-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
116
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00005-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
117
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00006-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
118
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00007-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
119
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00008-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
120
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00009-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
121
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00010-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
122
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00011-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
123
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K-00012-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
124
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00001-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
125
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00002-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
126
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00003-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
127
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00004-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
128
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00005-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
129
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00006-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
130
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00007-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
131
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00008-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
132
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00009-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
133
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00010-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
134
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00011-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
135
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00012-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
136
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00013-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
137
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00014-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
138
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00015-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
139
+ mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0-00016-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: mlabonne/Llama-3.1-70B-Instruct-lorablated
3
+ pipeline_tag: text-generation
4
+ quantized_by: featherless-ai-quants
5
+ ---
6
+
7
+ # mlabonne/Llama-3.1-70B-Instruct-lorablated GGUF Quantizations 🚀
8
+
9
+ ![Featherless AI Quants](./featherless-quants.png)
10
+
11
+ *Optimized GGUF quantization files for enhanced model performance*
12
+
13
+ > Powered by [Featherless AI](https://featherless.ai) - run any model you'd like for a simple small fee.
14
+ ---
15
+
16
+ ## Available Quantizations 📊
17
+
18
+ | Quantization Type | File | Size |
19
+ |-------------------|------|------|
20
+ | IQ4_XS | [mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS) | 36496.80 MB (folder) |
21
+ | Q2_K | [mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K) | 25153.27 MB (folder) |
22
+ | Q3_K_L | [mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L) | 35420.03 MB (folder) |
23
+ | Q3_K_M | [mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M) | 32680.03 MB (folder) |
24
+ | Q3_K_S | [mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S) | 29480.03 MB (folder) |
25
+ | Q4_K_M | [mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M) | 40550.61 MB (folder) |
26
+ | Q4_K_S | [mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S) | 38478.11 MB (folder) |
27
+ | Q5_K_M | [mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_M) | 47635.86 MB (folder) |
28
+ | Q5_K_S | [mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q5_K_S) | 46403.36 MB (folder) |
29
+ | Q6_K | [mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q6_K) | 55206.44 MB (folder) |
30
+ | Q8_0 | [mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0](https://huggingface.co/featherless-ai-quants/mlabonne-Llama-3.1-70B-Instruct-lorablated-GGUF/tree/main/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q8_0) | 71501.79 MB (folder) |
31
+
32
+
33
+ ---
34
+
35
+ ## ⚡ Powered by [Featherless AI](https://featherless.ai)
36
+
37
+ ### Key Features
38
+
39
+ - 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
40
+ - 🛠️ **Zero Infrastructure** - No server setup or maintenance required
41
+ - 📚 **Vast Compatibility** - Support for 2400+ models and counting
42
+ - 💎 **Affordable Pricing** - Starting at just $10/month
43
+
44
+ ---
45
+
46
+ **Links:**
47
+ [Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)
featherless-quants.png ADDED

Git LFS Details

  • SHA256: 2e1b4d66c8306c7b0614089381fdf86ea4efb02dffb78d22767a084cb8b88d6b
  • Pointer size: 132 Bytes
  • Size of remote file: 1.61 MB
mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b09db1de5138468e9c7ee5ca9abd18bb463c01c1d3ead947733b223a9ee58ec7
3
+ size 4876349760
mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5eec026041a04a1e97c3d9fc0d57019afe8e51940bada06a0dc4084ac4d9496
3
+ size 4919006720
mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f09b628d74cc3c4382e8d3340c7625d1851d095574138f6dc921cfce173375bb
3
+ size 4890498912
mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bb7ac0a73040c5d090f2223e78a777d040169c124b95d3192653fda6959435a
3
+ size 4890498912
mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcd1b1eda1c7a59a930b3bd4ae52de57dd524caa581472b4363352a406cebc6e
3
+ size 4973827808
mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69b3eb1596d6f4aefbce897c1c1d8f662dc4c9e7f23860343852dcd1c5d847ec
3
+ size 4979627840
mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c8bbe0961a494d8af7da0fd795ae8de68893d4ddb6761eedbb5444bc4dc8153
3
+ size 4886009568
mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS/mlabonne-Llama-3.1-70B-Instruct-lorablated-IQ4_XS-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf14f0f7c252c9c0d5f1261ec9e4c3c2adfb0b6b406a40f0461039a051513b6a
3
+ size 3853849312
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00001-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:822042b4906901306e69d3e406f034fc1b9ab726849b9a9d14f191d801e6d0d9
3
+ size 4988582848
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00002-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a84fa1840a6fe49ae2ca6c01af9c45b89b3d42771cf3d0232f88dc8604baa681
3
+ size 4975468832
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00003-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc0fdaeb900f58e38e0a13ac231eaacb78df1b13f6c88d94e8d9aab8806804fa
3
+ size 4952269152
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00004-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:013bbf47a0ba26de0eaf7a1dbe0915d4736638a3abf5950e81f3bfa0fc5485b3
3
+ size 4955054528
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00005-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e502704ebe039e1c0f3a00c01b98a2760620a6d998a4bf1bd93f4e16aa7622b
3
+ size 4931199456
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q2_K-00006-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19c228bb8092ab731393e35a8197212280f199446a80627218fb5798ed21191c
3
+ size 1572539104
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:822a06dadf1f56c1d0f0a2778f767cdb5650d9b173d2c09f36684367f307845f
3
+ size 4903138144
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7ebbc681f46c00eb44a73a3a422c1a1b93ba54a212dec25bd2c81a312800543
3
+ size 4925167488
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e7a8b67113b2bc49165f24bc46daaf72b7f69ee7982b229aaeb90b9ad811632
3
+ size 4925167488
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b243d9f4fa2e5fc97487368161240488c361d14dd66945e4a2ec2823df1c034
3
+ size 4925167488
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb9e67151a6159beae846f370288d9a0ebc1a1be48615a9a8b6d430fe801d095
3
+ size 4925167488
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cce0dddf477ecf75fe7f21c7bf18b696875d88bff44f9b3a70ddf007f5e4cbf3
3
+ size 4925167488
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ad9c6456509a874db7f2a455a530b916976a4d742e43522cb6f441af0a5983b
3
+ size 4925167488
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_L-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9275df6ad0a8266a7902a029552a1c1483010852b80d1915d0ea2a5f73494e5d
3
+ size 2686455040
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00001-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74480cce4d274887a783ffd6d77f885b5e63fdade17692525a6caeae9b1731cd
3
+ size 4980995040
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00002-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3bc96dfd4988aa96403cafa9df078d00bcb7502674dcf78f48361c96401ccbe
3
+ size 4919925152
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00003-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4674d991a55e0a9ef724cc06c9cc1846e3f72a6760482594d7ddd7dad10dff1
3
+ size 4919925152
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00004-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f346d13938c0e5e035259e61bd3bad556f570b27728057802fd154264bb9e1b
3
+ size 4919925152
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00005-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd6c352733a4c394e3153e0b5d2f3a21d8872dd30fffb266e76cc41c892fa534
3
+ size 4919925152
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00006-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea2c9a28e23c3d476517c77bd15cd48ba7eef43d287a9c37b0e8faa10c74e601
3
+ size 4919925152
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_M-00007-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ebc8c78fb114cbc85b59189ed4d227d720bdff3590bd973660fc6207ba60927
3
+ size 4686879008
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00001-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52ba48e71da52017b5cc55ffc74db60661a8a88dae64245cf31eed54eb83d064
3
+ size 4985419488
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00002-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:047a7cb0e96593a7bee3e4c5f8f04629c51425dc54ec34f1ea37248ef69a7390
3
+ size 4944075936
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00003-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19ef13f05b62b2c8ab333f40aaab896a08901ceba12c2ac57ccf7d3e9752db6b
3
+ size 4909440000
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00004-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26a7cfdac1b0bcf874b4ed52835179ada7db7982c40203ec3907e5fbf161d8a0
3
+ size 4976549216
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00005-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c29daa6b3741ca5f73a6280295b17d9625b13177eb127e2becd1f5fd42d0c39
3
+ size 4909440000
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00006-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bed484fd7f5563fbf22547f6c737d9127b50ed2a5d0fc87278310359785ccde
3
+ size 4909440000
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q3_K_S-00007-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68a920ac296441302fc247074db36e853642c93f24d1b4fcb8d2829566e09d86
3
+ size 1277691968
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d080409acd42fabae3507249fc63afa33699e72ce78482d55b65dd9aab5f571
3
+ size 4917899104
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:504091a7bfe757b0a892b4101b7d6cc857f22b2e1bf8dcf0da9a306f757cc1f0
3
+ size 4994536640
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6dd67ac68e99781f4c199736da23a306f5199bfbdc4203b9c30e5c707df530c
3
+ size 4972483904
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be1f0b62fa0a61318b5e0124056ccc2674ad477e5fbcb7c84e9bcf57b4904970
3
+ size 4971369792
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2836152d0f2c460ff780054e2e74cff37f927e88dc0263ebcdd440f630c7a86
3
+ size 4932801728
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5439b495bd7a203e025b661b42b71950e0f4639d4f6d659420b125e230992fed
3
+ size 4878112064
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bc914e6e1401082178a1552a893baa4c0cfbf2869285299195eb36b8a091d60
3
+ size 4876997952
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01308f28164d52673a007ad6cae1765980ea42d1a21376b77fd66c29d541de93
3
+ size 4904391584
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_M-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe4a72c1639f808518a4485e38d53b5599ddb2c7a8576981c21b4491b25dcd03
3
+ size 3071806656
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76019bbb18f33f201b9155697c51a9907d920b740f8c1f9b71a82c0a3c8071d1
3
+ size 4999590048
mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S/mlabonne-Llama-3.1-70B-Instruct-lorablated-Q4_K_S-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64d242792c4ae08a221c41f4740776c4cd071312b5f73418accd0043ef7bbeaa
3
+ size 4955739680