XXXXyu/Llama3-8B-1.58-100B-tokens-vlut-gguf
Text Generation
•
8B
•
Updated
•
176
vlut.cpp
SOTA ternary-packed versions of 1.58-bit LLMs for efficient on-device inference with vlut.cpp.