Description

I reuploaded one of the smaller versions of this model originaly posted by TheBloke.

Original found here https://huggingface.co/TheBloke/SOLARC-MOE-10.7Bx4-GGUF

This repo contains GGUF format model files for Seungyoo Lee's Solarc MOE 10.7Bx4.

These files were quantised using hardware kindly provided by Massed Compute.

Downloads last month
5
GGUF
Model size
36B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

3-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for crystalkalem/SOLARC-MOE-10.7Bx4-GGUF

Quantized
(5)
this model