ngxson
/

DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

Text Generation

Model card Files Files and versions

DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

This is made by using llama-export-lora

Base model: https://huggingface.co/bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF
LoRA adapter: https://huggingface.co/ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

Downloads last month: 316

GGUF

Model size

8B params

Architecture

qwen2

Hardware compatibility

Log In to view the estimation

4-bit

16-bit

Model tree for ngxson/DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

Base model

deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

Quantized

(162)

this model

Space using ngxson/DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF 1