abliteration loras
Collection
Extracted adapters for removing censorship in models • 3 items • Updated • 3
How to use nbeerbower/Mistral-Nemo-12B-abliterated-LORA with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("nbeerbower/Mistral-Nemo-12B-abliterated-LORA", device_map="auto")How to use nbeerbower/Mistral-Nemo-12B-abliterated-LORA with PEFT:
Task type is invalid.
This is a LoRA extracted from a language model. It was extracted using mergekit.
This LoRA adapter was extracted from natong19/Mistral-Nemo-Instruct-2407-abliterated and uses mistralai/Mistral-Nemo-Instruct-2407 as a base.
The following command was used to extract this LoRA adapter:
mergekit-extract-lora natong19/Mistral-Nemo-Instruct-2407-abliterated mistralai/Mistral-Nemo-Instruct-2407 OUTPUT_PATH --rank=64