---
base_model:
- google/gemma-3-1b-pt
- TheMockingJay1013/gemma-3-sft-peft-dare
- TheMockingJay1013/gemma-3-peft-safe
library_name: transformers
tags:
- mergekit
- merge

---
# merged

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Task Arithmetic](https://arxiv.org/abs/2212.04089) merge method using [google/gemma-3-1b-pt](https://huggingface.co/google/gemma-3-1b-pt) as a base.

### Models Merged

The following models were included in the merge:
* [TheMockingJay1013/gemma-3-sft-peft-dare](https://huggingface.co/TheMockingJay1013/gemma-3-sft-peft-dare)
* [TheMockingJay1013/gemma-3-peft-safe](https://huggingface.co/TheMockingJay1013/gemma-3-peft-safe)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
base_model: google/gemma-3-1b-pt
merge_method: task_arithmetic
modules:
  default:
    slices:
    - sources:
      - layer_range: [0, 26]
        model: TheMockingJay1013/gemma-3-sft-peft-dare
        parameters:
          weight: 1.0
      - layer_range: [0, 26]
        model: TheMockingJay1013/gemma-3-peft-safe
        parameters:
          weight: 1.0
      - layer_range: [0, 26]
        model: google/gemma-3-1b-pt
```