sequelbox/Qwen3-4B-PlumEsper

PlumEsper

This is a merge of pre-trained language models created using mergekit, combining the specialty and general reasoning skills of Esper 3 4b and Shining Valiant 3 4b.

Merge Details

Merge Method

This model was merged using the DELLA merge method using Qwen/Qwen3-4B as a base.

Models Merged

The following models were included in the merge:

• ValiantLabs/Qwen3-4B-ShiningValiant3
• ValiantLabs/Qwen3-4B-Esper3

Configuration

The following YAML configuration was used to produce this model:

merge_method: della
dtype: bfloat16
parameters:
  normalize: true
models:
  - model: ValiantLabs/Qwen3-4B-Esper3
    parameters:
      density: 0.5
      weight: 0.3
  - model: ValiantLabs/Qwen3-4B-ShiningValiant3
    parameters:
      density: 0.5
      weight: 0.3
base_model: Qwen/Qwen3-4B