--- base_model: - Retreatcost/KansenSakura-Eclipse-RP-12b - Retreatcost/KansenSakura-Radiance-RP-12b - Retreatcost/KansenSakura-Erosion-RP-12b library_name: transformers tags: - mergekit - merge - roleplay ---
Prototype-X-12b is a model merged using a custom flowforge method — it merges KansenSakura-Eclipse-RP-12B and KansenSakura-Radiance-RP-12B, with KansenSakura-Erosion-RP-12B as the base model.
It is a directional, coherence-aware merge algorithm that moves a base model along the weighted consensus direction defined by its donors rather than averaging them directly. Each donor’s influence is determined by its relative energy (the magnitude of its weight differences from the base), and the method normalizes and scales these offsets to preserve numerical stability. A small orthogonal adjustment prevents collapse when donors are highly similar, while the strength, trust, and top_k parameters control how far and how selectively the merge travels through parameter space. The result is a controlled shift in model behavior that reflects donor characteristics without discarding the base model’s underlying structure.
merge_method: flowforge models: - model: Retreatcost/KansenSakura-Eclipse-RP-12b - model: Retreatcost/KansenSakura-Radiance-RP-12b base_model: Retreatcost/KansenSakura-Erosion-RP-12b parameters: strength: 0.8 trust: 1.0 dtype: bfloat16 tokenizer: source: Retreatcost/KansenSakura-Erosion-RP-12b