⚡ Prototype-X-12b ⚡
01 // Overview
Prototype-X-12b is a model merged using a custom flowforge method — it merges KansenSakura-Eclipse-RP-12B and KansenSakura-Radiance-RP-12B, with KansenSakura-Erosion-RP-12B as the base model.
02 // Custom Merge Method
It is a directional, coherence-aware merge algorithm that moves a base model along the weighted consensus direction defined by its donors rather than averaging them directly. Each donor’s influence is determined by its relative energy (the magnitude of its weight differences from the base), and the method normalizes and scales these offsets to preserve numerical stability. A small orthogonal adjustment prevents collapse when donors are highly similar, while the strength, trust, and top_k parameters control how far and how selectively the merge travels through parameter space. The result is a controlled shift in model behavior that reflects donor characteristics without discarding the base model’s underlying structure.
Show YAML
merge_method: flowforge models: - model: Retreatcost/KansenSakura-Eclipse-RP-12b - model: Retreatcost/KansenSakura-Radiance-RP-12b base_model: Retreatcost/KansenSakura-Erosion-RP-12b parameters: strength: 0.8 trust: 1.0 dtype: bfloat16 tokenizer: source: Retreatcost/KansenSakura-Erosion-RP-12b
03 // Acknowledgments
- Team Mradermacher — Static & imatrix quants
- DeathGodlike — EXL3 quants
- Original creators and model authors
- Downloads last month
- 44