Update README.md
Browse files
README.md
CHANGED
|
@@ -7,30 +7,129 @@ library_name: transformers
|
|
| 7 |
tags:
|
| 8 |
- mergekit
|
| 9 |
- merge
|
| 10 |
-
|
| 11 |
---
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
-
|
|
|
|
|
|
|
| 22 |
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
|
|
|
|
|
|
|
|
|
| 26 |
|
| 27 |
-
|
| 28 |
|
| 29 |
-
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
-
|
|
|
|
| 32 |
|
| 33 |
-
|
|
|
|
|
|
|
| 34 |
models:
|
| 35 |
- model: Retreatcost/KansenSakura-Eclipse-RP-12b
|
| 36 |
- model: Retreatcost/KansenSakura-Radiance-RP-12b
|
|
@@ -41,5 +140,14 @@ parameters:
|
|
| 41 |
dtype: bfloat16
|
| 42 |
tokenizer:
|
| 43 |
source: Retreatcost/KansenSakura-Erosion-RP-12b
|
|
|
|
|
|
|
| 44 |
|
| 45 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
tags:
|
| 8 |
- mergekit
|
| 9 |
- merge
|
| 10 |
+
- roleplay
|
| 11 |
---
|
| 12 |
+
<style>
|
| 13 |
+
.blackforge-shell {
|
| 14 |
+
max-width: 1000px;
|
| 15 |
+
margin: 40px auto;
|
| 16 |
+
padding: 0 14px;
|
| 17 |
+
background: radial-gradient(circle at 40% 60%, rgba(0,3,0,0.96) 0%, rgba(0,0,0,0.99) 100%);
|
| 18 |
+
border: 2px solid rgba(0,160,70,0.35);
|
| 19 |
+
border-radius: 16px;
|
| 20 |
+
box-shadow:
|
| 21 |
+
0 0 60px rgba(0,160,70,0.25),
|
| 22 |
+
inset 0 0 50px rgba(0,120,50,0.2),
|
| 23 |
+
0 0 0 3px rgba(0,100,40,0.25);
|
| 24 |
+
color: #d0ffd6;
|
| 25 |
+
font-family: "Inter", "Segoe UI", system-ui, sans-serif;
|
| 26 |
+
text-align: left;
|
| 27 |
+
overflow: hidden;
|
| 28 |
+
}
|
| 29 |
+
.title-block {
|
| 30 |
+
margin: 42px 0 26px 0;
|
| 31 |
+
text-align: center;
|
| 32 |
+
background: linear-gradient(100deg, rgba(0,50,0,0.7), rgba(0,110,40,0.6), rgba(0,150,100,0.65));
|
| 33 |
+
border: 1px solid rgba(0,200,100,0.25);
|
| 34 |
+
border-radius: 14px;
|
| 35 |
+
padding: 16px 12px;
|
| 36 |
+
box-shadow:
|
| 37 |
+
0 0 25px rgba(0,160,70,0.35),
|
| 38 |
+
inset 0 0 25px rgba(0,180,100,0.25);
|
| 39 |
+
position: relative;
|
| 40 |
+
overflow: hidden;
|
| 41 |
+
}
|
| 42 |
+
.title-block::before {
|
| 43 |
+
content: "";
|
| 44 |
+
position: absolute;
|
| 45 |
+
top: 0; left: -70%;
|
| 46 |
+
width: 45%;
|
| 47 |
+
height: 100%;
|
| 48 |
+
background: linear-gradient(120deg, rgba(255,255,255,0.15), rgba(255,255,255,0));
|
| 49 |
+
transform: skewX(-25deg);
|
| 50 |
+
animation: beamSlide 8s linear infinite;
|
| 51 |
+
}
|
| 52 |
+
@keyframes beamSlide {
|
| 53 |
+
0% { left: -70%; }
|
| 54 |
+
50% { left: 115%; }
|
| 55 |
+
100% { left: -70%; }
|
| 56 |
+
}
|
| 57 |
+
.title-block h2 {
|
| 58 |
+
margin: 0;
|
| 59 |
+
font-size: 1.3rem;
|
| 60 |
+
letter-spacing: 2px;
|
| 61 |
+
text-transform: uppercase;
|
| 62 |
+
background: linear-gradient(90deg, #42ff90, #96ffb2, #2aff74);
|
| 63 |
+
-webkit-background-clip: text;
|
| 64 |
+
-webkit-text-fill-color: transparent;
|
| 65 |
+
text-shadow:
|
| 66 |
+
0 0 12px rgba(70,255,130,0.6),
|
| 67 |
+
0 0 24px rgba(50,255,100,0.4);
|
| 68 |
+
}
|
| 69 |
+
.title-block:hover h2 {
|
| 70 |
+
text-shadow:
|
| 71 |
+
0 0 14px rgba(120,255,180,0.8),
|
| 72 |
+
0 0 28px rgba(90,255,150,0.9);
|
| 73 |
+
}
|
| 74 |
+
.blackforge-shell pre {
|
| 75 |
+
background: rgba(0,5,0,0.9);
|
| 76 |
+
color: #e9ffed;
|
| 77 |
+
border-left: 4px solid rgba(0,200,90,0.7);
|
| 78 |
+
border-radius: 10px;
|
| 79 |
+
padding: 14px;
|
| 80 |
+
font-size: 13px;
|
| 81 |
+
overflow-x: auto;
|
| 82 |
+
box-shadow: inset 0 0 12px rgba(0,255,120,0.18);
|
| 83 |
+
}
|
| 84 |
+
details summary {
|
| 85 |
+
cursor: pointer;
|
| 86 |
+
font-weight: 600;
|
| 87 |
+
color: #b5ffd1;
|
| 88 |
+
margin: 10px 0;
|
| 89 |
+
}
|
| 90 |
+
.blackforge-shell a {
|
| 91 |
+
color: #7effa9;
|
| 92 |
+
text-decoration: none;
|
| 93 |
+
transition: color 0.25s ease, text-shadow 0.25s ease;
|
| 94 |
+
}
|
| 95 |
+
.blackforge-shell a:hover {
|
| 96 |
+
color: #baffd7;
|
| 97 |
+
text-shadow: 0 0 8px rgba(170,255,200,0.7);
|
| 98 |
+
}
|
| 99 |
+
.blackforge-divider {
|
| 100 |
+
height: 10px;
|
| 101 |
+
max-width: 900px;
|
| 102 |
+
margin: 30px auto;
|
| 103 |
+
background: radial-gradient(circle, rgba(0,255,100,0.25), rgba(0,20,0,0.9));
|
| 104 |
+
border-radius: 50%;
|
| 105 |
+
box-shadow: inset 0 0 30px rgba(0,255,100,0.3);
|
| 106 |
+
}
|
| 107 |
+
</style>
|
| 108 |
|
| 109 |
+
<div class="title-block" style="max-width:1000px;margin:40px auto;text-align:center;">
|
| 110 |
+
<h2 style="font-size:2.3rem;">⚡ Prototype-X-12b ⚡</h2>
|
| 111 |
+
</div>
|
| 112 |
|
| 113 |
+
<div style="max-width:1000px;margin:0 auto 25px;padding:0 12px;text-align:center;">
|
| 114 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/s83QTz1ZY8K-PeMrPmL5b.png"
|
| 115 |
+
style="width:100%;max-width:960px;border-radius:14px;
|
| 116 |
+
border:2px solid rgba(0,180,80,0.45);
|
| 117 |
+
box-shadow:0 0 60px rgba(0,180,70,0.35), inset 0 0 12px rgba(0,255,140,0.2);" />
|
| 118 |
+
</div>
|
| 119 |
|
| 120 |
+
<div class="blackforge-divider"></div>
|
| 121 |
|
| 122 |
+
<div class="blackforge-shell">
|
| 123 |
+
<div style="padding:30px 32px;">
|
| 124 |
+
<div class="title-block"><h2>01 // Overview</h2></div>
|
| 125 |
+
<p><strong>Prototype-X-12b</strong> is a model merged using a custom <code>flowforge</code> method — it merges <a href="https://huggingface.co/Retreatcost/KansenSakura-Eclipse-RP-12b">KansenSakura-Eclipse-RP-12B</a> and <a href="https://huggingface.co/Retreatcost/KansenSakura-Radiance-RP-12b">KansenSakura-Radiance-RP-12B</a>, with <a href="https://huggingface.co/Retreatcost/KansenSakura-Erosion-RP-12b">KansenSakura-Erosion-RP-12B</a> as the base model.</p>
|
| 126 |
|
| 127 |
+
<div class="title-block"><h2>02 // Custom Merge Method</h2></div>
|
| 128 |
+
<p>It is a directional, coherence-aware merge algorithm that moves a base model along the weighted consensus direction defined by its donors rather than averaging them directly. Each donor’s influence is determined by its relative energy (the magnitude of its weight differences from the base), and the method normalizes and scales these offsets to preserve numerical stability. A small orthogonal adjustment prevents collapse when donors are highly similar, while the <b>strength</b>, <b>trust</b>, and <b>top_k</b> parameters control how far and how selectively the merge travels through parameter space. The result is a controlled shift in model behavior that reflects donor characteristics without discarding the base model’s underlying structure.</p>
|
| 129 |
|
| 130 |
+
<details>
|
| 131 |
+
<summary>Show YAML</summary>
|
| 132 |
+
<pre>merge_method: flowforge
|
| 133 |
models:
|
| 134 |
- model: Retreatcost/KansenSakura-Eclipse-RP-12b
|
| 135 |
- model: Retreatcost/KansenSakura-Radiance-RP-12b
|
|
|
|
| 140 |
dtype: bfloat16
|
| 141 |
tokenizer:
|
| 142 |
source: Retreatcost/KansenSakura-Erosion-RP-12b
|
| 143 |
+
</pre>
|
| 144 |
+
</details>
|
| 145 |
|
| 146 |
+
<div class="title-block"><h2>03 // Acknowledgments</h2></div>
|
| 147 |
+
<ul style="list-style:none;padding-left:0;line-height:1.8;">
|
| 148 |
+
<li><strong><a href="https://huggingface.co/mradermacher" target="_blank">Team Mradermacher</a></strong> — Static & imatrix quants</li>
|
| 149 |
+
<li><strong><a href="https://huggingface.co/DeathGodlike" target="_blank">DeathGodlike</a></strong> — EXL3 quants</li>
|
| 150 |
+
<li><strong><a>Original creators and model authors</a></strong></li>
|
| 151 |
+
</ul>
|
| 152 |
+
</div>
|
| 153 |
+
</div>
|