Vortex5 commited on
Commit
4249aae
·
verified ·
1 Parent(s): 78bd9db

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +126 -18
README.md CHANGED
@@ -7,30 +7,129 @@ library_name: transformers
7
  tags:
8
  - mergekit
9
  - merge
10
-
11
  ---
12
- # merge
13
-
14
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
-
16
- ## Merge Details
17
- ### Merge Method
18
-
19
- This model was merged using the flowforge merge method using [Retreatcost/KansenSakura-Erosion-RP-12b](https://huggingface.co/Retreatcost/KansenSakura-Erosion-RP-12b) as a base.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
 
21
- ### Models Merged
 
 
22
 
23
- The following models were included in the merge:
24
- * [Retreatcost/KansenSakura-Eclipse-RP-12b](https://huggingface.co/Retreatcost/KansenSakura-Eclipse-RP-12b)
25
- * [Retreatcost/KansenSakura-Radiance-RP-12b](https://huggingface.co/Retreatcost/KansenSakura-Radiance-RP-12b)
 
 
 
26
 
27
- ### Configuration
28
 
29
- The following YAML configuration was used to produce this model:
 
 
 
30
 
31
- ```yaml
 
32
 
33
- merge_method: flowforge
 
 
34
  models:
35
  - model: Retreatcost/KansenSakura-Eclipse-RP-12b
36
  - model: Retreatcost/KansenSakura-Radiance-RP-12b
@@ -41,5 +140,14 @@ parameters:
41
  dtype: bfloat16
42
  tokenizer:
43
  source: Retreatcost/KansenSakura-Erosion-RP-12b
 
 
44
 
45
- ```
 
 
 
 
 
 
 
 
7
  tags:
8
  - mergekit
9
  - merge
10
+ - roleplay
11
  ---
12
+ <style>
13
+ .blackforge-shell {
14
+ max-width: 1000px;
15
+ margin: 40px auto;
16
+ padding: 0 14px;
17
+ background: radial-gradient(circle at 40% 60%, rgba(0,3,0,0.96) 0%, rgba(0,0,0,0.99) 100%);
18
+ border: 2px solid rgba(0,160,70,0.35);
19
+ border-radius: 16px;
20
+ box-shadow:
21
+ 0 0 60px rgba(0,160,70,0.25),
22
+ inset 0 0 50px rgba(0,120,50,0.2),
23
+ 0 0 0 3px rgba(0,100,40,0.25);
24
+ color: #d0ffd6;
25
+ font-family: "Inter", "Segoe UI", system-ui, sans-serif;
26
+ text-align: left;
27
+ overflow: hidden;
28
+ }
29
+ .title-block {
30
+ margin: 42px 0 26px 0;
31
+ text-align: center;
32
+ background: linear-gradient(100deg, rgba(0,50,0,0.7), rgba(0,110,40,0.6), rgba(0,150,100,0.65));
33
+ border: 1px solid rgba(0,200,100,0.25);
34
+ border-radius: 14px;
35
+ padding: 16px 12px;
36
+ box-shadow:
37
+ 0 0 25px rgba(0,160,70,0.35),
38
+ inset 0 0 25px rgba(0,180,100,0.25);
39
+ position: relative;
40
+ overflow: hidden;
41
+ }
42
+ .title-block::before {
43
+ content: "";
44
+ position: absolute;
45
+ top: 0; left: -70%;
46
+ width: 45%;
47
+ height: 100%;
48
+ background: linear-gradient(120deg, rgba(255,255,255,0.15), rgba(255,255,255,0));
49
+ transform: skewX(-25deg);
50
+ animation: beamSlide 8s linear infinite;
51
+ }
52
+ @keyframes beamSlide {
53
+ 0% { left: -70%; }
54
+ 50% { left: 115%; }
55
+ 100% { left: -70%; }
56
+ }
57
+ .title-block h2 {
58
+ margin: 0;
59
+ font-size: 1.3rem;
60
+ letter-spacing: 2px;
61
+ text-transform: uppercase;
62
+ background: linear-gradient(90deg, #42ff90, #96ffb2, #2aff74);
63
+ -webkit-background-clip: text;
64
+ -webkit-text-fill-color: transparent;
65
+ text-shadow:
66
+ 0 0 12px rgba(70,255,130,0.6),
67
+ 0 0 24px rgba(50,255,100,0.4);
68
+ }
69
+ .title-block:hover h2 {
70
+ text-shadow:
71
+ 0 0 14px rgba(120,255,180,0.8),
72
+ 0 0 28px rgba(90,255,150,0.9);
73
+ }
74
+ .blackforge-shell pre {
75
+ background: rgba(0,5,0,0.9);
76
+ color: #e9ffed;
77
+ border-left: 4px solid rgba(0,200,90,0.7);
78
+ border-radius: 10px;
79
+ padding: 14px;
80
+ font-size: 13px;
81
+ overflow-x: auto;
82
+ box-shadow: inset 0 0 12px rgba(0,255,120,0.18);
83
+ }
84
+ details summary {
85
+ cursor: pointer;
86
+ font-weight: 600;
87
+ color: #b5ffd1;
88
+ margin: 10px 0;
89
+ }
90
+ .blackforge-shell a {
91
+ color: #7effa9;
92
+ text-decoration: none;
93
+ transition: color 0.25s ease, text-shadow 0.25s ease;
94
+ }
95
+ .blackforge-shell a:hover {
96
+ color: #baffd7;
97
+ text-shadow: 0 0 8px rgba(170,255,200,0.7);
98
+ }
99
+ .blackforge-divider {
100
+ height: 10px;
101
+ max-width: 900px;
102
+ margin: 30px auto;
103
+ background: radial-gradient(circle, rgba(0,255,100,0.25), rgba(0,20,0,0.9));
104
+ border-radius: 50%;
105
+ box-shadow: inset 0 0 30px rgba(0,255,100,0.3);
106
+ }
107
+ </style>
108
 
109
+ <div class="title-block" style="max-width:1000px;margin:40px auto;text-align:center;">
110
+ <h2 style="font-size:2.3rem;">⚡ Prototype-X-12b ⚡</h2>
111
+ </div>
112
 
113
+ <div style="max-width:1000px;margin:0 auto 25px;padding:0 12px;text-align:center;">
114
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/s83QTz1ZY8K-PeMrPmL5b.png"
115
+ style="width:100%;max-width:960px;border-radius:14px;
116
+ border:2px solid rgba(0,180,80,0.45);
117
+ box-shadow:0 0 60px rgba(0,180,70,0.35), inset 0 0 12px rgba(0,255,140,0.2);" />
118
+ </div>
119
 
120
+ <div class="blackforge-divider"></div>
121
 
122
+ <div class="blackforge-shell">
123
+ <div style="padding:30px 32px;">
124
+ <div class="title-block"><h2>01 // Overview</h2></div>
125
+ <p><strong>Prototype-X-12b</strong> is a model merged using a custom <code>flowforge</code> method — it merges <a href="https://huggingface.co/Retreatcost/KansenSakura-Eclipse-RP-12b">KansenSakura-Eclipse-RP-12B</a> and <a href="https://huggingface.co/Retreatcost/KansenSakura-Radiance-RP-12b">KansenSakura-Radiance-RP-12B</a>, with <a href="https://huggingface.co/Retreatcost/KansenSakura-Erosion-RP-12b">KansenSakura-Erosion-RP-12B</a> as the base model.</p>
126
 
127
+ <div class="title-block"><h2>02 // Custom Merge Method</h2></div>
128
+ <p>It is a directional, coherence-aware merge algorithm that moves a base model along the weighted consensus direction defined by its donors rather than averaging them directly. Each donor’s influence is determined by its relative energy (the magnitude of its weight differences from the base), and the method normalizes and scales these offsets to preserve numerical stability. A small orthogonal adjustment prevents collapse when donors are highly similar, while the <b>strength</b>, <b>trust</b>, and <b>top_k</b> parameters control how far and how selectively the merge travels through parameter space. The result is a controlled shift in model behavior that reflects donor characteristics without discarding the base model’s underlying structure.</p>
129
 
130
+ <details>
131
+ <summary>Show YAML</summary>
132
+ <pre>merge_method: flowforge
133
  models:
134
  - model: Retreatcost/KansenSakura-Eclipse-RP-12b
135
  - model: Retreatcost/KansenSakura-Radiance-RP-12b
 
140
  dtype: bfloat16
141
  tokenizer:
142
  source: Retreatcost/KansenSakura-Erosion-RP-12b
143
+ </pre>
144
+ </details>
145
 
146
+ <div class="title-block"><h2>03 // Acknowledgments</h2></div>
147
+ <ul style="list-style:none;padding-left:0;line-height:1.8;">
148
+ <li><strong><a href="https://huggingface.co/mradermacher" target="_blank">Team Mradermacher</a></strong> — Static & imatrix quants</li>
149
+ <li><strong><a href="https://huggingface.co/DeathGodlike" target="_blank">DeathGodlike</a></strong> — EXL3 quants</li>
150
+ <li><strong><a>Original creators and model authors</a></strong></li>
151
+ </ul>
152
+ </div>
153
+ </div>