Text Generation
GGUF
English
reasoning
thinking
uncensored
gated
mixture of experts
Mixture of Experts
8x3B
Llama 3.2 MOE
128k context
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
float32
swearing
rp
horror
mergekit
llama-3
llama-3.2
Update README.md
Browse files
README.md
CHANGED
|
@@ -39,12 +39,16 @@ tags:
|
|
| 39 |
pipeline_tag: text-generation
|
| 40 |
---
|
| 41 |
|
| 42 |
-
(quants uploading, model card updates pending, examples to be added.)
|
| 43 |
|
| 44 |
<B><font color="red">WARNING:</font> NSFW. Vivid prose. INTENSE. Visceral Details. Light HORROR. Swearing. UNCENSORED... humor, romance, fun. </B>
|
| 45 |
|
| 46 |
<h2>Llama-3.2-8X3B-GATED-MOE-Reasoning-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF</h2>
|
| 47 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 48 |
<img src="dark-champ.jpg" style="float:right; width:300px; height:300px; padding:10px;">
|
| 49 |
|
| 50 |
It is a LLama 3.2 model, max context of 128k (131,000) using mixture of experts to combine EIGHT top L3.2 3B
|
|
@@ -98,7 +102,7 @@ This model is comprised of the following 8 models ("the experts") (in full):
|
|
| 98 |
|
| 99 |
https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated
|
| 100 |
|
| 101 |
-
- https://huggingface.co/
|
| 102 |
- https://huggingface.co/Hastagaras/L3.2-JametMini-3B-MK.I
|
| 103 |
- https://huggingface.co/ValiantLabs/Llama3.2-3B-Enigma
|
| 104 |
- https://huggingface.co/Hastagaras/L3.2-JametMini-3B-MK.III
|
|
@@ -226,6 +230,130 @@ This repo contains regular quants.
|
|
| 226 |
|
| 227 |
For more information on quants, quants choices, and LLM/AI apps to "run" quants see the section below: "Highest Quality Settings..."
|
| 228 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 229 |
<B>Template:</B>
|
| 230 |
|
| 231 |
This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s).
|
|
|
|
| 39 |
pipeline_tag: text-generation
|
| 40 |
---
|
| 41 |
|
| 42 |
+
(quants uploading, model card updates pending, "gating" access/methods, examples to be added.)
|
| 43 |
|
| 44 |
<B><font color="red">WARNING:</font> NSFW. Vivid prose. INTENSE. Visceral Details. Light HORROR. Swearing. UNCENSORED... humor, romance, fun. </B>
|
| 45 |
|
| 46 |
<h2>Llama-3.2-8X3B-GATED-MOE-Reasoning-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF</h2>
|
| 47 |
|
| 48 |
+
<SMALL><font color="red">IMPORTANT:</font> This model has on/off/variable control reasoning from NousResearch and
|
| 49 |
+
the DeepHermes model, and requires a system prompt(s) as provided to invoke reasoning/thinking.
|
| 50 |
+
Please see operating instructions below for best performance.</SMALL>
|
| 51 |
+
|
| 52 |
<img src="dark-champ.jpg" style="float:right; width:300px; height:300px; padding:10px;">
|
| 53 |
|
| 54 |
It is a LLama 3.2 model, max context of 128k (131,000) using mixture of experts to combine EIGHT top L3.2 3B
|
|
|
|
| 102 |
|
| 103 |
https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated
|
| 104 |
|
| 105 |
+
- https://huggingface.co/NousResearch/DeepHermes-3-Llama-3-3B-Preview [reasoning model]
|
| 106 |
- https://huggingface.co/Hastagaras/L3.2-JametMini-3B-MK.I
|
| 107 |
- https://huggingface.co/ValiantLabs/Llama3.2-3B-Enigma
|
| 108 |
- https://huggingface.co/Hastagaras/L3.2-JametMini-3B-MK.III
|
|
|
|
| 230 |
|
| 231 |
For more information on quants, quants choices, and LLM/AI apps to "run" quants see the section below: "Highest Quality Settings..."
|
| 232 |
|
| 233 |
+
---
|
| 234 |
+
|
| 235 |
+
<B>System Role / System Prompts - Reasoning On/Off/Variable and Augment The Model's Power:</b>
|
| 236 |
+
|
| 237 |
+
<small> ( <font color="red">Critical Setting for model operation </font> ) </small>
|
| 238 |
+
|
| 239 |
+
---
|
| 240 |
+
|
| 241 |
+
System Role / System Prompt / System Message (called "System Prompt" in this section)
|
| 242 |
+
is "root access" to the model and controls internal workings - both instruction following and output generation and in the
|
| 243 |
+
case of this model reasoning control and on/off for reasoning too.
|
| 244 |
+
|
| 245 |
+
In this section I will show you basic, advanced, and combined "code" to control the model's reasoning, instruction following and output generation.
|
| 246 |
+
|
| 247 |
+
If you do not set a "system prompt", reasoning/thinking will be OFF by default, and the model will operate like a normal LLM.
|
| 248 |
+
|
| 249 |
+
HOW TO SET:
|
| 250 |
+
|
| 251 |
+
Depending on your AI "app" you may have to copy/paste on of the "codes" below to enable reasoning/thinking in the
|
| 252 |
+
"System Prompt" or "System Role" window.
|
| 253 |
+
|
| 254 |
+
In Lmstudio set/activate "Power User" or "Developer" mode to access, copy/paste to System Prompt Box.
|
| 255 |
+
|
| 256 |
+
In SillyTavern go to the "template page" ("A") , activate "system prompt" and enter the text in the prompt box.
|
| 257 |
+
|
| 258 |
+
In Ollama see [ https://github.com/ollama/ollama/blob/main/README.md ] ; and setting the "system message".
|
| 259 |
+
|
| 260 |
+
In Koboldcpp, load the model, start it, go to settings -> select "Llama 3 Chat"/"Command-R" and enter the text in the "sys prompt" box.
|
| 261 |
+
|
| 262 |
+
SYSTEM PROMPTS AVAILABLE:
|
| 263 |
+
|
| 264 |
+
When you copy/paste PRESERVE formatting, including line breaks.
|
| 265 |
+
|
| 266 |
+
If you want to edit/adjust these only do so in NOTEPAD OR the LLM App directly.
|
| 267 |
+
|
| 268 |
+
IMPORTANT:
|
| 269 |
+
|
| 270 |
+
Note some of these have "names" in them for the AIs - DO NOT change these - as these are internal references
|
| 271 |
+
inside the structure of the MOE model ; roughly speaking these are triggers.
|
| 272 |
+
|
| 273 |
+
SIMPLE:
|
| 274 |
+
|
| 275 |
+
This is the generic system prompt used for generation and testing [no reasoning]:
|
| 276 |
+
|
| 277 |
+
<PRE>
|
| 278 |
+
You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.
|
| 279 |
+
</PRE>
|
| 280 |
+
|
| 281 |
+
This System Role/Prompt will give you "basic thinking/reasoning" [basic reasoning]:
|
| 282 |
+
|
| 283 |
+
<PRE>
|
| 284 |
+
You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.
|
| 285 |
+
</PRE>
|
| 286 |
+
|
| 287 |
+
MULTI-TIERED [reasoning on]:
|
| 288 |
+
|
| 289 |
+
```
|
| 290 |
+
You are a deep thinking AI composed of 4 AIs - Spock, Wordsmith, Jamet and Saten, - you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself (and 4 partners) via systematic reasoning processes (display all 4 partner thoughts) to help come to a correct solution prior to answering. Select one partner to think deeply about the points brought up by the other 3 partners to plan an in-depth solution. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem using your skillsets and critical instructions.
|
| 291 |
+
```
|
| 292 |
+
|
| 293 |
+
MULTI-TIERED - CREATIVE [reasoning on]:
|
| 294 |
+
|
| 295 |
+
```
|
| 296 |
+
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.
|
| 297 |
+
|
| 298 |
+
As a deep thinking AI composed of 4 AIs - Spock, Wordsmith, Jamet and Saten, - you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself (and 4 partners) via systematic reasoning processes (display all 4 partner thoughts) to help come to a correct solution prior to answering. Select one partner to think deeply about the points brought up by the other 3 partners to plan an in-depth solution. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem using your skillsets and critical instructions.
|
| 299 |
+
|
| 300 |
+
Here are your skillsets:
|
| 301 |
+
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)
|
| 302 |
+
|
| 303 |
+
[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)
|
| 304 |
+
|
| 305 |
+
Here are your critical instructions:
|
| 306 |
+
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
|
| 307 |
+
```
|
| 308 |
+
|
| 309 |
+
CREATIVE SIMPLE [reasoning on]:
|
| 310 |
+
|
| 311 |
+
<PRE>
|
| 312 |
+
You are an AI assistant developed by a world wide community of ai experts.
|
| 313 |
+
|
| 314 |
+
Your primary directive is to provide highly creative, well-reasoned, structured, and extensively detailed responses.
|
| 315 |
+
|
| 316 |
+
Formatting Requirements:
|
| 317 |
+
|
| 318 |
+
1. Always structure your replies using: <think>{reasoning}</think>{answer}
|
| 319 |
+
2. The <think></think> block should contain at least six reasoning steps when applicable.
|
| 320 |
+
3. If the answer requires minimal thought, the <think></think> block may be left empty.
|
| 321 |
+
4. The user does not see the <think></think> section. Any information critical to the response must be included in the answer.
|
| 322 |
+
5. If you notice that you have engaged in circular reasoning or repetition, immediately terminate {reasoning} with a </think> and proceed to the {answer}
|
| 323 |
+
|
| 324 |
+
Response Guidelines:
|
| 325 |
+
|
| 326 |
+
1. Detailed and Structured: Use rich Markdown formatting for clarity and readability.
|
| 327 |
+
2. Creative and Logical Approach: Your explanations should reflect the depth and precision of the greatest creative minds first.
|
| 328 |
+
3. Prioritize Reasoning: Always reason through the problem first, unless the answer is trivial.
|
| 329 |
+
4. Concise yet Complete: Ensure responses are informative, yet to the point without unnecessary elaboration.
|
| 330 |
+
5. Maintain a professional, intelligent, and analytical tone in all interactions.
|
| 331 |
+
</PRE>
|
| 332 |
+
|
| 333 |
+
CREATIVE ADVANCED [reasoning on]:
|
| 334 |
+
|
| 335 |
+
NOTE: To turn reasoning off, remove line #2.
|
| 336 |
+
|
| 337 |
+
This system prompt can often generation multiple outputs and/or thinking blocks.
|
| 338 |
+
|
| 339 |
+
```
|
| 340 |
+
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.
|
| 341 |
+
|
| 342 |
+
You may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem
|
| 343 |
+
|
| 344 |
+
Here are your skillsets:
|
| 345 |
+
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)
|
| 346 |
+
|
| 347 |
+
[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)
|
| 348 |
+
|
| 349 |
+
Here are your critical instructions:
|
| 350 |
+
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
|
| 351 |
+
```
|
| 352 |
+
|
| 353 |
+
---
|
| 354 |
+
|
| 355 |
+
|
| 356 |
+
|
| 357 |
<B>Template:</B>
|
| 358 |
|
| 359 |
This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s).
|