MiniusLight-24B

12B - 24B-v1 - 24B-v1.01

Origin Content (Click Here)

What is this?

A nice, simple Slerp merge of 2 Mistral "Small" model and well-known HuggingFace users, TheDrummer/Cydonia-24B-v2 & PocketDoc/Dans-PersonalityEngine-V1.2.0-24b.

This version is the best merge version and recipe I have tried with a good eval scores. Strong in ERP, RP, Story Writing and orther purpose.

Overall, nice to try model, if you want to try. :)

GGUF

Static - iMatrix

Other information

Chat Template? ChatML, of course!

Merge Method

Detail YAML Config

  {
  models:
    - model: TheDrummer/Cydonia-24B-v2
    - model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
  merge_method: slerp
  base_model: TheDrummer/Cydonia-24B-v2
  parameters:
    t: [0.1, 0.3, 0.6, 0.3, 0.1]
  dtype: bfloat16
  }