DavidAU commited on
Commit
d7ec027
·
verified ·
1 Parent(s): 1f19862

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -56,7 +56,8 @@ models into one massive powerhouse at 18.4B parameters (equal to 24B - 8 X 3B).
56
 
57
  This model's instruction following, and output generation for creative writing, prose, fiction and role play are exceptional.
58
 
59
- This model is also "gated", contains a master reasoning model (this can be turned on/off) and was built at float32 (32 bit) precision.
 
60
 
61
  The "gated" strucure means the "reasoning model" is re-inforced by the other 7 models in the MOE during reasoning, and then during
62
  output generation / non-reasoning the non-reasoning model(s) take control.
 
56
 
57
  This model's instruction following, and output generation for creative writing, prose, fiction and role play are exceptional.
58
 
59
+ This model is also "gated", contains a master reasoning model (this can be turned on/off), was built at float32 (32 bit) precision
60
+ and quants have the output tensor at Q8_0, with a few choice quants at f16 (16 bit) and a Q8_0 with f32 (32 bit).
61
 
62
  The "gated" strucure means the "reasoning model" is re-inforced by the other 7 models in the MOE during reasoning, and then during
63
  output generation / non-reasoning the non-reasoning model(s) take control.