Reasoning tags
#12
by
PSM24
- opened
I tried running Aquif-3.5-Max to test the benchmarks, but, it does not always respond in the ... format (it answers like an instruct model with a low temperature), and it sometimes includes the final answer in the tags... Is there a specific system prompt or setting to make it respond properly?
did you set thinking to true in the chat template?
did you set thinking to true in the chat template?
I just tried that, and it does not put the ending , but rather it ends with or other strings (it occasionally uses </think>, but not often)... Additionally, the final answer (after the) often gets into a loop...
aquiffoo
changed discussion status to
closed