JSON guided format
#10
by
chgrdj
- opened
Hey guys ,
Congrats for the model its overall really great. I encountered quite an annoying problem and wanted ot share here , maybe some of you had similar issue.
So im using minimax for multiple tasks and sometimes it must take decisions, to do so i use structured outputs, most of the time it works but from time to time will output just a loops of \n or \t characters, without outputting a valid JSON. That can break the whole flow .
For sampling i used these parameters :
{"temperature": 0.6, "top_p": 0.99,"top_k":40,"max_tokens": 8192}
Has anyone experienced the same problem ?
Thanks for the answer!