How to stop this model from thinking.
#2
by
CreeperMZ
- opened
When I tried running it with sglang, the model still kept thinking. At first I thought it was a chat_template issue, so I switched to the 235B Instruct version chat template, but that still didn't stop the thinking.
Ohh
CreeperMZ
changed discussion status to
closed
I should post that to FP8