this model thinks a lot

#14
by shihab456321 - opened

decisively the best model i have ever seen, but becoming unusable for too much thinking

Agreed. It uses the majority of it's tokens on thinking. It really hampers using it in edge scenarios or on mobile. A way to limit thinking would be good.

Sign up or log in to comment