Synapse Open Synapse
AI

YSK: Strata and polystrata have this functionality called answer_room

Reddit · r/LocalLLaMA · · 1 min read

With default settings and thinking on and max_tokens ≥ 1024, and no explicit reasoning_budget_tokens , Strata / PolyStrata has a behavior called answer_room which will silently cap thinking at 0.75.

Latest from Reddit · r/LocalLLaMA