Synapse Open Synapse
AI

Infinite Loop

Reddit · r/LocalLLaMA · · 1 min read

Several of the models I've used so far (especially the quantized ones) get stuck in a loop during the thinking phase, repeating the same thing indefinitely. Does this happen with non quantized, local models too? And why this never happens with closed models.

Latest from Reddit · r/LocalLLaMA