Synapse Open Synapse
AI

# One token at the beginning of a prompt changed 6 out of 15 LLM responses. Does it matter?

Reddit · r/LocalLLaMA ·

I'm back with another experiment. After the last heated discussion about KV cache, temperature 0, and reproducibility — where I got quite a beating for both my post and my writing style (partly deserved, to be fair ;) ) — I decided to investigate how models behave in Ollama and llama.cpp.

Latest from Reddit · r/LocalLLaMA