Synapse Open Synapse
AI

How do you locally benchmark and compare local LLMs?

Reddit · r/LocalLLaMA · · 1 min read

If I wanted to locally compare performance for multiple different offline LLM models across various modalities (speed, efficiency, reasoning, tool use, programing/coding, etc), what strategies, prompts, software are commonly used to do this?

Latest from Reddit · r/LocalLLaMA