Synapse Open Synapse
AI

Benchmarks are an unreliable measure of difficulty

Reddit · r/LocalLLaMA · · 1 min read

Very interesting paper on the way that benchmark question difficulty and framing affect the observed improvement in scores for model training.

Latest from Reddit · r/LocalLLaMA