Synapse Open Synapse
AI

I built a benchmark where LLMs reverse-engineer an audio codec, and the benchmark evolves

Reddit · r/LocalLLaMA · · 2 min read

Most coding benchmarks feel like textbook coding tasks or black boxes — either easy to benchmaxx or full of hidden tasks with unclear evaluation criteria. And most of them get irrelevant with each new model generation because all of the new models hit the ceiling.

Latest from Reddit · r/LocalLLaMA