Synapse Open Synapse
AI

Do we have any benchmarks on quality degradation between Basalt, Infernix, Strata(-nvfp4)? Not "engine go more brr" benchmarks, exploring wrong avenues fast is worthless.

Reddit · r/LocalLLaMA · · 1 min read

While fast inference is very welcome, I would like to know if it's worth increasing the speed over strata-nvfp4 or am I paying some unacceptable penalties.

Latest from Reddit · r/LocalLLaMA