Synapse Open Synapse
Open source

Show HN: Benchmarking DSpark speculative decoding on a consumer GPU

Show HN · · 8 min read

Does DSpark speculative decoding help on your GPU, for one user? Reproducible batch-size-1 benchmarks for llama.cpp on consumer GPUs. - juraj-jumic/dspark-local-bench

Latest from Show HN