Show HN: Benchmarking DSpark speculative decoding on a consumer GPU
Does DSpark speculative decoding help on your GPU, for one user? Reproducible batch-size-1 benchmarks for llama.cpp on consumer GPUs. - juraj-jumic/dspark-local-bench
Does DSpark speculative decoding help on your GPU, for one user? Reproducible batch-size-1 benchmarks for llama.cpp on consumer GPUs. - juraj-jumic/dspark-local-bench