Synapse Open Synapse
AI

1Cat-vLLM vs Strata

Reddit · r/LocalLLaMA · · 3 min read

Edit: 1Cat-vLLM is a Tesla V100 focused fork of vLLM, and the expert caching work is 1Cat's original work, which may or may not one day make it to vLLM.

Latest from Reddit · r/LocalLLaMA