Synapse Open Synapse
Open source

lightseekorg/tokenspeed

GitHub Trending · · 2 min read

TokenSpeed is a speed-of-light LLM inference engine. https://lightseek.org/blog/lightseek-tokenspeed.html TokenSpeed is a speed-of-light LLM inference engine designed for agentic workloads , with TensorRT-LLM-level performance and vLLM-level usability.

Latest from GitHub Trending