Synapse Open Synapse
Open source

vllm-project/vllm

GitHub Trending · · 2 min read

A high-throughput and memory-efficient inference and serving engine for LLMs https://vllm.ai Easy, fast, and cheap LLM serving for everyone | Documentation | Blog | Paper | Twitter/X | User Forum | Developer Slack | 🔥 We have built a vLLM website to help you get started with vLLM.

Latest from GitHub Trending