Synapse Open Synapse
Open source

lyogavin/airllm

GitHub Trending · · 9 min read

AirLLM 2.8T LLM inference with single 4GB GPU Quickstart | Configurations | MacOS | Example notebooks | FAQ AirLLM dramatically reduces inference memory usage, letting 70B large language models run on a single 4GB GPU card — without quantization, distillation, or pruning.

Latest from GitHub Trending