Synapse Open Synapse
AI

inferencekit: open-source plugin to optimize any model on any hardware using coding agents

Reddit · r/LocalLLaMA · · 1 min read

KittenML just released inferencekit , a free opensource plugin to turn coding agents(Claude Code, Codex, OpenCode) into inference engineers for your hardware. Most models ship with inference tuned for whatever hardware the authors used, which is usually not what you have locally.

Latest from Reddit · r/LocalLLaMA