Synapse Open Synapse
AI

LFM3-Omni-2B running locally in-browser on WebGPU

Reddit · r/LocalLLaMA ·

The first true omni model that can run 100% locally in a browser... fully end-to-end, with no separate ASR or TTS models needed. With custom WebGPU kernels, we're able to run LFM3-Omni-2B at ~280 tok/s on an M4 Max, accepting visual, audio, or text and producing interleaved text and audio tokens.

Latest from Reddit · r/LocalLLaMA