Synapse Open Synapse
AI

webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ggml-org/llama.cpp

Reddit · r/LocalLLaMA · · 1 min read

Tested on an RTX 3060 with native Dawn WebGPU .

Latest from Reddit · r/LocalLLaMA