Synapse Open Synapse
AI

llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp

Reddit · r/LocalLLaMA · · 2 min read

it's time to update your llama.cpp for another speedup (sparse attention models)

Latest from Reddit · r/LocalLLaMA