Synapse Open Synapse
AI

High-Performance llama.cpp fork for Legacy GPUs: Kepler Support, CUDA Graphs & Windows NCCL!

Reddit · r/LocalLLaMA · · 5 min read

I've been working on improving llama.cpp support and performance on older NVIDIA GPUs, particularly Kepler and other pre-Ampere architectures. The goal is simple: get more life out of older CUDA hardware instead of treating it as e-waste.

Latest from Reddit · r/LocalLLaMA