Synapse Open Synapse
AI

[Guide] Ternary Bonsai 2 is finally 100% working on ik_llama.cpp (Native CUDA offload + Fast CPU -rtr)

Reddit · r/LocalLLaMA · · 2 min read

Hey folks, Quick heads up for anyone playing around with PrismML's Ternary Bonsai 2! Until very recently, running it outside of Prism's own fork was a bit of a pain.

Latest from Reddit · r/LocalLLaMA