Synapse Open Synapse
AI

Strix Halo int4 cores: Gemma 4 31B at 2.43x llama.cpp, same quality

Reddit · r/LocalLLaMA · · 1 min read

The 8060S has an int4 x int4 WMMA instruction at 2x the FP16 rate (we measured 104 TOPS). Nothing in ROCm or llama.cpp uses it. We wrote a GEMM for it and run Gemma 4 with int4 weights and int4 activations.

Latest from Reddit · r/LocalLLaMA