Gemma 4 twice as fast on Ryzen AI Max+ 395
Hi! Just want to share that we have optimized Gemma 4 to run more than twice as fast as llama.cpp on the Ryzen AI Max+ 395! To maintain accuracy we use a combination of rotation and GPTQ, along with selective mixed precision. https://embedl.com/google/gemma-4-31B-it/ryzen-ai-max-395