AMD Loom Fun: Added Radeon 9700 support over the weekend. Benchmarked 48 models with an average 42% speedup over llama.cpp.
On Friday I posted about AMD Loom , a new experimental inference stack that includes a runtime, kernel compiler, and inference server.