"How Gufo caches a hybrid model", first blog post for Gufo, The Open Source Strix Halo AI engine
Hello hello 👋 , first post here, and it's self-promotion, so feel free to ping me to remove it if it violates rule 4. Sorry in advance. A friend and I started Gufo as a pet project (MIT license) to get the most out of the AMD Strix Halo chip, while supporting a few best-in-class models.