Synapse Open Synapse
AI

Given the flood of new inference engines any recommendations for 2x 7900xtx ?

Reddit · r/LocalLLaMA · · 1 min read

Hey everyone as the title says I am looking for inference engines that work well with AMD GPUs. There have been so many new ones that I am sure there is something better then llamacpp which currently hosts this. My use case is the following.

Latest from Reddit · r/LocalLLaMA