Synapse Open Synapse
AI

Switching to EPYC: what I had to fix, and before/after numbers

Reddit · r/LocalLLaMA · · 4 min read

Same GPUs before and after: RTX 3090 FE RTX 5070 Ti 2× RTX 5060 Ti 16 GB (one is out waiting for a riser, so the big MoE runs below use 3 cards, against 4 before).

Latest from Reddit · r/LocalLLaMA