Synapse Open Synapse
AI

Inference optimization

Reddit · r/LocalLLaMA · · 1 min read

Hey all, Looking to learn inference optimization, I learn by doing u fortunately but I have read a good part of the inference engineering book by Philip Kelly. Currently have a 4070 and 64gb of RAM. any tips? preciate it.

Latest from Reddit · r/LocalLLaMA