Synapse Open Synapse
Tech

I Found a 5× Performance Problem Hiding in Plain Sight

Reddit · r/programming · · 6 min read

To keep DPOLens's Docker image small, I dropped sentence-transformers and called the embedding model through ONNX Runtime directly. It took about forty lines of my own code, and the image came out roughly 800 MB lighter. It worked.

Latest from Reddit · r/programming