Synapse Open Synapse
Open source

Show HN: Introduction to GPU Inference, a short course with Interactive diagrams

Show HN ·

Hi HN! I've spent most of this year working on GPU inference, and I put together a short course to share what I've learned. It starts with the basics and works up to how inference is actually served, things like continuous batching, goodput, and disaggregated prefill and decode.

Latest from Show HN