Synapse Open Synapse
Open source

Show HN: Tokspur a 3x faster open source inference engine for Macs

Show HN · · 1 min read

While we were trying to solve a separate problem, we ended up on a bit of a side quest and built an inference engine. We got ourselves some nice, shiny new Mac M5 Max 128GB machines while doing a lot of local LLM work for another project and ended up wanting to run some bigger models.

Latest from Show HN