Synapse Open Synapse
AI

Nemotron 3.5 Bolt E4B on Jetson Orin Nano Super at 27.7 tok/s!

Reddit · r/LocalLLaMA ·

Hi! I wanted to share that we just got NVIDIA's latest Nemotron Bolt model running at 27.7 tok/s (compared to 15 tok/s on the official release with Llama CPP) on Jetson Orin Nano Super (1.8x faster)! It can program games on a model running completely on a cheap edge device!

Latest from Reddit · r/LocalLLaMA