Synapse Open Synapse
Tech

Show HN: DeepSeek V3 in ~200 lines of pure Jax

HN · · 6 min read

DeepSeek V3 (MLA, DeepSeekMoE, aux-loss-free balancing, MTP) in 190 lines of pure JAX, trained on a MacBook Air. Write-up: vaibhaav.in/writing/deepseek-v3-jax - Vaibhaav-Tiwari/deepseek-v3-jax

Same story elsewhere

Latest from HN