Synapse Open Synapse
AI

Setting a World Record for MoE Pre-Training on NVIDIA GB300 NVL72

NVIDIA Developer · · 6 min read

Frontier model pre-training has converged on mixture of experts (MoE), which is fundamentally changing what limits large-scale AI training. As compute per token...

Latest from NVIDIA Developer