Synapse Open Synapse
Tech

100% GPU Utilization, 39% of Rated FP16

Reddit · r/programming · · 7 min read

On an NVIDIA L4, GPU-Util (the nvidia-smi metric) read 100% while I measured 47 of 121 rated dense FP16 TFLOPS. DCGM showed why.

Latest from Reddit · r/programming