100% GPU Utilization, 39% of Rated FP16
On an NVIDIA L4, GPU-Util (the nvidia-smi metric) read 100% while I measured 47 of 121 rated dense FP16 TFLOPS. DCGM showed why.
On an NVIDIA L4, GPU-Util (the nvidia-smi metric) read 100% while I measured 47 of 121 rated dense FP16 TFLOPS. DCGM showed why.