RTX 3090 Ti Shows 80% BF16 Gain in One Dense Matrix Test
Photo: TokenPost
The open-source Zagitta/gpu-unlock project uses a Linux kernel module to change floating-point math throughput on NVIDIA Ampere consumer GPUs. In one dense general matrix multiplication (GEMM) test at a 450-watt power limit, the RTX 3090 Ti delivered 157.41 BF16 teraflops, up from 87.50. The result measures matrix performance in that test; it does not establish an equivalent gain across applications. The same test lists TF32 throughput at 82.61 teraflops, compared with 42.58, and FP16 at 118.39, compared with 87.46. The BF16 increase is about 79.9%.
Source: TokenPost
