An Introduction to Floating-Point Arithmetic - Alan Zucconi

Glitchified on Instagram: "Modern GPUs perform 10^12–10^15 arithmetic operations per second depending on class and precision. Explanation and examples: FLOPS = floating-point operations per second. 1 TFLOP = 10^12 FLOPS. Midrange/mobile GPUs: hundreds of GFLOPS to a few TFLOPS (10^9–10^12 FLOPS). High-end consumer desktop GPUs: tens of TFLOPS. Example: an RTX 4090 ≈ 82.6 TFLOPS (≈8.26×10^13 FLOPS) for FP32 peak. Data-center AI/HPC GPUs using low-precision matrix engines: hundreds to nearly a tho