Frontier AI Training Compute Has Grown Fivefold Each Year Since 2020
Photo: TokenPost
Training compute for frontier language models has grown at an annual rate of 5× since 2020, a pace that doubles the workload about every 5.2 months. The trend captures the scale of computing used to develop leading AI models. The 90% confidence interval is 4× to 6× annual growth, equivalent to a doubling every 4.6 to 6.0 months. Across 63 frontier models released after 2018, median annual compute growth was 4.17×. Hardware quantity grew 1.69× a year and accounted for 40% of measured growth, the largest share.
Source: TokenPost
