Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

I combine training compute and GPU price-performance data to estimate the cost of compute in US dollars for the final training run of 124 machine learning systems published between 2009 and 2022, and find that the cost has grown by approximately 0.5 orders of magnitude per year.

Trends in Training Dataset Sizes – Epoch

Llama 2 Scaling Laws : r/LocalLLaMA

Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

AI Training Costs Continue to Plummet

The Economic Case for Generative AI and Foundation Models

What is Compute? - Transformative AI and Compute [1/4] — EA Forum

Please Report Your Compute, May 2023

Large Language Models: A New Moore's Law?

Projecting Compute Trends in Machine Learning – Epoch

Machine Learning Model Sizes and the Parameter Gap – Epoch

Compute Trends Across Three eras of Machine Learning — AI

AI Trends – Epoch

A systematic evaluation of machine learning on serverless

Introduction to Deep Learning with TensorFlow – Deep Learning 1