Will We Run Out of ML Data? Evidence from Projections

Summary

This Epoch AI research examines whether the supply of training data for machine learning models will become a limiting factor for AI progress. The page appears to have been moved or deleted from its original URL, so full content is unavailable. The topic concerns projections of data availability relative to projected compute and model scaling demands.

Key Points

• •Page is no longer accessible at the original URL, suggesting content was moved or consolidated on Epoch AI's website (now epoch.ai)
• •Topic concerns data constraints on ML scaling — a key factor in AI capabilities forecasting
• •Epoch AI is a leading research organization tracking compute, data, and algorithmic trends in AI development
• •Data availability is a significant variable in forecasting timelines and limits of large-scale AI training
• •Related research suggests high-quality text data may be exhausted within years under current scaling trajectories