How does the Stanford AI Index track whether artificial intelligence is actually getting smarter?

Someone had to measure AI progress with data instead of hype - Stanford volunteered.

The answer

The Stanford AI Index, first published in 2017 as part of the Stanford One Hundred Year Study on AI (AI100), is an annual report that measures, tracks, and visualizes data related to artificial intelligence progress across research, technical performance, the economy, education, and policy. The project was initiated by Yoav Shoham and grew to involve collaborators from Harvard, McKinsey, OpenAI, and other institutions. The AI Index tracks metrics like benchmark performance across dozens of tasks, global AI investment (which exceeded $90 billion in private funding by 2021), the number of AI publications (over 240,000 in 2021 alone), and legislative activity across countries. It has become one of the most cited resources for understanding the state of AI worldwide.

Source: Stanford HAI - AI Index Report

More from AI & Machine Learning

All AI & Machine Learning →