The AI Index tracks, collates, distills, and visualizes data relating to artificial intelligence.
We provide unbiased, rigorously vetted, and globally sourced data for policymakers, researchers, journalists, executives, and the general public to develop a deeper understanding of the complex field of AI.
This year’s report measures and evaluates the rapid rate of AI advancement from research and development to technical performance and ethics, the economy and education, AI policy and governance, and more. The latest edition includes data from a broad set of academic, private, and non-profit organizations as well as more self-collected data and original analysis than any previous editions.
“The private investment in AI in 2021 totaled around $93.5 billion—more than double the total private investment in 2020, while the number of newly funded AI companies continues to drop, from 1051 companies in 2019 and 762 companies in 2020 to 746 companies in 2021. In 2020, there were 4 funding rounds worth $500 million or more; in 2021, there were 15.”
“Despite rising geopolitical tensions, the United States and China had the greatest number of cross-country collaborations in AI publications from 2010 to 2021, increasing five times since 2010. The collaboration between the two countries produced 2.7 times more publications than between the United Kingdom and China—the second highest on the list.”
“Large language models are setting new records on technical benchmarks, but new data shows that larger models are also more capable of reflecting biases from their training data. A 280 billion parameter model developed in 2021 shows a 29% increase in elicited toxicity over a 117 million parameter model considered the state of the art as of 2018. The systems are growing significantly more capable over time, though as they increase in capabilities, so does the potential severity of their biases."
Research on fairness and transparency in AI has exploded since 2014, with a fivefold increase in related publications at ethics-related conferences. Algorithmic fairness and bias has shifted from being primarily an academic pursuit to becoming firmly embedded as a mainstream research topic with wide-ranging implications. Researchers with industry affiliations contributed 71% more publications year over year at ethics-focused conferences in recent years.
“Since 2018, the cost to train an image classification system has decreased by 63.6%, while training times have improved by 94.4%. The trend of lower training cost but faster training time appears across other MLPerf task categories such as recommendation, object detection and language processing, and favors the more widespread commercial adoption of AI technologies.”
“Top results across technical benchmarks have increasingly relied on the use of extra training data to set new state-of-the-art results. As of 2021, 9 state-of-the-art AI systems out of the 10 benchmarks in this report are trained with extra data. This trend implicitly favors private sector actors with access to vast datasets.results across technical benchmarks have increasingly relied on the usage of extra training data to set new state-of-the-art results. As of 2021, 9 out of 10 state-of-the-art AI systems in this report were trained with extra data. This trend implicitly favors private sector actors with access to vast datasets.”
“An AI Index analysis of legislative records on AI in 25 countries shows that the number of bills containing “artificial intelligence” that were passed into law grew from just 1 in 2016 to 18 in 2021. Spain, the United Kingdom, and the United States passed the highest number of AI-related bills in 2021 with each adopting three."
“An AI Index survey shows that the median price of robotic arms has decreased by 46.2% in the past five years—from $42,000 per arm in 2017 to $22,600 in 2021. Robotics research has become more accessible and affordable.”
The new report highlights an AI investment boom, impressive new technical capabilities, and a fresh focus on ethics (including a new chapter on fairness and bias.
As AI systems develop more impressive capability, they also produce more harm, and with great power comes great responsibility.
The latest AI Index report shows major growth in AI jobs and degrees, a huge uptick in private investment, more capability, and more issues in fairness and bias.
For all their strategic tensions, China and the United States team up an astonishing amount on research in artificial intelligence, the 2022 AI Index reveals.
