The AI Index Report tracks, collates, distills, and visualizes data related to artificial intelligence. Its mission is to provide unbiased, rigorously vetted, and globally sourced data for policymakers, researchers, executives, journalists, and the general public to develop intuitions about the complex field of AI.
As artificial intelligence increasingly influences our world, it becomes crucial to assess its technical progress and societal impact. This paper surveys problems and opportunities in the measurement of AI systems and their impact, based on a workshop held at Stanford University in the fall of 2019. We identify six summary challenges inherent to measuring the progress and impact of AI, and summarize over 40 presentations and associated discussions from the workshop. We hope this can inspire research agendas in this crucial area.
The Stanford Institute for Human-Centered Artificial Intelligence (HAI) is dedicated to guiding and building the future of artificial intelligence (AI). Its mission is to advance AI research, education, policy and practice to improve the human condition. The focus of the institute is developing AI technologies inspired by the versatility and depth of human intelligence; guiding, forecasting and studying the human and societal impact of AI and designing and creating AI applications that augment human capabilities.
The AI Index program is an independent initative at the Stanford Institute for Human-Centered Artificial Intelligence (HAI). Stanford HAI relies on philanthropic support as it pursues its mission to advance AI research, education, policy, and practice to improve the human condition. Unrestricted gifts and pledges to support Stanford HAI, including AI Index, may be made online. For more information, click the link below.
We welcome feedback and new ideas for our annual reports and the Global AI Vibrancy Tool. Contact us at AI-Index-Report@stanford.edu.
