As artificial intelligence increasingly influences our world, it becomes crucial to assess its technical progress and societal impact. This paper surveys problems and opportunities in the measurement of AI systems and their impact, based on a workshop held at Stanford University in the fall of 2019. We identify six summary challenges inherent to measuring the progress and impact of AI, and summarize over 40 presentations and associated discussions from the workshop. We hope this can inspire research agendas in this crucial area.
On a research project regarding the application of AI-relevant regulatory frameworks, the AI Index is collaborating with Dr. Elif Kiesow Cortez who founded and leads the AI & LegTech Lab of The Hague University of Applied Sciences. The project aims to improve predictability and legal certainty for providers and users of AI technology via a judicial decision database.