Panel Discussion with Diyi Yang, Fei Fang, José Hernández-Orallo and Joel Leibo

Jose H. Orallo is Director of Research at the Leverhulme Centre for the Future of Intelligence, University of Cambridge, UK, and Professor (on partial leave) at TU Valencia, Spain. He pioneered the use of algorithmic information theory, psychometrics and cognitive science in AI evaluation, to better understand and anticipate the capabilities, generality, progress, impact and risks of artificial intelligence. He has published five books and more than two hundred journal articles and conference papers in Nature, Science, CACM, NeurIPS, ICML, ACL, AAAI, etc. His research in the area of machine intelligence evaluation has been covered by several popular outlets, such as The Economist, WSJ, FT and New Scientist. He keeps exploring a more integrated view of the evaluation of natural and artificial intelligence, as vindicated in his book The Measure of All Minds (Cambridge University Press, 2017, PROSE Award 2018). He is an EurAI fellow and has been advising national and international organisations such as the EU, OECD, the UK and Spanish governments, and contributes to the scientific panel of the EU AI Office. He is a founder of aievaluation.substack.com and ai-evaluation.org. In 2026 he received the Spanish National Award in Computer Science.