08

Feb

Teaser image to The highs and lows of performance evaluation: Towards a measurement theory for machine learning

The highs and lows of performance evaluation: Towards a measurement theory for machine learning

Peter Flach, University of Bristol

   08.02.2023

   5:00 pm - 7:00 pm

   Livestream on YouTube

The understanding of performance evaluation measures for machine-learned classifiers has progressed, but gaps persist, leading to questionable evaluation practices. This raises concerns about the trustworthiness of systems utilizing these algorithms. To address this, a proper measurement theory of machine learning is proposed, akin to measurement theory in other domains. This theory would explore relevant concatenation operations in data science and AI and their implications for measurement scales. The need for latent-variable models is highlighted to capture key properties like classification ability and dataset difficulty, enabling causal inferences in machine learning experiments.


Related

Link to Enlarging the Capability of Diffusion Models for Inverse Problems by Guidance

Munich AI Lectures  •  11.03.2024  •  LMU Munich, Theresienstraße 39, Room B 006

Enlarging the Capability of Diffusion Models for Inverse Problems by Guidance

Munich AI Lecture with Prof. Dr. Jong Chul Ye from KAIST on using diffusion models to solve inverse problems


Link to From Machine Learning to Autonomous Intelligence

Munich AI Lectures  •  29.09.2023  •  Plenarssitzungssaal, BAdW

From Machine Learning to Autonomous Intelligence

Join the presentation of Yann LeCun, Chief AI Scientist at Meta AI Research, on how can machines learn like humans.


Link to Thoughts on Artificial Intelligence

Munich AI Lectures  •  14.07.2023  •  LMU Audimax

Thoughts on Artificial Intelligence

Jürgen Schimdhuber, one of leading AI researchers worldwide, shares in his talk in the LMU Audimax his thoughts on AI.


Link to Explainable AI via Semantic Information Pursuit

Munich AI Lectures  •  08.03.2023  •  Livestream on YouTube

Explainable AI via Semantic Information Pursuit

Join the presentation of René Vidal, John Hopkins University.