Workshop
ACL 2026 Workshop on Evaluating Evaluations
Co-Organized by MCML Junior Member Jan Batzner
04.07.2026
2:00 pm - 5:30 pm
San Diego, USA
The ACL 2026 Workshop on Evaluating Evaluations (EvalEval) will take place on July 4, 2026, in San Diego. The workshop focuses on the practical challenges of evaluating generative AI systems and brings together model developers, evaluation researchers, and practitioners.
The program includes a panel discussion on the design and use of evaluations in real-world model development, oral and poster presentations, a shared task on building a standardized database of AI evaluation results, and the EvalEval Community Awards.
MCML Junior Member Jan Batzner is among the program chairs and will moderate the shared task session.
The workshop addresses key topics such as evaluation methodology, measurement theory, evaluation infrastructure, cost and stakeholders, as well as sociotechnical impacts of generative AI systems.
Organized by:
Jan Batzner
MCML
Related
Certificate Course • 06.11.2026 • Online
Certificate Course on Responsible AI - Part 1
Preliminary announcement of the Responsible AI Certificate Course 2026, a joint online program by the German National AI Centers. Details to follow.
Certificate Course • 13.11.2026 • Online
Certificate Course on Responsible AI - Part 2
Preliminary announcement of the Responsible AI Certificate Course 2026, a joint online program by the German National AI Centers. Details to follow.
Certificate Course • 20.11.2026 • Online
Certificate Course on Responsible AI - Part 3
Preliminary announcement of the Responsible AI Certificate Course 2026, a joint online program by the German National AI Centers. Details to follow.
