Title: AI in Health: Why models that succeed on paper often fail in practice
Speaker Bio
Dr. Annika Reinke earned her PhD degree in 2023, focusing on eliminating flaws in biomedical image analysis validation. She continues her work as a postdoctoral researcher and deputy head of department by addressing underrepresented societally relevant topics, particularly scientific benchmarking and validation. Leading the “Validation of Intelligent Systems” group, Dr. Reinke aims to enhance the quality of validation pipelines for biomedical AI algorithms. She holds influential positions in various international groups, including the secretary of the MICCAI Special Interest Group on biomedical challenges and the chair of the MONAI Working Group on Evaluation and Benchmarking
Abstract:
Despite impressive performance in publications, many AI models fail when deployed in real-world settings. A key reason is poor or misleading validation. This talk explores common pitfalls in validating AI systems, especially the misuse of performance metrics, and shows how they can create false confidence. Practical recommendations will be offered to guide more robust and trustworthy validation practices, aimed at supporting the safe and effective integration of AI into clinical workflows.
Schedule:
Date: Friday, October 18th 2025
Time: 09:00 PST | 17:00 West Africa Time | 16:00 UTC
Zoom Meeting Link: https://us06web.zoom.us/j/89709172931
Contact Information
compass@mailab.io
View recordings of previous sessions on our YouTube channel https://www.youtube.com/@COMPASS-nn5or
Leave a Reply