Can we trust AI evaluation? Modern AI systems are judged through benchmarks, aggregate scores, and public leaderboards, yet trust in these evaluations is often assumed rather than demonstrated. An evaluation can be precise but measure the wrong construct, stable on a familiar benchmark but brittle on newly collected data, or impressive on a leaderboard while poorly aligned with real-world decisions. Repeated benchmark use, small perturbations, underreported variance, leakage, and contamination can further weaken the evidence behind evaluation claims. The TAE (Trust-AI-Eval): Can We Trust AI Evaluation? workshop treats evaluation itself as an object of study: what is measured, which assumptions connect a protocol to a claim, how uncertainty and failure modes are reported, and when the resulting evidence is strong enough to guide deployment. By bringing together work on robustness, causal and measurement validity, auditing, judge reliability, and deployment risk, the workshop aims to clarify when AI evaluation results deserve trust and how evaluation practices can become more reliable, transparent, and decision-relevant.
December 11, 2026 - December 12, 2026
Sydney, Australia, Australia
Not Sponsored
- About
- News
- Membership
- Publications
- IMS Journals and Publications
- IMS Co-Sponsored Journals and Publications
- IMS Supported Journals
- IMS Affiliated Journals
- Electronic Access
- Journal Alerts
- Subscriptions and Orders
- Back Issues
- Article Reprints
- Acceptance of Papers
- Awards
- IMS Awards
- Harry C. Carver Medal
- IMS Fund Supporting International Meetings in Probability, Statistics and Allied Areas (SIMPSAA)
- IMS Hannan Graduate Student Travel Award
- IMS Lawrence D. Brown Ph.D. Student Award
- IMS New Researcher Travel Award
- IMS Thelma and Marvin Zelen Emerging Women Leaders in Data Science Award
- IMS Tweedie New Researcher Award
- Peter Gavin Hall IMS Early Career Prize
- IMS Awards Recipients
- IMS Fellows
- IMS Special Awards & Lectures
- IMS/BS Special Lectures
- International Prize in Statistics
- COPSS Awards
- Scientific Legacy Database
- IMS Awards
- Memorials
- Meetings
- Resources
- Leadership
- Contacts
Cart