Sunnie Kim will present herFPO "Advancing Responsible AI with Human-Centered Evaluation" on Wednesday, May 7, 2025 at 1:30 PM in CS 302 and Zoom. Location: Zoom link: https://princeton.zoom.us/my/sunniesuhyoung The members of Sunnies committee are as follows: Examiners: Olga Russakovsky (Adviser), Andrés Monroy-Hernández, Q. Vera Liao (Microsoft) Readers: Parastoo Abtahi, Jennifer Wortman Vaughan (Microsoft) A copy of her thesis is available upon request. Please email gradinfo@cs.princeton.edu if you would like a copy of the thesis. Everyone is invited to attend her talk. Abstract follows below: As Artificial Intelligence (AI) technologies are increasingly transforming how we live, work, and communicate, AI evaluation must take a human-centered approach to realistically reflect real-world performance and impact. In this thesis, I present research that advances human-centered evaluation, and subsequently responsible development and deployment of AI, by integrating knowledge and methods from AI and HumanComputer Interaction (HCI). First, using explainable AI as an example, I discuss the challenges and necessity of human (as opposed to automatic) evaluation and present human evaluation studies that identify new issues and opportunities in explainable AI research. Next, I bring context into the picture and present contextualized studies with real users that provide a holistic and nuanced understanding of users explainability needs and trust in AI. Then, I illustrate the importance of evaluating human-AI interaction through studies that examine how users trust, reliance, and other perceptions and behaviors are shaped by different features of AI technologies. In closing, I discuss the implications of these work, provide recommendations for human-centered evaluation, and describe future directions for responsible AI.