Siyang Wu will present his General Exam "How to evaluate monocular depth estimation?" on Wednesday, October 8, 2025 at 3:00 PM in CS 105
Committee Members: Jia Deng (advisor), Adam Finkelstein, Zhuang Liu
Abstract:
Monocular depth estimation is an important task with rapid progress, but how to evaluate it remains an open question, as evidenced by a lack of standardization in existing literature and an unhelpfully large selection of evaluation metrics whose trade-offs and behaviors are not well understood. This paper contributes a novel, quantitative analysis of existing metrics in terms of their sensitivity to various types of perturbations of ground truth, emphasizing comparison to human judgment. Our analysis reveals that existing metrics are severely under-sensitive to curvature perturbation such as making flat surfaces wavy. To remedy this, we introduce a new metric based on relative surface normals, along with new depth visualization tools and a principled method to create composite metrics with better human alignment.
Reading List:
https://docs.google.com/document/d/1bX49rxxy3z-RrqDJHKuIKXfQAySIYS7e7mZ5PgjdbtI/edit?usp=sharing
Everyone is invited to attend the talk, and those faculty wishing to remain for the oral exam following are welcome to do so.