Sreemanti Dey will present her General Exam "Handling Hidden Holes in View-Based 3D Scene Generation" on Friday, May 8, 2026 at 9:00 AM in Friend 202 and via zoom.
Sreemanti Dey will present her General Exam "Handling Hidden Holes in View-Based 3D Scene Generation" on Friday, May 8, 2026 at 9:00 AM in Friend 202 and via zoom. Zoom link: https://princeton.zoom.us/j/2473759731 Committee Members: Jia Deng (advisor), Ellen Zhong, Felix Heide Abstract: High-quality 3D scene generation from monocular image inputs is a challenging tasks with many promising downstream applications in AR/VR, gaming, embodied AI, and robotics training. One strategy for this problem is view-based iterative inpainting, which consists of repeatedly adding to a 3D scene by rendering novel views, inpainting them with a pretrained 2D model, and adding the new points to the existing scene. An implicit assumption in these methods is that all missing geometry can be completed by inpainting empty rendered pixels. However, this assumption does not always hold: a pixel existing in a render does not necessarily imply that nothing should be inpainted over that pixel. In other words, an object, such as a background wall, could be rendered in an area where an object should be completed. We refer to such cases as “hidden holes,” since they are uncaught via rendering alone. To detect these regions, we introduce Quadmask, a geometry-based system for labeling rendered pixels as potential hidden holes. QuadMask can help downstream view-based methods by indicating areas that have pixel information but may nevertheless be missing visually important geometry. Reading List: https://docs.google.com/document/d/1q2kTx-uQSK0UUKtT3dn0Psfk3uF4sTgKCmcDRdBF... Everyone is invited to attend the talk, and those faculty wishing to remain for the oral exam following are welcome to do so.
participants (1)
-
CS Grad Department