Shuyao Zhou will present her MSE talk “Code It, See It, Touch It: Vision-Powered AR Programming Tool for Children” on Tuesday, April 15, 2025 at 11:00am in CS 402.
The members of her committee are as follows: Andrés Monroy-Hernández (Adviser) and Parastoo Abtahi (reader)
All ae welcome to attend. Please see abstract below.
We present an augmented reality (AR) authoring tool that enables children to create interactive experiences by linking visual code blocks to physical objects recognized by vision-based AI models. Building on the accessibility of block-based programming, our system encourages creativity and exploration by extending traditional visual authoring tools into the physical environment. We evaluated the system through workshops with 20 children (ages 7–16) across the United States and Argentina, where participants collaboratively designed AR experiences. Our findings suggest that the system supports playful, explorative learning, while also highlighting challenges in real-time object tracking accuracy and responsiveness.