- talks - lists.cs.princeton.edu

Yuxuan Zhang's MSE thesis talk "Defending Against Adversarial Attacks with Camera Image Pipelines" will take place December 6, 2022 at 5pm in CS 402
by Nicki Mahler 05 Dec '22

05 Dec '22

Yuxuan Zhang's MSE thesis talk "Defending Against Adversarial Attacks with Camera Image Pipelines" will take place December 6, 2022 at 5pm in CS 402. The members of his committee are Felix Heide (adviser) and Olga Russakovsky (reader). All are welcome to attend. Abstract: Existing neural networks for computer vision tasks are vulnerable to adversarial attacks: adding imperceptible perturbations to the input images can fool these models into making a false prediction on an image that was correctly predicted without the perturbation. Various defense methods have proposed image-to-image mapping methods, either including these perturbations in the training process or removing them in a preprocessing step. In doing so, existing methods often ignore that the natural RGB images in today’s datasets are not captured but, in fact, recovered from RAW color filter array captures that are subject to various degradations in the capture. In this work, we exploit this RAW data distribution as an empirical prior for adversarial defense. Specifically, we propose a model-agnostic adversarial defensive method, which maps the input RGB images to Bayer RAW space and back to output RGB using a learned camera image signal processing (ISP) pipeline to eliminate potential adversarial patterns. The proposed method acts as an off-the-shelf preprocessing module and, unlike model-specific adversarial training methods, does not require adversarial images to train. As a result, the method generalizes to unseen tasks without additional retraining. Experiments on large-scale datasets, e.g., ImageNet, COCO, for different vision tasks, e.g., classification, semantic segmentation, object detection, validate that the method significantly outperforms existing methods across task domains

1 0

Today! Eszter Hargittai Book Discussion- Connected in Isolation: Digital Privilege in Unsettled Times
by Emily C. Lawrence 30 Nov '22

30 Nov '22

[ https://citp.princeton.edu/event/hargittai-book-discussion/ | https://citp.princeton.edu/event/hargittai-book-discussion/ ] Wednesday, November 30, 2022 3 p.m. Bendheim House Join us for a discussion regarding [ https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fbit.ly%2Fc… | Connected in Isolation: Digital Privilege in Unsettled Times ] by Eszter Hargittai, CITP Visiting Research Scholar. The book examines the hidden disparities that emerged during the global pandemic when access to education, work and even healthcare, hinged not only on access to the web, but certain digital skills, too. Hargittai will be joined by [ https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.keithw… | Keith Wailoo ] , the Henry Putnam University Professor of History and Public Affairs at Princeton, CITP Executive Director [ https://citp.princeton.edu/citp-people/tithi-chattopadhyay/ | Tithi Chattopadhyay ] , and [ https://politics.princeton.edu/people/andrew-m-guess | Andy Guess ] , assistant professor of politics and public affairs at the School of Public and International Affairs to discuss the book. Bio: Eszter Hargittai is a professor and holds the Chair of Internet Use and Society at the Institute of Communication and Media Research of the University of Zurich. She is a fellow of the International Communication Association and an External Member of the Hungarian Academy of Sciences. She is past fellow of the Center for Advanced Study in the Behavioral Sciences at Stanford and Harvard’s Berkman Center for Internet & Society. She has also held visiting positions at Trinity College, Dublin (Ireland), the University of St. Gallen (Switzerland), University of Queensland (Australia), and the University of Vienna (Austria). Hargittai’s research looks at how people may benefit from or be left behind as a result of their varied digital media uses with a particular focus on how differences in people’s digital skills influence what they do online. She has looked at these questions in the domains of information seeking, health content (including Covid-19), political participation, job search, the sharing of creative content, and privacy management. Hargittai’s work has received awards from several professional associations including the International Communication Association’s Outstanding Young Scholar Award. For her teaching, she received the Galbut Outstanding Faculty Mentor Award of the School of Communication at Northwestern University, which honors one faculty member each year for exemplary teaching and engagement with students both inside and outside of the classroom. She has published over 100 journal articles, dozens of book chapters, and has edited [ http://eszter.com/books | four books ] . In addition to having presented her work across the US, she has also given invited talks in 15 countries on four continents. She has keynoted 18 meetings, given over 160 invited talks, and has presented at numerous conferences. Her work has been featured in many popular media outlets in the United States and internationally. Her research has been supported by the U.S. National Science Foundation, the John D. and Catherine T. MacArthur Foundation, the Alfred P. Sloan Foundation, Microsoft Research, Nokia, Google, Facebook, and Merck, among others. Hargittai is editor of the Handbook of Digital Inequality (Edward Elgar Publishing, 2021), Research Exposed: How Empirical Social Science Gets Done in the Digital Age (Columbia University Press 2021), Digital Research Confidential (with Christian Sandvig, The MIT Press, 2015), and Research Confidential: Solutions to Problems Most Social Scientists Pretend They Never Have (University of Michigan Press, 2009). The latter three present a behind-the-scenes look at doing empirical social science research. She has published academic career advice at Inside Higher Ed under the Ph.Do column. She has won some photo contests, has had her photography featured in books and calendars, and people she doesn’t know have been willing to part with their money to own some of her paintings. She tweets @eszter. If you cannot attend in person, you can [ https://princeton.zoom.us/j/96182136418 | click here to watch the webinar ] . Link for webinar: [ https://princeton.zoom.us/j/96182136418 | https://princeton.zoom.us/j/96182136418 ]

1 0

Princeton Robotics Seminar: Nadia Figueroa, Fri Dec 2 at 11am
by Emily C. Lawrence 29 Nov '22

29 Nov '22

Princeton Robotics Seminar Speaker: Nadia Figueroa, University of Pennsylvania Date: Friday Dec 2, 2022 Time: 11am EST Location: Computer Science 105 Event page: [ https://robo.princeton.edu/seminar | https://robo.princeton.edu/seminar ] Title: Collaborative Robots in the Wild: Challenges and Future Directions from a Human-Centric Perspective Abstract: Since the 1960’s we have lived with the promise of one day being able to own a robot that would be able to co-exist, collaborate and cooperate with humans in our everyday lives. This promise has motivated a vast amount of research in the last decades on motion planning, machine learning, perception and physical human-robot interaction (pHRI). Nevertheless, we are yet to see a truly collaborative robot navigating and manipulating objects, the environment or physically collaborating with humans and other robots outside of labs and in the human-centric dynamic spaces we inhabit; i.e., “in-the-wild”. This bottleneck is due to a robot-centric set of assumptions of how humans interact and adapt to technology and machines. In this talk, I will introduce a set of more realistic human-centric assumptions and I posit that for collaborative robots to be truly adopted in such dynamic, ever-changing environments they must possess human-like characteristics of reactivity, compliance, safety, efficiency and transparency. Combining these objectives is challenging as providing a single optimal solution can be intractable and even infeasible due to problem complexity and contradicting goals. Hence, I will present possible avenues to achieve these requirements. I will show that by adopting a Dynamical System (DS) based approach for motion planning we can achieve reactive, safe and provably stable robot behaviors while efficiently teaching the robot complex tasks with a handful of demonstrations. Further, I will show that such an approach can be extended to offer task-level reactivity and can be adopted to efficiently and incrementally learn from failures, as humans do. I will also discuss the role of compliance in collaborative robots, the allowance of soft impacts and the relaxation to the standard definition of safety in pHRI and how this can be achieved with DS-based and optimization-based approaches. I will then talk about the importance of both end-users and designers having a holistic understanding of their robot’s behaviors, capabilities, and limitations and present an approach that uses Bayesian posterior sampling to achieve this. The talk will end with a discussion of open challenges and future directions to achieve truly collaborative robots in-the-wild. Biography: Nadia Figueroa is the Shalini and Rajeev Misra Presidential Assistant Professor in the Mechanical Engineering and Applied Mechanics (MEAM) Department at the University of Pennsylvania. She holds a secondary appointment in the Computer and Information Science (CIS) department and is a faculty advisor at the General Robotics, Automation, Sensing & Perception (GRASP) laboratory. Before joining the faculty, she was a Postdoctoral Associate in the Interactive Robotics Group of the Computer Science and Artificial Intelligence Laboratory (CSAIL) at the Massachusetts Institute of Technology (MIT), advised by Prof. Julie A. Shah. She completed a Ph.D. (2019) in Robotics, Control and Intelligent Systems at the Swiss Federal Institute of Technology in Lausanne (EPFL), advised by Prof. Aude Billard. Prior to this, she was a Research Assistant (2012-2013) at the Engineering Department of New York University Abu Dhabi (NYU-AD) and in the Institute of Robotics and Mechatronics (2011-2012) at the German Aerospace Center (DLR). She holds a B.Sc. degree in Mechatronics (2007) from Monterrey Tech (ITESM-Mexico) and an M.Sc. degree in Automation and Robotics (2012) from the Technical University of Dortmund, Germany. Her main research interest focuses on developing collaborative human-aware robotic systems: robots that can safely and efficiently interact with humans and other robots in the human-centric dynamic spaces we inhabit. This involves research at the intersection of machine learning, control theory, artificial intelligence, perception, and psychology - with a physical human-robot interaction perspective.

1 0

William Pierson Field Lecture: Roberto Martin-Martin, Mon Dec 5 at 1:30pm
by Emily C. Lawrence 29 Nov '22

29 Nov '22

William Pierson Field Lecture Speaker: Roberto Martin-Martin, University of Texas at Austin Time: 1:30pm - 2:50pm, Monday Dec 5, 2022 Location: CS 104 Title: What do we want robots to do for us (and how could we get there)? — Challenges in Robot Perception for Long Horizon Heterogeneous Tasks Abstract:: Latest advances in robot learning are creating more capable and robust embodied agents, making us consider a future where robots could help humans in their everyday lives. But, what exactly do we want robots to do for us? In this talk, I will consider this question and discuss the results of a first analysis: a new robot benchmark with a human-guided set of tasks in ecological household environments. This benchmark demands solutions with better capabilities for long-horizon planning and control; I will present our first steps in robot perception towards improved planning and control: perceiving human plans to long-horizon tasks from instructional videos, and predicting video to enable versatile visuomotor control. Bio: Roberto Martin-Martin is Assistant Professor of Computer Science at University of Texas at Austin. His research connects robotics, computer vision and machine learning. He studies and develops novel AI algorithms that enable robots to perform tasks in human uncontrolled environments such as homes and offices. He creates novel decision-making solutions based on reinforcement learning, imitation learning, planning and control, and explores topics in robot-perception such as pose estimation and tracking, video prediction and parsing. Martin-Martin received his Ph.D. from Berlin Institute of Technology (TUB) prior to a postdoctoral position at the Stanford Vision and Learning Lab. His work has been selected as RSS Best Systems Paper Award, RSS Pioneer, Winner of the Amazon Picking Challenge, and ICRA and IROS Best Paper Nominee. He is chair of the IEEE Technical Committee in Mobile Manipulation.

1 0

Tyler Park (QCB) Dissertation Defense: Dec 7th at 10am
by Gradinfo 28 Nov '22

28 Nov '22

The Lewis-Sigler Institute for Integrative Genomics ~ Graduate Program in Quantitative and Computational Biology Final Public Oral Tyler Park Integrating multi-modal biological data uncovers vulnerabilities and complex interactions in cancer Wednesday, December 7, 2022 10:00 AM Computer science building, room 301 Raphael Lab A copy of the dissertation is available to QCB for inspection electronically; email [ mailto:jgiraldi@princeton.edu | jgiraldi(a)princeton.edu ] with your request.

1 0

Meryem Essaidi will present her FPO "User-Centered Algorithmic Mechanism Design" on Tuesday, December 20, 2022 at 1pm via Zoom.
by Nicki Mahler 23 Nov '22

23 Nov '22

Meryem Essaidi will present her FPO "User-Centered Algorithmic Mechanism Design" on Tuesday, December 20, 2022 at 1pm via Zoom. Zoom link: [ https://princeton.zoom.us/j/93585578182 | https://princeton.zoom.us/j/93585578182 ] Committee: Adviser: Matt Weinberg Readers: Sam Taggart, Mark Braverman Examiners: Olga Russakovsky, Huacheng Yu All are welcome to attend. Abstract: In algorithmic mechanism design, classical desiderata define standards used to evaluate the performance of an algorithm or mechanism. Examples of such desiderata are efficiency, revenue maximization, and strategyproofness. These desiderata are oftentimes seller-centered and tend to create negative externalities that harm the users targeted by the market. Examples of such externalities are not treating the users equally, not protecting against adversarial sellers, and not maximizing user utility. In this thesis, we explore the frontier between user-centric and seller-centric performance at different levels of leverage offered by central regulation. We ask: how can we design new solutions that prioritize user-centered desiderata while maintaining the pre-existing seller-centered desiderata or without too great a cost to them? We present theoretical frameworks at three levels of intervention“protected”goods, and significant regulation for essential and public goods. Our first framework is credible auctions. We consider a revenue-maximizing seller with a single item for sale to multiple users with independent-and-identicallydistributed valuations. In this work, assuming the existence of cryptographically-secure commitment-schemes, we identify a new single-item auction that is credible, strategyproof, revenue-optimal, and terminates in constant rounds in expectation for all distributions with finite monopoly price. Our second framework is fair and symmetric ad auctions. We consider a revenuemaximizing seller with multiple items for sale to a single population of additive buyers with independent item values. We motivate this via fairness in ad auctions where items correspond to (views from) users, and equally-qualified users from different demographics should be shown the same desired ad at equal rates. We show that bundling all items together achieves a constant-factor approximation to the revenue-optimal itemsymmetric mechanism; as any item-symmetric auction is also fair. Observe that in this domain, bundling all items together corresponds to concealing all demographic data. i Our last framework is markets with mandatory purchase. We study a problem inspired by regulated health-insurance markets, and investigate whether limiting entry of providers increases or decreases the utility(welfare minus revenue) of users who purchase from the providers, specifically in settings where the outside option of “purchasing nothing” is prohibitively undesirable.

2 1

CSML Lunch and Learn: Robustness for Models and Algorithms in Machine Learning, Monday, Nov 28
by Emily C. Lawrence 23 Nov '22

23 Nov '22

CSML Lunch and Learn SEMINAR Speaker: Yassine Laguel, Rutgers University Title: Robustness for Models and Algorithms in Machine Learning Day: Monday, November 28, 2022 Time: 12:30 p.m. Lunch available from 12:00 p.m. Location: CSML, 26 Prospect Ave. Classroom 103 Host: CSML and Mert Gürbüzbalaban Abstract: Risk-averse optimization plays a major role in the design of safety for machine learning applications. In this talk, we will present a set of tools to enhance the robustness of models and algorithms to potentially harmful data shifts. First, we will expose some general results on the modeling of risk aversion and highlight the interest of superquantile-based risk measures to enforce robustness to worst-case events. We will then show how such a measure may be minimized in the centralized setting based on a smoothing à la Nesterov of the superquantile. We will then present applications of this framework in federated learning to handle statistical heterogeneity among the devices of a given network. Second, we will revisit the bias-variance trade-off of first-order stochastic algorithms from a robust perspective. Precisely, we study the convergence properties of accelerated methods on saddle-point problems for diverse robustness metrics. We deduce new ways to set the associated hyperparameters to stabilize the algorithm at equilibrium. Bio : Yassine Laguel is a postdoctoral researcher at Rutgers University and a departmental guest at the Center for Statistics and Machine Learning at Princeton University. He received his M.Sc. in applied mathematics from the Ecole Nationale Supérieure de l’Informatique et des Mathématiques Appliquées (ENSIMAG) in 2018. He then completed his Ph.D. under the supervision of Jérôme Malick at the Université Grenoble Alpes. He is now working in the Management Sciences and Information Systems department at Rutgers Business School, in the team of Mert Gürbüzbalaban. Dr. Laguel’s research interests center around optimization under uncertainty and its applications to stochastic programming and machine learning. A common thread in his research is the design and analysis of numerical algorithms to address risk in data-driven applications.

1 0

Andrew Jones will present his FPO "Probabilistic models for structured biomedical data" on Friday, December 16, 2022 at 9:30 AM in COS 402 and Zoom.
by gradinfo＠cs.princeton.edu 23 Nov '22

23 Nov '22

Andrew Jones will present his FPO "Probabilistic models for structured biomedical data" on Friday, December 16, 2022 at 9:30 AM in COS 402 and Zoom. Location: Zoom link: https://princeton.zoom.us/j/95479201507 <https://www.google.com/url?q=https://princeton.zoom.us/j/95479201507&sa=D&s ource=calendar&ust=1669648765658473&usg=AOvVaw0W0kAo0lJDADvaWIY_Kr4D> The members of Andrew's committee are as follows: Examiners: Barbara Engelhardt (Adviser), Ben Raphael, Adji Bousso Dieng Readers: Jonathan Pillow, Olga Russakovsky A copy of his thesis will be available, upon request, two weeks before the FPO. Please email gradinfo(a)cs.princeton.edu <mailto:gradinfo@cs.princeton.edu> if you would like a copy of the thesis. Everyone is invited to attend his talk. Abstract follows below: Modern biomedical datasets-from molecular measurements of gene expression to pathology images-hold promise for discovering new therapeutics and probing basic questions about the behavior of cells. Thoughtful statistical modeling of these complex, high-dimensional data is crucial to elucidate robust scientific findings. A common assumption in data analysis that the data samples are independent and identically distributed. However, this assumption is nearly always violated in practice. This is especially true in the setting of biomedical data, which often exhibit some amount of structure, such as subgroups of patients, cells, or tissue types or other correlation structure among the samples. In this body of work, I propose data analysis and experimental design frameworks to account for several types of highly-structured biomedical data. These approaches, which take the form of Bayesian models and associated inference algorithms, are specifically tailored for datasets with group structure, multiple data modalities, and spatial organization of samples. In the first line of work, I propose a model for contrastive dimension reduction that decomposes the sources of variation in samples that belong to case and control conditions. Second, I propose a computational framework for aligning spatially-resolved genomics data into a common coordinate system that accounts for spatial correlation among the samples and models multiple data modalities. Finally, I propose a family of methods for optimally designing spatially-resolved genomics experiments that is tailored to the highly-structured data collection process of these studies. Together, this body of work advances the field of biomedical data analysis by developing models that directly exploit common types of structure within these data and demonstrating the advantage of these modeling approaches across an array of data types.

1 0

CS Colloquium: Shuran Song, Monday, Nov 7 at 12:30pm
by Emily C. Lawrence 21 Nov '22

21 Nov '22

CS Colloquium Series Speaker: Shuran Song, Columbia University Date: Monday, November 7 Time: 12:30pm Location: CS 105 Host: Szymon Rusinkiewicz Event page: [ https://www.cs.princeton.edu/events/26279 | https://www.cs.princeton.edu/events/26279 ] Title: Unpatched Vulnerabilities in Cellular Standards Abstract: Despite the incredible capabilities (speed, repeatability) of our hardware, most robot manipulators today are deliberately programmed to avoid dynamics – moving slow enough so they can adhere to quasi-static assumptions about the world. In contrast, people frequently (and subconsciously) make use of dynamic phenomena to manipulate everyday objects – from unfurling blankets to tossing trash, to improve efficiency and physical reach range. These abilities are made possible by an intuition of physics, a cornerstone of intelligence. How do we impart the same on robots? In this talk, I will discuss how we might enable robots to leverage dynamics for manipulation in unstructured environments. Modeling the complex dynamics of unseen objects from pixels is challenging. However, by tightly integrating perception and action, we show it is possible to relax the need for accurate dynamical models. Thereby, allowing robots to (i) learn dynamic skills for complex objects, (ii) adapt to new scenarios using visual feedback, and (iii) use their dynamic interactions to improve their understanding of the world. By changing the way we think about dynamics – from avoiding it to embracing it – we can simplify a number of classically challenging problems, leading to new robot capabilities. Bio: Shuran Song is an Assistant Professor in the Department of Computer Science at Columbia University. Before that, she received her Ph.D. in Computer Science at Princeton University, BEng. at HKUST. Her research interests lie at the intersection of computer vision and robotics. Song’s research has been recognized through several awards including the Best Paper Awards at RSS’22 and T-RO’20, Best System Paper Awards at CoRL’21, RSS’19, and Amazon Robotics’18, and finalist at RSS’22, ICRA'20, CVPR'19, RSS’19, and IROS'18. She is also a recipient of the NSF Career Award, as well as research awards from Microsoft, Toyota Research, Google, Amazon, JP Morgan, and Sloan Foundation. To learn more about Shuran’s work please visit: [ https://www.cs.columbia.edu/~shurans/ | https://www.cs.columbia.edu/~shurans/ ]

1 12

Claudia Roberts will present her FPO "Human-machine Collaboration in Real-World Machine-Learning Applications” on Thursday, December 15, 2022 at 2:00pm in CS 105 (correction)
by Nicki Mahler 18 Nov '22

18 Nov '22

Claudia Roberts will present her FPO "Human-machine Collaboration in Real-World Machine-Learning Applications” on Thursday, December 15, 2022 at 2:00pm in CS 105. The members of her committee are as follows: Arvind Narayanan (Adviser); Adji Dieng and Barbara Engelhardt (Readers); Andrés Monroy-Hernández and Matt Salganik (Examiners) All are welcome to attend. Abstract: Automation tools like machine learning are a necessity in our big data world. Thanks to the Internet and advancements in all facets of computer and storage technology, almost everyone has a voice in the Internet connected world. However, there are still very real physical limits in our physical world. This dichotomy—the seemingly limitless nature of technology enabled data colliding with the physical limits of the real world—has made automation tools a necessity, and predictive models powered by machine learning algorithms are one such tool. The promise of machine learning to accurately predict future human behavior and human preferences has lead practitioners and researchers alike to apply machine learning automation tools to tasks such as product recommendations and speculatory activities such as long term job applicant success. However, due to the mercurial nature of humans, developing mathematical intermediaries to attempt to model and predict human behavior is challenging and not a straight-forward task. One way of harnessing the power of machine-learning backed automation to help reduce the scale of many real-world applications in more challenging domain settings is by having humans and machines collaborating in non-trivial ways. In this dissertation, we delineate the various ways in which humans and machines collaborate in challenging real-world applications. Moreover, we highlight three specific ways in which we can use human-machine collaboration to keep or increase utility and reduce real-world harm when using these systems in the wild: (i) humans enabling computers with domain specific knowledge, (ii) computers providing humans with algorithmic explanations, (iii) humans and computers working together in decision making. [ https://www.cs.princeton.edu/events/26295 | https://www.cs.princeton.edu/events/26295 ]

1 0