- talks - lists.cs.princeton.edu

Colloquium Speaker Jeffrey Siskind Thurs Oct 15, 12:30pm
by Nicole E. Wagenblast 14 Oct '15

14 Oct '15

Colloquium Speaker Jeffrey Siskind, from Purdue University Thursday, October 15, 12:30pm Computer Science 105 Seeing, Saying, Doing, and Learning: Integrating Computer Vision, Natural Language Processing, Robotics, and Machine Learning Through Multidirectional Inference The semantics of natural language can be grounded in perception and motor control with a unified cost function that supports multidirectional inference. I will present several instances of this approach. The first is a cost function relating sentences, video, and a lexicon. Performing inference from video and a lexicon to sentences allows it to generate sentential descriptions of video. Performing inference from sentences and a lexicon to video allows it to search a video database for clips that match a sentential query. Performing inference from sentences and video to a lexicon allows it to learn a lexicon. The second is the functional inverse of video captioning. Instead of mapping video and object detections to sentences, one can map video and sentences to object detections. This allows one to use sentential constraint on a video object codetection process to find objects without pretrained object detectors. The third is a cost function relating sentences, robotic navigation paths, and a lexicon. Performing inference from sentences and navigation paths to a lexicon allows it to learn a lexicon. Performing inference from navigation paths and a learned lexicon to sentences allows it to generate sentential descriptions of paths driven by a mobile robot. Performing inference from sentences and a learned lexicon to navigation paths allows it to plan and drive navigation paths that satisfy a sentential navigation request. Finally, one can perform object codetection on the video stream from a robot-mounted camera during navigation to satisfy sentential requests and use the collection of constraints from vision, language, and robotics to detect, localize, and label objects in the environment without any pretrained object detectors. Joint work with Andrei Barbu, Daniel Paul Barrett, Scott Alan Bronikowski, N. Siddharth, and Haonan Yu. Jeffrey M. Siskind received the B.A. degree in computer science from the Technion, Israel Institute of Technology, Haifa, in 1979, the S.M. degree in computer science from the Massachusetts Institute of Technology (M.I.T.), Cambridge, in 1989, and the Ph.D. degree in computer science from M.I.T. in 1992. He did a postdoctoral fellowship at the University of Pennsylvania Institute for Research in Cognitive Science from 1992 to 1993. He was an assistant professor at the University of Toronto Department of Computer Science from 1993 to 1995, a senior lecturer at the Technion Department of Electrical Engineering in 1996, a visiting assistant professor at the University of Vermont Department of Computer Science and Electrical Engineering from 1996 to 1997, and a research scientist at NEC Research Institute, Inc. from 1997 to 2001. He joined the Purdue University School of Electrical and Computer Engineering in 2002 where he is currently an associate professor. His research interests include computer vision, robotics, artificial intelligence, neuroscience, cognitive science, computational linguistics, child language acquisition, automatic differentiation, and programming languages and compilers.

1 0

Colloquium Speaker: Shie Mannor today- 12:30pm
by Nicole E. Wagenblast 13 Oct '15

13 Oct '15

Colloquium Speaker Shie Mannor, Technion, Israel Institute of Technology Monday, October 12, 12:30pm Computer Science 105 Co-hosted by the Computer Science Department and the Center for Statistics and Machine Learning Actionable big data: from data to decisions and back In many sequential decision problems all that we have is a record of historical trajectories. Building dynamic models from these trajectories and ultimately sequential decision policies may result in much uncertainty and bias. In this talk we consider the question of how to create control policies from existing historical data and how to better sample trajectories so that future control policies would be better. This question has been central in reinforcement learning in the last decade if not more, and involves methods from statistics, machine learning, optimization, and control theory. I will start my talk with demonstrating why planning with parameter uncertainty is an important issue. I will then describe several approaches: Bayesian uncertainty model over the unknown parameters, a robust approach that takes a worst case view, and a frequentist approach. I will then discuss the challenges that are posed when the model itself rather than just the parameters may not be fully known. I will then describe two challenging real-world domains that have been studied in my research group in collaboration with experts from industry and academia: diabetes care management in healthcare and asset management in high-voltage transmission grids. For each domain I will describe our efforts to reduce the problem to its bare essentials as a reinforcement learning problem, the algorithms for learning the control policies, and some of the lessons we learned. I graduated from the Technion with a BSc in Electrical Engineering and BA in mathematics (both summa cum laude) in 1996. After that I spent almost four years as an intelligence officer with the Israeli Defense Forces. I was subsequently involved in a few ventures in the high-tech industry. I earned my PhD in Electrical Engineering from the Technion at 2002, under the supervision of Nahum Shimkin. I was then a Fulbright postdoctoral associate with LIDS (MIT) working with John Tsitsiklis for two years. I was at the Department of Electrical and Computer Engineering in McGill University from July 2004 until August 2010, where I held a Canada Research Chair in Machine Learning from 2005 to 2009. I have been with the Department of Electrical Engineering at the Technion since 2008 where I am a professor. I am married to Tally and father to Liam, Oliver and Dylan.

1 1

Colloquium Speaker Kyle Jamieson, today, 12:30pm
by Nicole E. Wagenblast 13 Oct '15

13 Oct '15

Colloquium Speaker Kyle Jamieson, University College, London Monday, April 13, 12:30pm Computer Science 105 Leveraging Array Signal Processing in the Wireless Internet of Things Phased array signal processing has long been employed outdoors in radar, underwater in sonar, and underground in seismic monitoring. Today, it has the potential to revolutionize the Internet of Things (IoT) by giving us the ability to track every one of the billions of IoT devices indoors, and meet their exploding bandwidth requirements. But to make the shift to indoor wireless networks, it must cope with strong multipath radio reflections, packetized data transmissions, and commodity hardware platforms. In this talk I will describe two relevant systems through the lens of system-building and experimentation. First, I will describe an indoor location system that uses solely the existing Wi-Fi infrastructure to achieve a median location accuracy of 23 centimeters, and sub-second response time, allowing Wi-Fi-enabled devices to be tracked in real-time. Next, I will present a MIMO-based Sphere Decoder system that leverages novel search algorithms and geometric reasoning to increase wireless throughput, the first of its kind that scales to 256-QAM constellation densities with computational demands that are practically realizable in current ASIC hardware. Finally, I will conclude with a vision of how these techniques will support exciting IoT applications such as video analytics over billions of indoor wireless cameras. Kyle Jamieson is a Senior Lecturer (U.S. equivalent: Assistant Professor) in the Department of Computer Science at University College London (UCL). His research interests are in building wirelessly networked systems for the real world that cut across the boundaries of digital communications and networking. Prior to joining UCL, he received the B.S., M.Eng., and Ph.D. (2008) degrees in Computer Science from the Massachusetts Institute of Technology. He then received a Starting Investigator fellowship from the European Research Council in 2011, Best Paper awards at USENIX 2013 and CoNEXT 2014, and a Google Faculty Research Award in 2015. He regularly serves on the program committees of the ACM MobiCom, USENIX NSDI, and ACM SIGCOMM conferences.

1 0

Colloquium Speaker Kyle Jamieson, Mon April 13, 12:30pm
by Nicole E. Wagenblast 13 Oct '15

13 Oct '15

Colloquium Speaker Kyle Jamieson, University College, London Monday, April 13, 12:30pm Computer Science 105 Leveraging Array Signal Processing in the Wireless Internet of Things Phased array signal processing has long been employed outdoors in radar, underwater in sonar, and underground in seismic monitoring. Today, it has the potential to revolutionize the Internet of Things (IoT) by giving us the ability to track every one of the billions of IoT devices indoors, and meet their exploding bandwidth requirements. But to make the shift to indoor wireless networks, it must cope with strong multipath radio reflections, packetized data transmissions, and commodity hardware platforms. In this talk I will describe two relevant systems through the lens of system-building and experimentation. First, I will describe an indoor location system that uses solely the existing Wi-Fi infrastructure to achieve a median location accuracy of 23 centimeters, and sub-second response time, allowing Wi-Fi-enabled devices to be tracked in real-time. Next, I will present a MIMO-based Sphere Decoder system that leverages novel search algorithms and geometric reasoning to increase wireless throughput, the first of its kind that scales to 256-QAM constellation densities with computational demands that are practically realizable in current ASIC hardware. Finally, I will conclude with a vision of how these techniques will support exciting IoT applications such as video analytics over billions of indoor wireless cameras. Kyle Jamieson is a Senior Lecturer (U.S. equivalent: Assistant Professor) in the Department of Computer Science at University College London (UCL). His research interests are in building wirelessly networked systems for the real world that cut across the boundaries of digital communications and networking. Prior to joining UCL, he received the B.S., M.Eng., and Ph.D. (2008) degrees in Computer Science from the Massachusetts Institute of Technology. He then received a Starting Investigator fellowship from the European Research Council in 2011, Best Paper awards at USENIX 2013 and CoNEXT 2014, and a Google Faculty Research Award in 2015. He regularly serves on the program committees of the ACM MobiCom, USENIX NSDI, and ACM SIGCOMM conferences.

1 0

Colloquium Speaker Kyle Jamieson, Mon April 13, 12:30pm
by Nicole E. Wagenblast 13 Oct '15

13 Oct '15

Colloquium Speaker Kyle Jamieson, University College, London Monday, April 13, 12:30pm Computer Science 105 Leveraging Array Signal Processing in the Wireless Internet of Things Phased array signal processing has long been employed outdoors in radar, underwater in sonar, and underground in seismic monitoring. Today, it has the potential to revolutionize the Internet of Things (IoT) by giving us the ability to track every one of the billions of IoT devices indoors, and meet their exploding bandwidth requirements. But to make the shift to indoor wireless networks, it must cope with strong multipath radio reflections, packetized data transmissions, and commodity hardware platforms. In this talk I will describe two relevant systems through the lens of system-building and experimentation. First, I will describe an indoor location system that uses solely the existing Wi-Fi infrastructure to achieve a median location accuracy of 23 centimeters, and sub-second response time, allowing Wi-Fi-enabled devices to be tracked in real-time. Next, I will present a MIMO-based Sphere Decoder system that leverages novel search algorithms and geometric reasoning to increase wireless throughput, the first of its kind that scales to 256-QAM constellation densities with computational demands that are practically realizable in current ASIC hardware. Finally, I will conclude with a vision of how these techniques will support exciting IoT applications such as video analytics over billions of indoor wireless cameras. Kyle Jamieson is a Senior Lecturer (U.S. equivalent: Assistant Professor) in the Department of Computer Science at University College London (UCL). His research interests are in building wirelessly networked systems for the real world that cut across the boundaries of digital communications and networking. Prior to joining UCL, he received the B.S., M.Eng., and Ph.D. (2008) degrees in Computer Science from the Massachusetts Institute of Technology. He then received a Starting Investigator fellowship from the European Research Council in 2011, Best Paper awards at USENIX 2013 and CoNEXT 2014, and a Google Faculty Research Award in 2015. He regularly serves on the program committees of the ACM MobiCom, USENIX NSDI, and ACM SIGCOMM conferences.

1 0

Colloquium Speaker: Shie Mannor, Mon, Oct 12- 12:30pm
by Nicole E. Wagenblast 12 Oct '15

12 Oct '15

Colloquium Speaker Shie Mannor, Technion, Israel Institute of Technology Monday, October 12, 12:30pm Computer Science 105 Co-hosted by the Computer Science Department and the Center for Statistics and Machine Learning Actionable big data: from data to decisions and back In many sequential decision problems all that we have is a record of historical trajectories. Building dynamic models from these trajectories and ultimately sequential decision policies may result in much uncertainty and bias. In this talk we consider the question of how to create control policies from existing historical data and how to better sample trajectories so that future control policies would be better. This question has been central in reinforcement learning in the last decade if not more, and involves methods from statistics, machine learning, optimization, and control theory. I will start my talk with demonstrating why planning with parameter uncertainty is an important issue. I will then describe several approaches: Bayesian uncertainty model over the unknown parameters, a robust approach that takes a worst case view, and a frequentist approach. I will then discuss the challenges that are posed when the model itself rather than just the parameters may not be fully known. I will then describe two challenging real-world domains that have been studied in my research group in collaboration with experts from industry and academia: diabetes care management in healthcare and asset management in high-voltage transmission grids. For each domain I will describe our efforts to reduce the problem to its bare essentials as a reinforcement learning problem, the algorithms for learning the control policies, and some of the lessons we learned. I graduated from the Technion with a BSc in Electrical Engineering and BA in mathematics (both summa cum laude) in 1996. After that I spent almost four years as an intelligence officer with the Israeli Defense Forces. I was subsequently involved in a few ventures in the high-tech industry. I earned my PhD in Electrical Engineering from the Technion at 2002, under the supervision of Nahum Shimkin. I was then a Fulbright postdoctoral associate with LIDS (MIT) working with John Tsitsiklis for two years. I was at the Department of Electrical and Computer Engineering in McGill University from July 2004 until August 2010, where I held a Canada Research Chair in Machine Learning from 2005 to 2009. I have been with the Department of Electrical Engineering at the Technion since 2008 where I am a professor. I am married to Tally and father to Liam, Oliver and Dylan.

1 1

Keller Center 10th Anniversary Symposium- Tuesday, October 13
by Nicole E. Wagenblast 09 Oct '15

09 Oct '15

Keller Center 10th Anniversary Symposium- Tuesday, October 13 Please join us as we celebration a decade of Keller. Our afternoon program will include discussions on Education Innovation and Entrepreneurship in higher education with some of Princeton’s leaders in the field, a keynote address by Tom Leighton ’78 with introduction by President Eisgruber ’83, and of course there will be cake! For more information on the speakers and to register, please visit: http://kellercenter.princeton.edu/engage/e-vents/keller-center-10-years/

1 1

Colloquium Speaker Martial Hebert, Fri Oct 9, 12:30pm
by Nicole E. Wagenblast 08 Oct '15

08 Oct '15

Colloquium Speaker Martial Hebert, Carnegie Mellon University Friday, October 9, 12:30pm Computer Science 105 The task of visual prediction is important for two main reasons: (a) For intelligent agents and systems, prediction is vital for decision making. For example, in order to perform assistive activities, robots must be able to predict the intentions of other agents in the scene. Even a task as simple as walking through a crowded hallway requires the prediction of human trajectories. (b) More importantly, prediction requires deep understanding of the visual world and complex interplay between different elements of the scene. Therefore, prediction can act as a way to define “what does it mean to understand an image,” and the task of visual prediction can act as an enabler for scene understanding. In this talk, I will go over several techniques for prediction developed over the past few years. These techniques operates at different levels of descriptions from high-level object motions, to mid-level patch motion and appearance changes, to low-level optical flow. They operate at different levels of supervision from strong the supervision requiring explicit object tracking to unsupervised learning for patch-based prediction. I will discuss the pros and cons of different levels, ideas for combining them and example applications in robotics and transportation applications. Martial Hebert is a Professor of Robotics Carnegie Mellon University and Director of the Robotics Institute, which he joined in 1984. His interest includes computer vision, especially recognition in images and video data, model building and object recognition from 3D data, and perception for mobile robots and for intelligent vehicles. His group has developed approaches for object recognition and scene analysis in images, 3D point clouds, and video sequences. In the area of machine perception for robotics, his group has developed techniques for people detection, tracking, and prediction, and for understanding the environment of ground vehicles from sensor data. He has served on the editorial boards the IEEE Transactions on Robotics and Automation, the IEEE transactions on Pattern Analysis and Machine Intelligence, and the International Journal of Computer Vision (for which he currently serves as Editor-in-Chief).

1 1

Perspectives from a Young Alumni Founder Patrick Wendell'11- Keller Center Event
by Nicole E. Wagenblast 07 Oct '15

07 Oct '15

Perspectives from a Young Alumni Founder, Patrick Wendell'11 Keller Center Event Thursday, October 8, 5:30pm Hub 34 Chambers Street Event Room RSVP Required This talk will feature Patrick Wendell, class of 2011. Two years after graduating from Princeton in Computer Science, Patrick co-founded Databricks, a company commercializing the Apache Spark software platform for large scale data processing. Databricks helps companies extract value from large amounts of data. Over the last two and a half years, Databricks has raised more than $40 million inventure funding from lead investors Andreessen Horowitz and NEA Ventures. The company employs more than 70 people at its San Francisco headquarters. In this talk, which will be followed by a "meet-and-greet" session, Patrick will revisit the founding of the company and reflect on lessons learned along the path from Princeton, to Berkeley, and finally to the start-up world. Topics will include fundraising, product strategy, building successful teams, transferring technical innovation into usable products, and perspectives on how the undergraduate life differs from the life of an entrepreneur. He will also discuss different avenues to an entrepreneurial career for Princeton students. The session will be highly interactive and allow for questions from the audience. Patrick Wendell is a co-founder of Databricks as well as a founding Committer and PMC member of the Apache Spark software project. In the Spark project, Patrick has acted as release manager for several Spark releases, in addition to maintaining several subsystems of Spark's core engine. At Databricks, Patrick directs the company's maintenance and development of Spark.Patrick holds an M.S. in Computer Science at UC Berkeley, where his research focused on low latency scheduling for large scale analytics workloads. He holds a B.S.E in Computer Science from Princeton University. RSVP for this event to bjarvie(a)princeton.edu

1 1

Colloquium Speaker Jeffrey Siskind Thurs Oct 15, 12:30pm
by Nicole E. Wagenblast 07 Oct '15

07 Oct '15

Colloquium Speaker Jeffrey Siskind, from Purdue University Thursday, October 15, 12:30pm Computer Science 105 Seeing, Saying, Doing, and Learning: Integrating Computer Vision, Natural Language Processing, Robotics, and Machine Learning Through Multidirectional Inference The semantics of natural language can be grounded in perception and motor control with a unified cost function that supports multidirectional inference. I will present several instances of this approach. The first is a cost function relating sentences, video, and a lexicon. Performing inference from video and a lexicon to sentences allows it to generate sentential descriptions of video. Performing inference from sentences and a lexicon to video allows it to search a video database for clips that match a sentential query. Performing inference from sentences and video to a lexicon allows it to learn a lexicon. The second is the functional inverse of video captioning. Instead of mapping video and object detections to sentences, one can map video and sentences to object detections. This allows one to use sentential constraint on a video object codetection process to find objects without pretrained object detectors. The third is a cost function relating sentences, robotic navigation paths, and a lexicon. Performing inference from sentences and navigation paths to a lexicon allows it to learn a lexicon. Performing inference from navigation paths and a learned lexicon to sentences allows it to generate sentential descriptions of paths driven by a mobile robot. Performing inference from sentences and a learned lexicon to navigation paths allows it to plan and drive navigation paths that satisfy a sentential navigation request. Finally, one can perform object codetection on the video stream from a robot-mounted camera during navigation to satisfy sentential requests and use the collection of constraints from vision, language, and robotics to detect, localize, and label objects in the environment without any pretrained object detectors. Joint work with Andrei Barbu, Daniel Paul Barrett, Scott Alan Bronikowski, N. Siddharth, and Haonan Yu. Jeffrey M. Siskind received the B.A. degree in computer science from the Technion, Israel Institute of Technology, Haifa, in 1979, the S.M. degree in computer science from the Massachusetts Institute of Technology (M.I.T.), Cambridge, in 1989, and the Ph.D. degree in computer science from M.I.T. in 1992. He did a postdoctoral fellowship at the University of Pennsylvania Institute for Research in Cognitive Science from 1992 to 1993. He was an assistant professor at the University of Toronto Department of Computer Science from 1993 to 1995, a senior lecturer at the Technion Department of Electrical Engineering in 1996, a visiting assistant professor at the University of Vermont Department of Computer Science and Electrical Engineering from 1996 to 1997, and a research scientist at NEC Research Institute, Inc. from 1997 to 2001. He joined the Purdue University School of Electrical and Computer Engineering in 2002 where he is currently an associate professor. His research interests include computer vision, robotics, artificial intelligence, neuroscience, cognitive science, computational linguistics, child language acquisition, automatic differentiation, and programming languages and compilers.

1 0