<html><body><div style="font-family: garamond,new york,times,serif; font-size: 12pt; color: #000000"><div><p style="margin: 0px;" data-mce-style="margin: 0px;"><span style="font-family: garamond, "new york", times, serif; font-size: 12pt;" data-mce-style="font-family: garamond, 'new york', times, serif; font-size: 12pt;"><span style="line-height: 115%; color: black;" data-mce-style="line-height: 115%; color: black;">Kiran Vodrahalli will present his MSE thesis talk on </span><span style="line-height: 115%; color: black;" data-mce-style="line-height: 115%; color: black;">Wednesday, May 10, 2017 at 1pm in CS 401. </span> The members of his committee are Sanjeev Arora (adviser) and Ken Norman (Princeton Neuroscience Institute). </span><span data-mce-style="line-height: 115%; color: black;" style="line-height: 115%; color: black;">Everyone is invited to attend his talk. His </span>abstract follows below.</p><p style="margin: 0px;" data-mce-style="margin: 0px;"><br></p></div><div data-marker="__QUOTED_TEXT__"><div dir="ltr"><div><span style="color: rgb(0, 0, 0); font-family: garamond, "new york", times, serif; font-size: 12pt;" data-mce-style="color: #000000; font-family: garamond, 'new york', times, serif; font-size: 12pt;">Several research groups have shown how to correlate fMRI responses to the meanings of presented stimuli. This paper presents new methods for doing so when only a natural language annotation is available as the description of the stimulus. We study fMRI data gathered from subjects watching an episode of BBCs Sherlock, and learn bidirectional mappings between fMRI responses and natural language representations. We show how to leverage data from multiple subjects watching the same movie to improve the accuracy of the mappings, allowing us to succeed at a scene classification task with 72% accuracy (random guessing would give 4%) and at a scene ranking task with average rank in the top 4% (random guessing would give 50%). The key ingredients are (a) the use of the Shared Response Model (SRM) and its variant SRM-ICA to aggregate fMRI data from multiple subjects, both of which are shown to be superior to standard PCA in producing low-dimensional representations for the tasks in this paper; a sentence embedding technique adapted from the natural language processing (NLP) literature [4] that produces semantic vector representation of the annotations; using previous timestep information in the featurization of the predictor data.</span><br></div></div><div class="gmail_extra"><br></div></div></div></body></html>