None
Peter Torpey Thesis Defense: Media Scores: A Framework for Composing the Modern-Day Gesamtkunstwerk
Aug. 28, 2013
Referring expressions with vague and ambiguous modifiers, such as “a quick visit” and “the big meeting,” are difficult for computers to interpret because their meanings are defined in part by context. For the hearer to arrive at the speaker's intended meaning, he must consider the alternative decisions that the speaker was faced with in context.
To address these challenges, Dustin Smith proposes a new approach to both generating and interpreting referring expressions based on belief-state planning and plan recognition. Planning in belief space offers a way to capture the uncertainty of interpretations. Both generation and interpretation procedures are incremental, because each belief state represents a complete interpretation. The contributions of his thesis are:
(1) A computational model of reference generation and interpretation that is fast, incremental, and non-deterministic. This model includes a lexical semantics for a fragment of English noun phrases, which specifies the encoded meanings of determiners (quantifiers and articles), gradable and ambiguous modifiers. It performs in real time, even when the hypothesis space grows very large. Because it's incremental, it avoids considering possibilities that will later turn out to be irrelevant.
(2) Integrating generation and interpretation into a single process.
Interpretation is guided by comparison to alternatives produced by the generation module. When faced with an underspecified description, the system uses what it could have said and compares that to what the user did say. Reasoning about hypothetical generation decisions facilitates interpretive inferences of this sort: "She ate some of the tuna" means not all of it, otherwise you would have said,``She ate the tuna".
This approach has been implemented and evaluated using a computational model, AIGRE. Smith also created a testbed for comparing human judgments of referring expressions to those produced by our algorithm (or others). In an online user experiment with Mechanical Turk, he got 97% coverage of human responses in a simple geometrical domain where correct responses were clear, and lower, but still encouraging, coverage in a more complex, real-world domain where the responses were outside the language model.
The model, AIGRE, demonstrates that vagueness and ambiguity in natural language, while still not easy, is manageable. The day where we will routinely talk to our computers in unconstrained natural language is not far off.
Additional Featured Research By
(Unpublished) Software Agents
Host/Chair: (Unpublished) Henry A. Lieberman
Marvin L. Minsky, Agustín Rayo
Gershon Dublon Dissertation Defense
Nan Zhao Dissertation Defense
Yadid Ayzenberg Thesis Defense: Tributary, Interactive Distributed Analytics of Large Scale Sensor Time Series Data
David Mellis Dissertation Defense: Do-It-Yourself Devices
Roy Shilkrot Thesis Defense: Designing Assistive Finger Augmentation Devices
Soroush Vosoughi Thesis Defense: Automatic Detection and Verification of Rumors in Twitter
Micah Eckhardt Thesis Defense: Inclusive Creative Learning Technology
Robert Morris Dissertation Defense: Crowd Sourcing Mental Health and Emotional Well-Being
Jay Silver Thesis Defense on LENS × BLOCK: World as Construction Kit
Matt Hirsch Dissertation Defense: Computational Visual Reality
Sigurður (Siggi) Örn Aðalgeirsson Thesis Defense
James Barabas Thesis Defense: Holographic Television; Measuring Visual Performance with Holographic and Other 3D Television Technologies
Seth Hunter Thesis Defense: WaaZam! Supporting Creative Play at a Distance in Personalized Video Environments
Dustin Smith Thesis Defense: Generating and Interpreting Referring Expressions in Context Now Viewing
John Moore Dissertation Defense: Technology-Supported Apprenticeship in the Management of Chronic Disease
M. Ehsan Hoque Dissertation Defense: Computers to Help with Conversations: Affective Framework to Enhance Human Nonverbal Skills
Michael Lapinski Thesis Defense: A Platform for High-Speed Biomechanical Data Analysis using Wearable Wireless Sensors
Karen Brennan Thesis Defense: Best of Both Worlds; Issues of Structure and Agency in Computational Creation, In and Out of School
Drew Harry Thesis Defense: Designing Complementary Communication Systems
Nadav Aharony Thesis Defense: Social fMRI
Angela Chang Thesis Defense
Amon Millner Thesis Defense: Computer as Chalk
Mark Feldmeier Thesis Defense: Personalized Building Comfort Control
David Merrill Thesis Defense: Gestural Interaction with Embodied Media
Manu Prakash Thesis Defense: Low Reynolds Number Microfluidic Logic and Control
Michael Fleischman Thesis Defense: Grounding Language in Events
Emmanuel Munguia Tapia Thesis Defense: Using Machine Learning for Real-Time Activity Recognition and Estimation of Energy Expenditure
Matt Berlin Thesis Defense: Understanding the Embodied Teacher: Sensible Learning for Sociable Robots
Hayes Raffle Thesis Defense: Sculpting Behavior: A Tangible Language for Hands-On Play and Learning
Cory Kidd Thesis Defense: Designing for Long-Term Human-Robot Interaction and Application to Weight Loss
David Kong Thesis Defense: Microfluidic Gene Synthesis
Claudia Urrea Thesis Defense: One to One Connections: Building a Community Learning Culture
Guy Hoffman Thesis Defense: Ensemble–Fluency and Embodiment for Robots Acting with Humans
Elisabeth Sylvan Thesis Defense: The Sharing of Wonderful Ideas: Influence and Interaction in Online Communities of Creators
Arnan Roger Sipitakiat Thesis Defense: Giving the Head a Hand
Ernesto Arroyo Thesis Defense: Mediating Disruption in Human-Computer Interaction from Implicit Metrics of Attention
Oren Zuckerman Thesis Defense: Flowness + FlowBlocks
Leo Burd Thesis Defense: Technological Initiatives for Social Empowerment
Kai-yuh Hsiao Thesis Defense: Embodied Object Schemas for Grounding Language
Guy Hoffman Thesis Proposal Defense
Ari Benbasat - Thesis Defense: An Automated Framework for Power-Efficient Detection in Embedded Sensor Systems
Nikolaos Mavridis Thesis Defense: Grounded Situation Models for Situated Conversational Assistants
Roberto Aimi Thesis Defense: Percussion Using Sampled Acoustics
Jason Taylor Thesis Defense: "Controlling Molecules with Lasers and Lasers with Molecules"
Hyun-Yeul Lee Thesis Defense: Storied Objects
Aisling Kelliher Thesis Defense: Everyday Storytelling
Win Burleson Thesis Defense: Affective Learning Companions
Andrew Brooks Thesis Defense: Coordinating Human-Robot Communication
Robbin Chapman Thesis Defense: Pearls of Wisdom
Hugo Liu Thesis Defense: Computing Point-of -View
Benjamin Recht Thesis Defense: Convex Modeling with Priors
Ashish Kapoor Thesis Defense: Learning Discriminative Models with Incomplete Data
Paul Nemirovsky Thesis Defense: Improvisational Interaction: a Framework for Structural Exploration of Media
Jacky Mallet Thesis Defense: The Role of Groups in Smart Camera Networks
Constantine K. Christakos Thesis Defense: Distributed-in/ Distributed-out Sensor Networks
Marc Downie Thesis Defense: Choreographing the Extended Agent: Performance Graphics for Dance Theater
Carson Reynolds Thesis Defense: Adversarial Uses of Affective Computing and Ethical Implications
Peter Gorniak Thesis Defense: The Affordance-Based Concept
Cameron Marlow Thesis Defense: The Structural Determinants of Media Contagion
Erik Blankinship Thesis Defense: Who's Got Game (Theory)?
Jeana Frost Thesis Defense: A Study of and Design for Online Dating
Fernanda Viégas Thesis Defense: Revealing Individual and Collective Pasts: Visualizations of Online Social Archives
Alexandra Mazalek Thesis Defense: Media Tables: An Extensible Method for Developing Multi-User Media Interaction Platforms for Shared Spaces
Aggelos Bletsas Thesis Defense: Intelligent Antenna Sharing
Tristan Jehan Thesis Defense: Creating Music by Listening
Wei Chai Thesis Defense: Automated Analysis of Musical Structure
Joan DiMicco: Changing Small Group Interaction through Visual Reflections of Social Behavior
Nathan Eagle Thesis Defense: Machine Perception and Learning of Complex Social Systems
Stefan Marti Thesis Defense: Autonomous Interactive Intermediaries: Social Intelligence for Mobile Communication Agents
Kimiko Ryokai Thesis Defense: The World as a Palette
Brian Whitman Thesis Defense: Learning the Meaning of Music
Barbara Barry Thesis Defense: Mindful Documentary
Tara Shankar Thesis Defense: Speaking on the Record
Andrew Sparks Thesis Defense: Scanning Probe Microscopy With Inherent Disturbance Suppression Using Micromechanical Devices
Nyssim Lefford Thesis Defense: The Structure, Perception and Generation of Musical Patterns
Sunil Vemuri Thesis Defense: Personal Long-Term Memory Aids
Natalia Marmasse Thesis Defense: Providing Lightweight Telepresence in Mobile Communication to Enhance Collaborative Living
Karrie Karahalios Thesis Defense: Social Catalysts: Enhancing Communication in Mediated Spaces
Pengkai Pan Thesis Defense: Mobile Cinema
Saul Griffith Thesis Defense: Growing Machines
Eric Wilhelm Thesis Defense: Printed Electronics and Micro-electromechanical Systems
Yael Maguire Thesis Defense: Scalable Electromagnetic Microstructure Instrumentation
Rich DeVaul Thesis Defense: The Memory Glasses, Wearable Computing for Just-in-Time Memory Support
Stacy Morris Thesis Defense: A Shoe-Integrated Sensor System for Wireless Gait Analysis and Real-Time Therapeutic Feedback
Ben Fry Thesis Defense: Computational Information Design
Cagri Savran Thesis Defense: A Micromechanical Biosensor with Inherently Differential Readout
Tanzeem Choudhury Thesis Defense: Sensing and Modeling Human Networks
Raul Fernandez Thesis Defense: A Computational Model for the Automatic Recognition of Affect in Speech
Chris Hancock Thesis Defense: Real-Time Programming and the Big Ideas of Computational Literacy
Brent Ridley Thesis Defense: Printed Inorganic Transistors
Gili Weinberg Thesis Defense: Interconnected Musical Networks?Bringing Expression and Thoughtfulness to Collaborative Group Playing
Benjamin Vigoda Thesis Defense: Continuous-Time Analog Circuits for Statistical Signal Processing in Multiuser Communication
E. Rehmi Post Thesis Defense: Inertial Measurement via Dynamics of Trapped Particles
Youngmoo Kim Thesis Defense: Singing Voice Analysis/Synthesis
Hannes Vilhjalmsson Thesis Defense: Avatar Augmented Online Conversation
Vadim Gerasimov Thesis Defense: Every Sign of Life
Timothy Bickmore Thesis Defense
Matthew Reynolds Thesis Defense: Low Frequency Indoor Radiopositioning
Nitin Sawhney Thesis Defense: Cooperative Innovation in the Commons
Brian Clarkson Thesis Defense: Structure from Wearable Sensors
Sumit Basu Thesis Defense: Conversational Scene Analysis
Brygg Ullmer Thesis Defense: Tangible Interfaces for Manipulating Aggregates of Digital Information
Michael Patrick Johnson Thesis Defense: Exploiting Quaternions to Support Expressive Interactive Character Motion
Richard Fletcher Thesis Defense: Low-cost Electromagnetic Tagging: Design and Implementation
Bill Tomlinson Thesis Defense: Synthetic Social Relationships for Computational Entities