Project

Theme | Multi-modal Interaction + Language

Groups

How can we make embodied agents have multimodal conversation with individual and group users that is not only natural, but also relational, empathetic, commonsensical, contextual, and meaningfully continuous?

Project Research

The Social Robot Intelligence Benchmark

The social robot intelligence benchmark is a large-scale multimodal dataset comprising of many diverse contexts, tasks and environments to …
Project Research

Modeling Contingent Behaviors in Multiparty Conversations

Recognizing and interpreting group behaviors is much more challenging than that of individual behaviors. Firstly, the system must perform w…
Project Research

Affective Typography for Empathetic Story Reading

When people listen to stories, the words are colored with emotions conveyed through prosodic features beyond the text alone. Visual font d…
Project Research

Modeling Empathic Similarity in Personal Narratives

The most meaningful connections between people are often formed through expression of shared vulnerability and emotional experiences. Despi…