Menu
Project

Theme | Social Intelligence

Copyright

Jibo

JIbo 

Groups

How can we make embodied agents have multimodal conversation with individual and group users that is not only natural, but also relational, empathetic, commonsensical, contextual, and meaningfully continuous?

Project Research

EmpathicStories++ Dataset: A Multimodal Empathy Dataset

The EMPATHICSTORIES++ dataset is collected from a month-long in-the-wild deployment of 41 participants (across 269 sessions with 53 hours o…
Project Research

Narrative Empathy and LLMs

Empathy serves as a cornerstone in enabling prosocial behaviors, and can be evoked through sharing of personal experiences in stories.…
Project Research

A HeARTfelt Robot: Social Robot-Driven Deep Emotional Art Reflection with Children

In "A HeARTfelt Robot", we designed a social robot interaction for children age 7-11 that helped them practice their social-emotional learn…
Project Research

Robot mediated multi-person interaction for optimal social-emotional experience

This project explores multi-person conversation flow, likening it to a dance where participants must coordinate their steps effectively. Ef…
Archived
Project Research

Improving Dialogue Agents (LLMs) with Multimodal Feedback

We propose an approach for aligning an LLM- based dialogue agent for long-term social dialogue, where there is only a single global score g…
Archived
Project Research

Human Robot Social Interaction (HSRI) Dataset & Benchmark

Our work aims to advance the socially intelligent behavior of social embodied artificial intelligence (AI) agents in real-world social inte…
Project Research

Modeling Contingent Behaviors in Multiparty Conversations

Recognizing and interpreting group behaviors is much more challenging than that of individual behaviors. Firstly, the system must perform w…
Project Research

Affective Typography for Empathetic Story Reading

When people listen to stories, the words are colored with emotions conveyed through prosodic features beyond the text alone. Visual font d…
Project Research

Modeling Empathic Similarity in Personal Narratives

The most meaningful connections between people are often formed through expression of shared vulnerability and emotional experiences. Despi…