Rana Kaliouby, Rosalind W. Picard, Alea Teeters, Matthew Goodwin

Abstract

This project is a collaborative effort between the Massachusetts Institute of Technology Media Laboratory and the Groden Center to develop and evaluate wearable social-emotional technology that helps individuals with high-functioning autism or Asperger syndrome acquire an affinity for the social domain and improve their overall social abilities. The project will develop the first wearable camera system capable of perceiving and visualizing social-emotional information in real-time human interaction. Using a small wearable camera and video-pattern analysis algorithms, the system analyzes video of the wearer or interaction partner and tags it at multiple granularities (facial actions, communicative facial or head gestures, and emotions).