Inventing the future of digitally augmented objects and environments.
Archived
Archived
Research
Collective Learning

Transforming data into knowledge
Research
Human Dynamics

Exploring how social networks can influence our lives in business, health, governance, and technology adoption and diffusion
Publication Research

Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity

Leong, Joanne, et al. "Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity." Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 2021.
Research
Fluid Interfaces

Designing Systems for Cognitive Support
Research
Personal Robots

Building intelligent personified technologies that collaborate with people to help them learn, thrive, and flourish.
Research
Responsive Environments

Augmenting and mediating human experience, interaction, and perception with sensor networks
Research
Affective Computing

Advancing human wellbeing by developing new ways to communicate, understand, and respond to emotion
Article Research

New Study Highlights Opportunities for Artificial Emotional Intelligence

MIT uses affective computing in efforts to improve human mental health.
Research
Sculpting Evolution

Cultivating wisdom through evolutionary and ecological engineering
Project Research

Dyadic Affect in Multimodal Interaction - Parent to Child (DAMI-P2C) Dataset

Audio-visual data set containing around 21.6 hours of parent-child interaction during story reading.The DAMI-P2C dataset consists of audio-…
Research
Social Machines

Promoting deeper learning and understanding in human networks
Research
Camera Culture

Making the invisible visible–inside our bodies, around us, and beyond–for health, work, and connection
Project Research

Situated VR: Towards a Congruent Hybrid Reality without Experiential Artifacts

​Situated VR: Towards a Congruent Hybrid RealityThe vision of Extended Reality (XR) systems is living in a hybrid reality or "Metaverse" wh…
Archived
Research
ML Learning

ML Learning
Center for Civic Media
Archived
Archived
Research
Object-Based Media

Changing storytelling, communication, and everyday life through sensing, understanding, and new interface technologies
Article Research

The Science Behind Creativity

Seli is an assistant professor at the Duke Institute for Brain Sciences and also an artist. He uses Dormio to tap into hypnagogia.
Archived
Project Research

SPRING: A Smart Platform for Research, Intervention, and Neurodevelopmental Growth

SPRING is a custom-built hardware and software platform for children with neuro-differences. The system automates data acquisition, optimiz…
Archived
Project Research

KALM: BCI Systems for Managing Anxiety and Stress

The KALM project consists of a multimodal dataset and a wearable system for managing anxiety.  With this set of tools we aim to make n…
Article Research

Podcast: Night Shifts

Perchance to dream engineer: on new research into our sleeping minds
Article Research

Night Shifts

In the April issue, Michael W. Clune writes about the profound insights offered by the Dormio: "Can technology shape our dreams?"
Article Research

The consequences of hacking our dreams

Advertisers are beginning to explore ways to market products to people while they sleep. A group of scientists talked to NPR about the risks
Project Research

Dormio: Interfacing with Dreams

InspirationSleep is a forgotten country of the mind. A vast majority of our technologies are built for our waking state, even though a thir…
Article Research

Inside your dreamscape

Dream-hacking techniques can help us create, heal and have fun. They could also become tools of commercial manipulation.
How buildings and cities can become more intelligently responsive to the needs and desires of their inhabitants.
Archived
Article Research

Are advertisers coming for your dreams?

"We can see the waves forming a tsunami that will come, but most people are just sleeping on a beach unaware"
Archived
Project Research

Multi-SPRING

OverviewWe have created a new customizable, multi-user research-through-play platform designed to facilitate social skill development for c…
Archived
Article Research

Advertisers are hijacking your dreams, scientists say

This is the actual stuff of nightmares.
Article Research

Companies are ready to experiment with advertising in your dreams, and experts are sounding the alarm

Sleep and dream researchers are urging for an advance tightening of advertising law to nip all this in the bud before it starts in earnest.
Article Research

Neuroscientists warn advertisers are trying to 'weaponize sleep' by plugging into your dreams

“The potential for misuse of these technologies is as ominous as it is obvious.”
Article Research

Nightmare scenario: Alarm as advertisers seek to plug into our dreams

After Coors sought to steer unconscious minds to thoughts of beer, scientists have called for curbs on ‘targeted dream incubation.’
Project Research

Targeted Dream Incubation

What Is TDI?Targeted Dream Incubation is a method for guiding dreams towards specific themes. It is a proposal both magnetic and unlik…
Project Research

Frisson

Interoceptive Technologies: Inducing emotions from the body upInspirationThere’s a feeling that comes tingling down the spine in certain mo…
Project Research

Essence Wearables: Biometric Olfactory Interfaces for Day and Night

Human-computer interaction (HCI) has traditionally focused on designing and investigating interfaces that provide explicit visual, auditory…
Archived
Project Research

SeqCLR: Self-supervised learning of features for time-series data

Interpreting human electroencephalogram (EEG) is a challenging task and requires years of medical training. We present a framework for lear…
Archived
Article Research

Scientists engineer dreams to understand the sleeping brain

Researchers in the Fluid Interfaces group and elsewhere are hoping to learn more about how and why dreams are generated, and their effects.
Publication Research

Dormio: Interfacing with Dreams

Haar Horowitz, Adam, Ishaan Grover, Pedro Reynolds-Cuéllar, Cynthia Breazeal, and Pattie Maes. "Dormio: Interfacing with dreams." In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1-10. 2018.
Project Research

SkipNorm

Skip Norm is a new and flexible building block for Deep Learning that serves as a skip connection and normalization block simultaneously. I…
Archived
Research
Synthetic Neurobiology

Revealing insights into the human condition and repairing brain disorders via novel tools for mapping and fixing brain computations
Archived
Project Research

Tools for mapping the molecular architecture and wiring of the brain

Complex biological systems such as brain circuits are extended 3-D structures made out of nanoscale building blocks such as proteins, RNAs,…
Archived
Architecture Machine Group
Archived
Archived
Research
New Media Medicine

How radical new collaborations will catalyze a revolution in health.
Project Research

Modeling Auditory Memory

When we form memories, not everything that we perceive is noticed; not everything that we notice is remembered. Humans are excellent at f…
How to build characters that have the everyday common sense, the ability to learn, and the sense of empathy that one finds in animals such a
Archived
Digital Life
Archived
Archived
Project Research

Relational AI

Creating long-term interpersonal interaction and shared experiences with social robots Many of our current projects explore the use of…
Archived
Archived
Research
CE 2.0

CE 2.0
Archived
Research
Advancing Wellbeing

Advancing Wellbeing
Archived
Research
Music, Mind and Machine

How to build intelligent music systems out of interacting audio-processing agents.
Project Research

Digital Synesthesia

Digital Synesthesia looks to evolve the idea of human-computer interfacing and give way for human-world interacting. It aims to find a way …
Archived
Article Research

Ed Boyden on minding your brain

A conversation between Ed Boyden and Tyler Cowen on optogenetics and expansion microscopy to storytelling and the nature of consciousness.
Project Research

Cognimates: Collaborative creative learning with embodied intelligent agents

Cognimates is a platform where parents and children (7-10 years old) participate in creative programming activities in which they lea…
Article Research

Lighting the path

Luminaries in computing and cognition discuss their journeys and share their insights.
Communications Futures Program
Archived
e-markets
Archived
Future Storytelling
Archived
Consumer Electronics Laboratory
Archived
Archived
Project Research

Masque

 When the body senses itself internally and localizes its actions, it provides the basis for a material sense of self-existence. At th…
Archived
How software can act as an assistant to the user rather than a tool, by learning from interaction and by proactively anticipating the user's
Archived
Archived
Project Research

FaceSense: Affective-Cognitive State Inference from Facial Video

People express and communicate their mental states–such as emotions, thoughts, and desires–through facial expressions, vocal nuances, gestu…
Archived
Post Research

Making new (robot) friends: Further reading

For the interested reader:If you'd like to learn more about the topics covered in my post,  Making new (robot) friends: Understanding …
Archived
Research
Electronic Publishing

How to distill meaning from complex everyday experiences.