Research — MIT Media Lab

Venous Materials : Towards Interactive Fluidic Mechanisms

Mor, Hila, Ken Nakagaki, et al. "Venous Materials : Towards Interactive Fluidic Mechanisms." CHI '20, Honolulu, HI, USA, April 2020. DOI: https://doi.org/10.1145/3313831.3376129

Byte.it

Discreet Teeth Gestures for Mobile Device InteractionByte.it is a miniaturized, discreet interface that uses teeth gestures for hands-fre...

Archived

PerForm

PerForm explores the intuitive meanings associated with the shape of objects, and how a deformable tool can allow for interaction based o...

Archived

Wearable Wisdom

Wearable Wisdom: An Intelligent Audio-Based System for Mediating Wisdom and AdviceHaving good mentors and role models is important for pe...

Jamming to Knitting, Music to Machines: Bringing interdisciplinary research to the manufacturing ecosystem

Here's my take on the future of textiles, as well as the connection between research and manufacturing.

ETH Zurich at the WEF – RETHINKING Creativity

KnittedKeyboard at ETH Rethinking Creativity Pavilion

Archived

PopBots: An early childhood AI curriculum

How can we add the missing "T" and "E" in preschool STEAM education?

Archived

Marauder's Map

"I solemnly swear that I am up to no good."The Marauder's Map from the Harry Potter universe uses UltraWide Band transmitters and receive...

Archived

Byte.it: Discreet Teeth Gestures for Mobile Device Interaction

Tomás Vega Gálvez, Shardul Sapkota, Alexandru Dancu, Pattie Maes, CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI’19 Extended Abstracts), May 4–9, 2019, Glasgow, Scotland UK, ACM, New York, NY, USA, 6 pages, https://doi.org/10.1145/3290607.3312925

A holographic meeting platform for collaborating from anywhere

"There's got to be a better way to share space and work together remotely—but computers or phones may not be the right tools."

Archived

Connected Coral

Connected Coral integrates physical and digital elements in a visualization of the environmental impacts on reefs. This complex projectio...

Archived

Grain Prism

The Grain Prism is a hybrid musical instrument that combines granular synthesis and live audio recordings. Presented in a capacitive touc...

Cilllia: 3D-printed micro pillar structures for surface texture, actuation, and sensing

In nature, hair has numerous functions such as providing warmth, adhesion, locomotion, sensing, and a sense of touch, as well as its well...

RGBox

The RGBox is an experimental game to teach fundamentals of additive color mixing theory. As opposed to the behavior of pigments that...

Essence: Olfactory Interfaces for Unconscious Influence of Mood and Cognitive Performance

Judith Amores and Pattie Maes. 2017. Essence: Olfactory Interfaces for Unconscious Influence of Mood and Cognitive Performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '17). ACM, Denver, CO, USA. DOI: http://dx.doi.org/10.1145/3025453.3026004

MoveU

MoveU is a wearable vestibular stimulation device for providing proprioceptive haptic feedback in virtual reality (VR). The device ...

Bird: a 3D Cursor for 3D Interaction in Virtual Reality

Bird is a hand-controlled pointing system that translates a user's finger movements and positions into the motion of a 3D pointer in a vi...

Designing robots in mixed reality

This is a joint proposal from graduate students Vik Parthiban (Media Lab) and Andrew Spielberg (MIT CSAIL, Distributed Robotics Laborator...

Archived

World Changing Ideas 2019: All the winners, finalists, and honorable mentions

AttentivU and AlterEgo received honorable mentions in the Experimental category.

Archived

Research

Advancing Wellbeing

Q&A with Nataliya Kos’myna

Nataliya Kos’myna is a Post-Doctoral Fellow in the MIT Media Lab, helping MITili evaluate the real-time biofeedback of learners

Tangible influence: A stroll through Hiroshi Ishii’s living legacy

Celebrating Hiroshi Ishii's mentorship and groundbreaking research

Augmented reality changing the factory landscape from PTC's room with a view

Valentin Heun describes his work with the PTC Reality Lab to transform factory operations by using augmented reality.

Watch this device translate silent thoughts into speech

For people who can’t speak out loud due to illness or injury, AlterEgo might return their ability to communicate in real time.

Could plants be the future of interface design?

Core77 reports on the Fluid Interfaces group’s work in cyborg botany.

Elowan: A plant-robot hybrid

Elowan is a cybernetic lifeform, a plant in direct dialogue with a machine. Using its own internal electrical signals, the plant is inter...

Cyborg Botany: Augmented plants as sensors, displays, and actuators

Plants can sense the environment, other living entities and regenerate, actuate or grow in response. Our interaction and communicati...

EMMA: An emotionally intelligent personal assistant for improving wellbeing

The delivery of mental health interventions via ubiquitous devices has shown a lot of promise. A natural conversational interface that al...

Experiential Lighting: New user interfaces for lighting control

The vision of pervasive computing is now mainstream. These connected devices permeate every aspect of our lives. Yet, we remain tethered ...

HeartBit

HeartBit is an interface designed for haptic heart rate biofeedback. A handheld heart beats alongside your own, mirroring the size, weigh...

Archived

News Graph

This project aims to show a different picture of the data behind the news, looking at how we analyze, represent, and interact with it.&nb...

Archived

Conversational Characters: AI agents for entertainment

We want to create immersive, personalized, and scalable digital experiences. In order to do that, we need to fundamentally rethink the wa...

Inside Professor Nanayakkara’s futuristic Augmented Human Lab

What can seamless human-computer interfaces do for humanity?

reMi: Translating Ambient Sounds of Moment into Tangible and Shareable Memories through Animated Paper

Kyung Yun Choi, Darle Shinsato, Shane Zhang, Ken Nakagaki, and Hiroshi Ishii. 2018. reMi: Translating Ambient Sounds of Moment into Tangible and Shareable Memories through Animated Paper. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings (UIST '18 Adjunct). ACM, New York, NY, USA, 84-86. DOI: https://doi.org/10.1145/3266037.3266109

Archived

reMi

Translating ambient sounds of moment into tangible and shareable memories through animated paperWe present a tangible memory notebook—reM...

Archived

Thesis Research

Talking Machines: Democratizing the Design of Voice-Based Agents for the Home

Learning to dance in VR

Virtual reality can help realize mediated social experiences where we interact as richly with those around the world as we do with those ...

The Leafy Green Cyborgs Are Coming

While plants at first glance look like static things, they are in fact very busy transmitting bio-electrochemical signals.

PhysioHMD: a conformable, modular toolkit for collecting physiological data from head-mounted displays

Bernal, Guillermo, et al. "PhysioHMD: a conformable, modular toolkit for collecting physiological data from head-mounted displays." Proceedings of the 2018 ACM International Symposium on Wearable Computers. ACM, 2018.

A calm house is a smart house

Receptive Skins envisions a living building that silently interacts with air and temperature

EmotionalBeasts

With advances in virtual reality (VR) and physiological sensing technology, even more immersive computer-mediated communication through l...

Emotional Beasts: Visually Expressing Emotions through Avatars in VR

Bernal, Guillermo, and Pattie Maes. "Emotional Beasts: Visually Expressing Emotions through Avatars in VR." Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2017.

Archived

A-pops

A design project done in collaboration with the MIT Media Lab and the Laboratorio para la Ciudad (Laboratory for the City), Mexico City's...

Archived

RFind: Extreme localization for billions of items

Presenting RFind, a new technology that allows us to locate almost any object with extreme accuracy by transforming low-cost, battery-fre...

Archived

Panorama

An interface for smashing filter bubbles, Panorama is built to allow open, transparent, and collaborative exploration of news from a...

Archived

CityMatrix

An Urban Decision-Support System Augmented by Artificial IntelligenceThe decision-making process in urban design and urban planning is ou...

Apops: Pilot Installation, Mexico City, December 2017

APOPS was presented at the Connected Learning Summit at the MIT Media Lab in Aug 2018. The slides from that presentation can be found below.

Archived

Reality Editor 2.0

The Reality Editor is a web browser for the physical world: Point your phone or tablet at a physical object and an interface pops up with...

Archived

LuminAR

LuminAR reinvents the traditional incandescent bulb and desk lamp, evolving them into a new category of robotic, digital information devi...

Archived

Research

Living Mobile

Enhancing mobile life through improved user interactions

Archived

WordSense

As more powerful and spatially aware Augmented Reality devices become available, we can leverage the user’s context to embed reality with...

Archived

Talking Machines: Democratizing the design of voice-based agents for the home

Embodied voice-based agents, such as Amazon’s Echo, Google Home, and Jibo, are becoming increasingly present in the home environment. For...

FingerReader selected for a Golden Pin Concept Design Award

FingerReader, a wearable interface that uses audio and haptic feedback to enhance the reading experience, was selected for a 2017 Go...

Receptive Skins: The Breathing Wall

In architecture, the building skin is the primary interface for mediating the environment of the external with the internal. But today, t...

Creativity and collaboration: Revisiting Cybernetic Serendipity

Creativity and Collaboration: Revisiting Cybernetic Serendipity, set out to underline the close connections between art and technology.

Archived

Memento

Memento is a home-based reminder system that allows users to associate customized voice reminders with specific activities in their daily...

Archived

Mission Wildlife

Mission Wildlife is a research collaboration between San Diego Zoo Global and the MIT Center for Civic Media to explore the pot...

Archived

Personalized Interaction for Language Learning

The process by which children learn native languages is markedly different from the process of learning a second, or non-native, language...

Human microchipping is here, and it’s about to rock your skin’s world

“A few years ago, I was flipping through a fashion magazine and saw that Beyoncé had these cool metallic temporary tattoos."

Archived