{{{gallery_title}}}

FedML: A Research Library and Benchmark for Federated Machine Learning

In this work, we introduce FedML, an open research library and benchmark that facilitates the development of new 'federated learning algori…

Frisson

Interoceptive Technologies: Inducing emotions from the body upInspirationThere’s a feeling that comes tingling down the spine in certain mo…

dementAI

dementAI is an open-source platform for modeling risk stratification of Alzheimer's dementia using spontaneous speech through a …

Archived

SeqCLR: Self-supervised learning of features for time-series data

Interpreting human electroencephalogram (EEG) is a challenging task and requires years of medical training. We present a framework for lear…

Archived

DAMS: Differentially Private Sketching Data Structures

We propose an improved private count-mean-sketch data structure and show its applicability to differentially private contact trac…

Wearable Sanitizer: Open-source, On-body Sanitizer

Regular disinfection of hands and frequently touched surfaces is a critical factor in preventing the spread of infectious diseases and diso…

On-Face Olfactory Interfaces

We envision that a close-to-nose interface could be used as a complementary or alternative wearable method to nasal cannulas or masks,…

The Best Inventions of 2020 | A New Kind of Interface: MIT Media Lab AlterEgo

Congrats to Fluid Interfaces PhD student Arnav Kapur and collaborators on the selection of AlterEgo by ⁦Time Magazine for this recognition.

Low-latency tracking of multiple permanent magnets

C. R. Taylor, H. G. Abramson, and H. M. Herr, “Low-Latency Tracking of Multiple Permanent Magnets,” IEEE Sensors Journal, pp. 1–11, 2019.

ORBIT (Olfactory Response Baseline Identification Test)

I am currently developing a new approach in conducting sensory examinations via the Olfactory Response Baseline Identification Test (O.R.B.…

Archived

Research

Synthetic Neurobiology

Revealing insights into the human condition and repairing brain disorders via novel tools for mapping and fixing brain computations

Archived

reSpire: Self-awareness and Interpersonal Connectedness through Shape-changing Fabric Display

We present an interactive shape-changing display—Dancing Membrane of the reSpire- using the deformation of fabric and airflow control…

Archived

DIVE

DIVE is a web-based data exploration system that lets non-technical users create stories from their data without writing code. DIVE co…

Archived

Q+A with Pattie Maes, MIT Professor of Media Technology

The MIT Integrated Learning Initiative (MITili) talks to Fluid Interfaces head Pattie Maes

Living Bits

Living Bits : Opportunities and Challenges for Integrating Living Microorganisms in Human-Computer InteractionThere are trillions of living…

Archived

The Telemetron Orchestra

When contemplating the future of life in space, we dream not only of rockets and off-world societies, but also of art, of leisure, and freq…

Archived

Gamma SENSE: Sensory Engaging Nebulised Scent Experience

The Gamma SENSE (Sensory Engaging Nebulised Scent Experience) is a pioneering instrumental addition to the gamma instrument series. The dev…

Archived

TRANS-DOCK

In the research realm of shape changing interfaces in human-computer interaction, a variety of pin-based shape display designs have been pr…

Archived

Programmable Synthetic Hallucinations

We are creating consumer-grade appliances and authoring methodologies that will allow hallucinatory phenomena to be programmed and utilized…

Archived

Pillow-Talk

Pillow-Talk is a set of connected objects intended to assist in the capture and recall digitally stored dreams and memories via natural and…

Archived

Venous Materials : Towards Interactive Fluidic Mechanisms

Mor, Hila, Ken Nakagaki, et al. "Venous Materials : Towards Interactive Fluidic Mechanisms." CHI '20, Honolulu, HI, USA, April 2020. DOI: https://doi.org/10.1145/3313831.3376129

Byte.it

Discreet Teeth Gestures for Mobile Device InteractionByte.it is a miniaturized, discreet interface that uses teeth gestures for hands-free …

Archived

PerForm

PerForm explores the intuitive meanings associated with the shape of objects, and how a deformable tool can allow for interaction based on …

Archived

Wearable Wisdom

Wearable Wisdom: An Intelligent Audio-Based System for Mediating Wisdom and AdviceHaving good mentors and role models is important for pers…

Post Research

Jamming to Knitting, Music to Machines: Bringing interdisciplinary research to the manufacturing ecosystem

Here's my take on the future of textiles, as well as the connection between research and manufacturing.

ETH Zurich at the WEF – RETHINKING Creativity

KnittedKeyboard at ETH Rethinking Creativity Pavilion

Archived

PopBots: An early childhood AI curriculum

How can we add the missing "T" and "E" in preschool STEAM education?

Archived

Marauder's Map

"I solemnly swear that I am up to no good."The Marauder's Map from the Harry Potter universe uses UltraWide Band transmitters and receiver …

Archived

Byte.it: Discreet Teeth Gestures for Mobile Device Interaction

Tomás Vega Gálvez, Shardul Sapkota, Alexandru Dancu, Pattie Maes, CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI’19 Extended Abstracts), May 4–9, 2019, Glasgow, Scotland UK, ACM, New York, NY, USA, 6 pages, https://doi.org/10.1145/3290607.3312925

A holographic meeting platform for collaborating from anywhere

"There's got to be a better way to share space and work together remotely—but computers or phones may not be the right tools."

Archived

Connected Coral

Connected Coral integrates physical and digital elements in a visualization of the environmental impacts on reefs. This complex projection …

Archived

Cilllia: 3D-printed micro pillar structures for surface texture, actuation, and sensing

In nature, hair has numerous functions such as providing warmth, adhesion, locomotion, sensing, and a sense of touch, as well as its well-k…

RGBox

The RGBox is an experimental game to teach fundamentals of additive color mixing theory. As opposed to the behavior of pigments that g…

Essence: Olfactory Interfaces for Unconscious Influence of Mood and Cognitive Performance

Judith Amores and Pattie Maes. 2017. Essence: Olfactory Interfaces for Unconscious Influence of Mood and Cognitive Performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '17). ACM, Denver, CO, USA. DOI: http://dx.doi.org/10.1145/3025453.3026004

MoveU

MoveU is a wearable vestibular stimulation device for providing proprioceptive haptic feedback in virtual reality (VR). The device in…

Designing robots in mixed reality

This is a joint proposal from graduate students Vik Parthiban (Media Lab) and Andrew Spielberg (MIT CSAIL, Distributed Robotics Laboratory)…

Archived

World Changing Ideas 2019: All the winners, finalists, and honorable mentions

AttentivU and AlterEgo received honorable mentions in the Experimental category.

Archived

Research

Advancing Wellbeing

Q&A with Nataliya Kos’myna

Nataliya Kos’myna is a Post-Doctoral Fellow in the MIT Media Lab, helping MITili evaluate the real-time biofeedback of learners

Post Research

Tangible influence: A stroll through Hiroshi Ishii’s living legacy

Celebrating Hiroshi Ishii's mentorship and groundbreaking research

Augmented reality changing the factory landscape from PTC's room with a view

Valentin Heun describes his work with the PTC Reality Lab to transform factory operations by using augmented reality.

Watch this device translate silent thoughts into speech

For people who can’t speak out loud due to illness or injury, AlterEgo might return their ability to communicate in real time.

Could plants be the future of interface design?

Core77 reports on the Fluid Interfaces group’s work in cyborg botany.

Elowan: A plant-robot hybrid

Elowan is a cybernetic lifeform, a plant in direct dialogue with a machine. Using its own internal electrical signals, the plant is interfa…

Cyborg Botany: Augmented plants as sensors, displays, and actuators

Plants can sense the environment, other living entities and regenerate, actuate or grow in response. Our interaction and communication…

Experiential Lighting: New user interfaces for lighting control

The vision of pervasive computing is now mainstream. These connected devices permeate every aspect of our lives. Yet, we remain tethered to…

HeartBit

HeartBit is an interface designed for haptic heart rate biofeedback. A handheld heart beats alongside your own, mirroring the size, weight,…

Archived

News Graph

This project aims to show a different picture of the data behind the news, looking at how we analyze, represent, and interact with it. …

Archived

Inside Professor Nanayakkara’s futuristic Augmented Human Lab

What can seamless human-computer interfaces do for humanity?

reMi: Translating Ambient Sounds of Moment into Tangible and Shareable Memories through Animated Paper

Kyung Yun Choi, Darle Shinsato, Shane Zhang, Ken Nakagaki, and Hiroshi Ishii. 2018. reMi: Translating Ambient Sounds of Moment into Tangible and Shareable Memories through Animated Paper. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings (UIST '18 Adjunct). ACM, New York, NY, USA, 84-86. DOI: https://doi.org/10.1145/3266037.3266109

Archived

reMi

Translating ambient sounds of moment into tangible and shareable memories through animated paperWe present a tangible memory notebook—reMi—…

Archived

Thesis Research

Talking Machines: Democratizing the Design of Voice-Based Agents for the Home

Learning to dance in VR

Virtual reality can help realize mediated social experiences where we interact as richly with those around the world as we do with those in…

The Leafy Green Cyborgs Are Coming

While plants at first glance look like static things, they are in fact very busy transmitting bio-electrochemical signals.

PhysioHMD: a conformable, modular toolkit for collecting physiological data from head-mounted displays

Bernal, Guillermo, et al. "PhysioHMD: a conformable, modular toolkit for collecting physiological data from head-mounted displays." Proceedings of the 2018 ACM International Symposium on Wearable Computers. ACM, 2018.

Post Research

A calm house is a smart house

Receptive Skins envisions a living building that silently interacts with air and temperature

Emotional Beasts: Visually Expressing Emotions through Avatars in VR

Bernal, Guillermo, and Pattie Maes. "Emotional Beasts: Visually Expressing Emotions through Avatars in VR." Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2017.

Archived

A-pops

A design project done in collaboration with the MIT Media Lab and the Laboratorio para la Ciudad (Laboratory for the City), Mexico City's e…

Archived