Research
Camera Culture

Making the invisible visible–inside our bodies, around us, and beyond–for health, work, and connection
Research
Fluid Interfaces

Designing Systems for Cognitive Support
Research
Poetic Justice

Exploring new forms of social justice through art
Research
City Science

Looking beyond smart cities
Project Research

Dormio: Interfacing with Dreams

InspirationSleep is a forgotten country of the mind. A vast majority of our technologies are built for our waking state, even though a thir…
Research
Space Exploration Initiative

Space Exploration Initiative
Research
Media Lab Research Theme: Connected Mind + Body

Connected Mind + Body | Revolutionizing the future of mental and physical wellbeing
Research
Media Lab Research Theme: Cultivating Creativity

Cultivating Creativity | Catalyzing a global movement enabling everyone to unlock and unleash their individual and collective creativity
Research
Media Lab Research Theme: Life with AI

Life with AI | Designing the future of smart systems to improve the human experience
Research
Media Lab Research Theme: Future Worlds

Future Worlds | Design and action for the future we want to live in
Project Research

Theme | CityScope

City Science researchers are developing a slew of tangible and digital platforms dedicated to solving spatial design and urban planning cha…
Project Research

Detecting and Mapping Transparent or Mirror-like Surfaces with Lidar

Although lidar is widely used for mapping the 3D geometry of surfaces, the technology has historically been challenged by specular, or mirr…
Project Research

Theme | Learning + Creativity

Several of our projects aim to support learning and creativity. While some systems focus on a specific skill to be strengthened, e.g.,…
Archived
Project Research

Bounce-Flash Lidar

In photography, illuminating a subject directly using an on-camera flash can result in unflattering photos. To avoid this, photographers o…
Archived
Project Research

Wemoji

This project was produced as part of the   2021 Snap Creative Challenge, focused on "The Future of Co-located Social AR."Wem…
Publication Research

"Picture the Audience...": Exploring Private AR Face Filters for Online Public Speaking

Joanne Leong, Florian Perteneder, Muhender Raj Rajvee, and Pattie Maes. 2023. “Picture the Audience...”: Exploring Private AR Face Filters for Online Public Speaking. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 13 pages. https://doi.org/10.1145/3544548.3581039
Archived
Project Research

"Picture the Audience" Exploring Private AR Face Filters for Online Public Speaking

This work will be presented  at the upcoming ACM CHI 2023 conference. By Joanne Leong, Florian Perteneder, Muhender Raj Rajv…
Archived
Project Research

Augmented Reality with X-Ray Vision

X-AR is an augmented reality (AR) system that gives humans "X-Ray Vision" X-AR is a new AR headset that enables users to see things th…
Project Research

Deep Reinforcement Learning for Autonomous UAVs (AUAVs)

Many tasks are not easily defined and/or too complex for supervised machine learning approaches. For these reasons, a technique known as&nb…
Project Research

Domain Randomization & Synthetic Data Generation for AUAVs - Reducing Perceptual Uncertainty of Sim2Real Navigation

Navigation for autonomous UAVS (unmanned aerial vehicles) is a complex problem and physical field testing of associated tasks introduces a …
Project Research

Unmanned Aerial Vehicle (UAV) Pilot Simulator

With the advent of real-time photorealism (RTPR), virtual environments are now able to achieve higher degrees of engagement than ever befor…
Research
Signal Kinetics

Inventing, building, and deploying wireless sensor technologies to address complex problems in society, industry, and ecology
Research
Viral Communications

People and intelligent machines in a creative, symbiotic loop
Article Research

Virtual reality system lets you stop and smell the roses

Media Lab alum Judith Amores talks to Scientific American about a lightweight, wireless interface to deliver scents to VR users.
Research
MIT Center for Constructive Communication

MIT Center for Constructive Communication
Research
Responsive Environments

Augmenting and mediating human experience, interaction, and perception with sensor networks
Article Research

New research from the Signal Kinetics research group is featured on "Science Without the Gobbledygook"

Physicist Sabine Hossenfelder discusses X-AR, the new research from the Media Lab’s Signal Kinetics group.
Article Research

MIT researchers develop augmented reality headset to help users see hidden objects

Using augmented reality, the X-AR system developed by the Signal Kinetics research group can guide users to find hidden objects.
Project Research

AttentivU

There are currently  UROP openings for this project. AttentivU is  a  device, in the  form factor of a pair of gla…
Project Research

City Science Lab @ Hamburg

MIT City Science is working with HafenCity University to develop CityScope for the neighborhood of Rothenburgsort in Hamburg, Germany. The …
Research
Tangible Media

Invent new tangible and embodied interactions that inspire and engage people
Research
Personal Robots

Building intelligent personified technologies that collaborate with people to help them learn, thrive, and flourish.
Post Research

Hope Schroeder and collaborators receive CHI 2023 Best Case Study award

Congratulations to Hope Schroeder and collaborators on receiving the single Best Case Study award at CHI'23.
Archived
Project Research

Essence Wearables: Biometric Olfactory Interfaces for Day and Night

Human-computer interaction (HCI) has traditionally focused on designing and investigating interfaces that provide explicit visual, auditory…
Archived
Publication Research

Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality

Joanne Leong, Olivia Seow, Cathy Mengying Fang, Benny J. Tang, Rajan Vaish, and Pattie Maes. 2022. Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality. In The Adjunct Publication of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22 Adjunct), October 29-November 2, 2022, Bend, OR, USA. ACM, New York, NY, USA, 3 pages.
Thesis Research

Investigating the Use of Synthetic Media and Real-Time Virtual Camera Filters for Supporting Communication and Creativity

Leong, Joanne. Investigating the Use of Synthetic Media and Real-Time Virtual Camera Filters for Supporting Communication and Creativity. 2021. Massachusetts Institute of Technology, MS Thesis.
Publication Research

Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity

Leong, Joanne, et al. "Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity." Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 2021.
Project Research

Synthetic Self-Perception

Perceptual illusions have the power to change our abilities and behaviours. Prior research in virtual reality (VR) has shown that transport…
Research
Beyond the Cradle

Beyond the Cradle
Article Research

Augmented reality headset enables users to see hidden objects

The device could help workers locate objects for fulfilling e-commerce orders or identify parts for assembling products.
Article Research

Assistive tech gains at CES in Las Vegas

Spinoff Xander, founded by alum Alex Westner, provides real-time captions to help users with hearing loss follow in-person conversations.
Post Research

Spinoff Xander raises $1.4 million in pre-seed funding

Xander plans to launch its first product, XanderGlasses, designed for people with hearing loss or auditory processing challenges.
Research
Future Sketches

Exploring the essence of code as a creative medium
Article Research

The One Earth Model: Geographic interoperability in the real-world metaverse

Michael Naimark considers the potential of the "real-world metaverse," which combines virtual experiences with specific physical places.
Post Research

Media Lab spinoff Xander honored at CES 2023

Co-founded by Media Lab alum Alex Westner, Xander will introduce its first product, XanderGlasses, at CES 2023.
Archived
Project Research

Using Shadows to See Behind Objects

The full text of our paper is available here.Sometimes the thing that we want to see is hidden behind something else. A neighboring vehicl…
Archived
Archived
Project Research

TangiBel Soundscapes

Words are fleeting. Moments come and go, and what we vocalize “disappears into thin air."In this project, TangiBel Soundscapes, we propose …
Archived
Project Research

SensorNets

SensorNets: Towards Reconfigurable Multifunctional Fine-grained  Soft and Stretchable Electronic Skins.SensorNets is a bioin…
Archived
Project Research

PsychicVR: Increasing mindfulness by using Virtual Reality and Brain Computer Interfaces

We present PsychicVR, a proof-of-concept system that integrates a brain-computer interface device and virtual reality headset to improve mi…
Archived
Archived
Project Research

ZoomADay - AI Synthesized Characters

#ZoomADay was a year long project exploring the creation and use of synthetic characters and deep fakes for use in online telepresence and …
Archived
Archived
Research
Open Ocean

Open Ocean
Archived
Research
Object-Based Media

Changing storytelling, communication, and everyday life through sensing, understanding, and new interface technologies
Archived
Project Research

ARTextiles: Promoting Social Interactions Around Personal Interests

Abstract data visualizations for enhancing social interactions through clothing and augmented reality.
Archived
Archived
Project Research

Inertia

Inertia is a platform for exploring physical interactions between real active agents and virtual elements in an augmented reality environme…
Archived
Post Research

Hacking Reality

XR technology is becoming increasingly important in a world where the need to know intersects with the need to experience.
Article Research

A guide to cyberarts: From bots to glitch, an annotated glossary for an age of augmented reality

Check out this list of cyberart projects compiled by The Boston Globe, which includes work by alum Alexander Reben and Prof. Ekene Ijeoma.
Project Research

Living Observatory: Sensor networks for documenting and experiencing ecology

Living Observatory is an initiative for documenting and interpreting ecological change that will allow people, individually and collectivel…
Project Research

Physiophone: Electrophysiology Sonification

The human body produces a variety of different electrophysiological signals from brain-waves (EEG) to the electrical activity of the heart …
Project Research

E-maki: XR-enabled Scroll for Interactive Museum Artifacts

E-maki is a collection of ancient, painted scrolls accompanied by a cross-reality app that give contextual information and interactive expe…
Article Research

ACM ByteCast: Ramesh Raskar

Camera Culture head Ramesh Raskar talks to Rashmi Mohan about his interdisciplinary research and entrepreneurial endeavors.
Project Research

Andorra | Dynamic Urban Planning

View the main City Science Andorra project profile.Research in dynamic tools, mix users (citizens, workers) amenities, services, and land u…
Project Research

Deep Reality: An underwater VR experience to promote relaxation by unconscious HR, EDA, and brain activity biofeedback

We present an interactive virtual reality (VR) experience that uses biometric information for reflection and relaxation. We monit…
Publication Research

Imaging Behind Occluders Using Two-Bounce Light

Henley, C., Maeda, T., Swedish, T., & Raskar, R. (2020). Imaging Behind Occluders Using Two-Bounce Light. Computer Vision – ECCV 2020 Lecture Notes in Computer Science, 573-588. doi:10.1007/978-3-030-58526-6_34
Article Research

Bringing the benefits of in-person collaboration to the virtual world

The startup Spatial uses an augmented reality platform to make people feel like they’re working side by side.
Project Research

Modeling Auditory Memory

When we form memories, not everything that we perceive is noticed; not everything that we notice is remembered. Humans are excellent at f…
Archived
Project Research

Funnel Vision

MotivationThe need for inexpensive, reliable, 3D, 360-degree display technologies grows as augmented reality applications continue to incre…
Archived
Archived
Project Research

Virtual Regalia

COVID-19 and virtual commencements around the world were not what many universities had planned for the graduating class of 2020. Walking a…
Archived
Archived
Project Research

Micronauts

Microbes are the foundation upon which life on Earth depends: they set the boundaries of habitability for all plants and animals and create…
Archived
Archived
Project Research

LUI: Large User Interface with Gesture and Voice Feedback

LUI is a scalable, multimodal web-interface that uses a custom framework of nondiscrete, free-handed gestures and voice to control modular …
Archived
Archived
Project Research

Connected Coral

Connected Coral integrates physical and digital elements in a visualization of the environmental impacts on reefs. This complex projection …
Archived