• Search Search
  • User Login
  • Nav Nav
Search
Work for a Member company and need a Member Portal account? Register here with your company email address. Work for a Member company and forgot your password?
  • News + Updates
  • Research
  • About
  • Graduate Program
  • People
  • Events
  • Videos
  • Member Portal
We are an interdisciplinary research lab working to invent the future of
  • art

  • health

  • artificial intelligence

  • human-machine interaction

  • learning

  • robotics

  • design

  • technology

  • architecture

  • consumer electronics

  • kids

  • music

  • wearable computing

  • human-computer interaction

  • data

  • politics

  • bioengineering

  • networks

  • entertainment

  • machine learning

  • sensors

  • economy

  • cognition

  • social science

  • environment

  • history

  • space

  • archives

  • storytelling

  • wellbeing

  • interfaces

  • computer science

  • covid19

  • prosthetics

  • engineering

  • developing countries

  • ethics

  • civic technology

  • biology

  • privacy

  • social robotics

  • alumni

  • public health

  • social media

  • communications

  • augmented reality

  • creativity

  • civic media

  • urban planning

  • imaging

  • synthetic biology

  • industry

  • community

  • computer vision

  • virtual reality

  • neurobiology

  • affective computing

  • energy

  • biomechanics

  • biotechnology

  • transportation

  • food

  • government

  • data visualization

  • social change

  • data science

  • startup

  • ocean

  • zero gravity

  • social networks

  • materials

  • blockchain

  • medicine

  • genetics

  • manufacturing

  • prosthetic design

  • 3d printing

  • climate change

  • agriculture

  • racial justice

  • gaming

  • banking and finance

  • fabrication

  • women

  • behavioral science

  • construction

  • diversity

  • fashion

  • cryptocurrency

  • electrical engineering

  • cognitive science

  • security

  • systems

  • bionics

  • neural interfacing and control

  • performance

  • open source

  • crowdsourcing

  • marginalized communities

  • microfabrication

  • civic action

  • microbiology

  • ecology

  • internet of things

  • collective intelligence

  • human augmentation

  • makers

  • extended intelligence

  • wiesner

  • autonomous vehicles

  • language learning

  • natural language processing

  • perception

  • interactive

  • nonverbal behavior

  • mapping

  • physics

  • visualization

  • mechanical engineering

  • physiology

  • nanoscience

  • chemistry

  • primary healthcare

  • water

  • clinical science

  • holography

  • long-term interaction

  • gesture interface

  • sports and fitness

  • rfid

  • networking

  • trust

  • point of care

  • voice

  • mechatronics

  • orthotic design

  • soft-tissue biomechanics

  • event

  • hacking

  • autism research

  • member company

  • pharmaceuticals

  • open access

  • clinical trials

  • assistive technology

  • code

  • trade

  • biomedical imaging

  • exhibit

  • academia

  • member event

  • real estate

  • gender studies

  • publishing

  • randomized experiment

  • gis

  • metamaterials

  • cartography

  • installation

  • Groups
  • Projects
  • Publications
  • Centers
  • Initiatives
More Close
Research
Camera Culture

Making the invisible visible–inside our bodies, around us, and beyond–for health, work, and connection

#computer vision #human-computer interaction #artificial intelligence +41 more
Accepting Applicants
Publication Research

"Picture the Audience...": Exploring Private AR Face Filters for Online Public Speaking

Joanne Leong, Florian Perteneder, Muhender Raj Rajvee, and Pattie Maes. 2023. “Picture the Audience...”: Exploring Private AR Face Filters for Online Public Speaking. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 13 pages. https://doi.org/10.1145/3544548.3581039

Academic Paper, March 2023
in Fluid Interfaces
#augmented reality
Project Research

Theme | Communication + Collaboration

Communication skills are critical for all. We  design and develop systems to help people with communication issues, e.g., more empathi…

in Fluid Interfaces · Affective Computing
Pattie Maes · Utkarsh Sarawgi +3 more
#design #human-computer interaction #artificial intelligence +7 more
Project Research

Theme | Learning + Creativity

Several of our projects aim to support learning and creativity. While some systems focus on a specific skill to be strengthened, e.g.,…

in Fluid Interfaces
Pattie Maes
#human-computer interaction #artificial intelligence #augmented reality +5 more
Archived
Project Research

Essence Wearables: Biometric Olfactory Interfaces for Day and Night

Human-computer interaction (HCI) has traditionally focused on designing and investigating interfaces that provide explicit visual, auditory…

in Fluid Interfaces
Judith Amores Fernandez
#design #virtual reality #human-computer interaction +18 more
Archived
Publication Research

Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality

Joanne Leong, Olivia Seow, Cathy Mengying Fang, Benny J. Tang, Rajan Vaish, and Pattie Maes. 2022. Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality. In The Adjunct Publication of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22 Adjunct), October 29-November 2, 2022, Bend, OR, USA. ACM, New York, NY, USA, 3 pages.

Poster, Oct. 2022
in Fluid Interfaces
#augmented reality #communications
Thesis Research

Investigating the Use of Synthetic Media and Real-Time Virtual Camera Filters for Supporting Communication and Creativity

Leong, Joanne. Investigating the Use of Synthetic Media and Real-Time Virtual Camera Filters for Supporting Communication and Creativity. 2021. Massachusetts Institute of Technology, MS Thesis.

Thesis, Feb. 2021
in Fluid Interfaces
#human-computer interaction #artificial intelligence #augmented reality +2 more
Publication Research

Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity

Leong, Joanne, et al. "Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity." Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 2021.

Proceedings, May 2021
in Fluid Interfaces
#human-computer interaction #augmented reality #cognition +2 more
Project Research

"Picture the Audience" Exploring Private AR Face Filters for Online Public Speaking

This work will be presented  at the upcoming ACM CHI 2023 conference. By Joanne Leong, Florian Perteneder, Muhender Raj Rajv…

in Fluid Interfaces
Joanne Leong · Pattie Maes
#human-computer interaction #augmented reality #perception
Project Research

Synthetic Self-Perception

Perceptual illusions have the power to change our abilities and behaviours. Prior research in virtual reality (VR) has shown that transport…

in Fluid Interfaces
Joanne Leong · Pat Pataranutaporn +1 more
#human-computer interaction #artificial intelligence #augmented reality +5 more
Research
Beyond the Cradle

Beyond the Cradle

#robotics #design #architecture +10 more
Research
Responsive Environments

Augmenting and mediating human experience, interaction, and perception with sensor networks

#robotics #design #virtual reality +66 more
Accepting Applicants
Research
Viral Communications

People and intelligent machines in a creative, symbiotic loop

#design #virtual reality #computer vision +43 more
Accepting Applicants
Project Research

Augmented Reality with X-Ray Vision

X-AR is an augmented reality (AR) system that gives humans "X-Ray Vision" X-AR is a new AR headset that enables users to see things th…

in Signal Kinetics
Tara Boroushaki · Maisy Lam +3 more
#virtual reality #computer vision #augmented reality +4 more
Article Research

Augmented reality headset enables users to see hidden objects

The device could help workers locate objects for fulfilling e-commerce orders or identify parts for assembling products.

via MIT News · Feb. 27, 2023
in Signal Kinetics
#virtual reality #computer vision #augmented reality +3 more
Project Research

AttentivU

There are currently  UROP openings for this project. AttentivU is  a  device, in the  form factor of a pair of gla…

in Fluid Interfaces
Nataliya Kos'myna · Pattie Maes
#human-computer interaction #augmented reality #health +8 more
Article Research

Assistive tech gains at CES in Las Vegas

Spinoff Xander, founded by alum Alex Westner, provides real-time captions to help users with hearing loss follow in-person conversations.

via Wall Street Journal · Jan. 6, 2023
in Media Lab Spinoffs
#design #augmented reality #technology +1 more
Research
Space Exploration Initiative

Space Exploration Initiative

#robotics #design #virtual reality +68 more
Post Research

Spinoff Xander raises $1.4 million in pre-seed funding

Xander plans to launch its first product, XanderGlasses, designed for people with hearing loss or auditory processing challenges.

Jan. 30, 2023
in Object-Based Media · Media Lab Spinoffs
#augmented reality #health
Research
City Science

Looking beyond smart cities

#robotics #design #social networks +67 more
Accepting Applicants
Research
Signal Kinetics

Inventing, building, and deploying wireless sensor technologies to address complex problems in society, industry, and ecology

#robotics #virtual reality #computer vision +26 more
Accepting Applicants
Research
Poetic Justice

Exploring new forms of social justice through art

#robotics #design #architecture +30 more
Accepting Applicants
Research
Future Sketches

Exploring the essence of code as a creative medium

#design #computer vision #art +16 more
Accepting Applicants
Article Research

The One Earth Model: Geographic interoperability in the real-world metaverse

Michael Naimark considers the potential of the "real-world metaverse," which combines virtual experiences with specific physical places.

via Medium · Dec. 9, 2022
in Viral Communications
#design #virtual reality #augmented reality +3 more
Post Research

Media Lab spinoff Xander honored at CES 2023

Co-founded by Media Lab alum Alex Westner, Xander will introduce its first product, XanderGlasses, at CES 2023.

Jan. 3, 2023
in Object-Based Media · Media Lab Spinoffs
#augmented reality #health
Research
Tangible Media

Seamlessly coupling the worlds of bits and atoms by giving dynamic physical form to digital information and computation

#robotics #design #virtual reality +59 more
Accepting Applicants
Project Research

Using Shadows to See Behind Objects

The full text of our paper is available here.Sometimes the thing that we want to see is hidden behind something else. A neighboring vehicl…

in Camera Culture
Connor Henley · Tomohiro Maeda +2 more
#computer vision #artificial intelligence #augmented reality +2 more
Project Research

Wemoji

This project was produced as part of the   2021 Snap Creative Challenge, focused on "The Future of Co-located Social AR."Wem…

in Fluid Interfaces
Joanne Leong · Pattie Maes +1 more
#human-computer interaction #augmented reality #communications
Archived
Project Research

TangiBel Soundscapes

Words are fleeting. Moments come and go, and what we vocalize “disappears into thin air."In this project, TangiBel Soundscapes, we propose …

in Fluid Interfaces · Future Sketches
Joanne Leong · Mengying Fang +2 more
#augmented reality #communications
Archived
Research
Personal Robots

Building intelligent personified technologies that collaborate with people to help them learn, thrive, and flourish.

#robotics #design #virtual reality +66 more
Accepting Applicants
Project Research

SensorNets

SensorNets: Towards Reconfigurable Multifunctional Fine-grained  Soft and Stretchable Electronic Skins.SensorNets is a bioin…

in Responsive Environments
Irmandy Wicaksono · Elena Kodama +2 more
#design #human-computer interaction #architecture +10 more
Archived
Project Research

PsychicVR: Increasing mindfulness by using Virtual Reality and Brain Computer Interfaces

We present PsychicVR, a proof-of-concept system that integrates a brain-computer interface device and virtual reality headset to improve mi…

in Advancing Wellbeing · Fluid Interfaces
Xavier Benavides Palos · Pattie Maes +2 more
#augmented reality #health #technology
Archived
Archived
Project Research

ZoomADay - AI Synthesized Characters

#ZoomADay was a year long project exploring the creation and use of synthetic characters and deep fakes for use in online telepresence and …

Daniel Novy
#computer vision #human-computer interaction #augmented reality +1 more
Archived
Archived
Research
Open Ocean

Open Ocean

#robotics #virtual reality #art +32 more
Archived
Research
Object-Based Media

Changing storytelling, communication, and everyday life through sensing, understanding, and new interface technologies

#robotics #design #virtual reality +52 more
Not Accepting Applicants
Archived
Project Research

ARTextiles: Promoting Social Interactions Around Personal Interests

Abstract data visualizations for enhancing social interactions through clothing and augmented reality.

in Living Mobile
Chris Schmandt · Anna Fuste
#augmented reality #data #fashion +2 more
Archived
Archived
Project Research

Inertia

Inertia is a platform for exploring physical interactions between real active agents and virtual elements in an augmented reality environme…

in Living Mobile
Anna Fuste
#augmented reality #learning
Archived
Archived
Project Research

Bounce-Flash Lidar

In photography, illuminating a subject directly using an on-camera flash can result in unflattering photos. To avoid this, photographers o…

in Camera Culture
Connor Henley
#robotics #computer vision #augmented reality +1 more
Archived
Project Research

Unmanned Aerial Vehicle (UAV) Pilot Simulator

With the advent of real-time photorealism (RTPR), virtual environments are now able to achieve higher degrees of engagement than ever befor…

in Personal Robots
Stephen Kaputsos
#robotics #virtual reality #artificial intelligence +1 more
Project Research

Domain Randomization & Synthetic Data Generation for AUAVs - Reducing Perceptual Uncertainty of Sim2Real Navigation

Navigation for autonomous UAVS (unmanned aerial vehicles) is a complex problem and physical field testing of associated tasks introduces a …

in Personal Robots
Stephen Kaputsos
#robotics #virtual reality #computer vision +2 more
Project Research

Deep Reinforcement Learning for Autonomous UAVs (AUAVs)

Many tasks are not easily defined and/or too complex for supervised machine learning approaches. For these reasons, a technique known as&nb…

in Personal Robots
Stephen Kaputsos
#robotics #virtual reality #computer vision +2 more
Post Research

Hacking Reality

XR technology is becoming increasingly important in a world where the need to know intersects with the need to experience.

March 25, 2020
in Responsive Environments · Personal Robots · Fluid Interfaces
#virtual reality #augmented reality #hacking
Article Research

A guide to cyberarts: From bots to glitch, an annotated glossary for an age of augmented reality

Check out this list of cyberart projects compiled by The Boston Globe, which includes work by alum Alexander Reben and Prof. Ekene Ijeoma.

via The Boston Globe · Jan. 27, 2022
in Responsive Environments · Poetic Justice
#robotics #art #artificial intelligence +4 more
Project Research

Living Observatory: Sensor networks for documenting and experiencing ecology

Living Observatory is an initiative for documenting and interpreting ecological change that will allow people, individually and collectivel…

in Terrestrial Sensing · Responsive Environments
Glorianna Davenport · Joseph A. Paradiso +4 more
#virtual reality #augmented reality #data +6 more
Project Research

Dormio: Interfacing with Dreams

InspirationSleep is a forgotten country of the mind. A vast majority of our technologies are built for our waking state, even though a thir…

in Civic Media · Fluid Interfaces · Personal Robots
Eyal Perry · Adam Haar Horowitz +5 more
#human-computer interaction #art #artificial intelligence +16 more
Project Research

Physiophone: Electrophysiology Sonification

The human body produces a variety of different electrophysiological signals from brain-waves (EEG) to the electrical activity of the heart …

in Fluid Interfaces
Neo (Mostafa) Mohsenvand
#human-computer interaction #artificial intelligence #augmented reality +4 more
Project Research

E-maki: XR-enabled Scroll for Interactive Museum Artifacts

E-maki is a collection of ancient, painted scrolls accompanied by a cross-reality app that give contextual information and interactive expe…

in Responsive Environments
Irmandy Wicaksono
#design #virtual reality #art +3 more
Project Research

City Science Lab @ Hamburg

MIT City Science is working with HafenCity University to develop CityScope for the neighborhood of Rothenburgsort in Hamburg, Germany. The …

in City Science
Kent Larson · Margaret Church +3 more
#computer vision #augmented reality #civic technology +3 more
Article Research

ACM ByteCast: Ramesh Raskar

Camera Culture head Ramesh Raskar talks to Rashmi Mohan about his interdisciplinary research and entrepreneurial endeavors.

via ACM ByteCast · March 22, 2021
in Camera Culture
#computer vision #augmented reality #sensors +3 more
Project Research

Andorra | Dynamic Urban Planning

View the main City Science Andorra project profile.Research in dynamic tools, mix users (citizens, workers) amenities, services, and land u…

in City Science
Arnaud Grignard · Luis Alberto Alonso Pastor +8 more
#computer vision #augmented reality #data +4 more
Project Research

Deep Reality: An underwater VR experience to promote relaxation by unconscious HR, EDA, and brain activity biofeedback

We present an interactive virtual reality (VR) experience that uses biometric information for reflection and relaxation. We monit…

in Fluid Interfaces
Judith Amores Fernandez · Anna Fuste +1 more
#virtual reality #human-computer interaction #augmented reality
Publication Research

Imaging Behind Occluders Using Two-Bounce Light

Henley, C., Maeda, T., Swedish, T., & Raskar, R. (2020). Imaging Behind Occluders Using Two-Bounce Light. Computer Vision – ECCV 2020 Lecture Notes in Computer Science, 573-588. doi:10.1007/978-3-030-58526-6_34

Proceedings, Oct. 2020
in Camera Culture
#computer vision #augmented reality
Article Research

Bringing the benefits of in-person collaboration to the virtual world

The startup Spatial uses an augmented reality platform to make people feel like they’re working side by side.

via MIT News · July 10, 2020
in Tangible Media
#virtual reality #augmented reality #technology +3 more
Project Research

Modeling Auditory Memory

When we form memories, not everything that we perceive is noticed; not everything that we notice is remembered. Humans are excellent at f…

in Responsive Environments
Ishwarya Ananthabhotla · David Ramsay
#artificial intelligence #augmented reality #cognition +4 more
Archived
Project Research

Funnel Vision

MotivationThe need for inexpensive, reliable, 3D, 360-degree display technologies grows as augmented reality applications continue to incre…

in Object-Based Media
Emily Salvador
#art #augmented reality #entertainment
Archived
Archived
Project Research

Virtual Regalia

COVID-19 and virtual commencements around the world were not what many universities had planned for the graduating class of 2020. Walking a…

in Object-Based Media
Daniel Novy
#augmented reality
Archived
Project Research

Theme | CityScope

City Science researchers are developing a slew of tangible and digital platforms dedicated to solving spatial design and urban planning cha…

in City Science
Markus Elkatsha · Kent Larson +7 more
#design #computer vision #human-computer interaction +20 more
Archived
Project Research

Micronauts

Microbes are the foundation upon which life on Earth depends: they set the boundaries of habitability for all plants and animals and create…

in Open Ocean · Object-Based Media
Caroline Rozendo
#art #augmented reality #environment +3 more
Archived
Archived
Project Research

LUI: Large User Interface with Gesture and Voice Feedback

LUI is a scalable, multimodal web-interface that uses a custom framework of nondiscrete, free-handed gestures and voice to control modular …

in Object-Based Media
Vik Parth
#virtual reality #human-computer interaction #augmented reality +3 more
Archived
Archived
Project Research

Connected Coral

Connected Coral integrates physical and digital elements in a visualization of the environmental impacts on reefs. This complex projection …

in Object-Based Media · Open Ocean
Katy Croff Bell · Emily Salvador +1 more
#art #augmented reality #interfaces +1 more
Archived
Project Research

AR Enhanced Wall Plants: Escape Pod

An environment of plants and mirrors that extends beyond the terrarium walls. 

in City Science
Alex Berke
#agriculture #architecture #augmented reality +1 more
Project Research

Taking a line on a walk

Bauhaus artist Paul Klee considered a line to be  one of the atomic elements of art and architecture. He famously described a line dra…

in Opera of the Future
Charles Holbrow
#augmented reality
Project Research

Designing robots in mixed reality

This is a joint proposal from graduate students Vik Parthiban (Media Lab) and Andrew Spielberg (MIT CSAIL, Distributed Robotics Laboratory)…

in Object-Based Media
Vik Parth
#robotics #design #human-computer interaction +3 more
Archived
Project Research

Holographic Glasses for Augmented Reality

For my "How to Make Almost Anything" [HTMAA] class,  I attempted to build holographic glasses for augmented reality. These glasses wou…

in Object-Based Media
Vik Parth
#augmented reality #holography
Archived
Article Research

Touchless gesture controls on phones? Think bigger

Vik Parthiban and other AR/VR researchers talk to Wired about the future potential of gesture control for interaction design.

via Wired · Aug. 12, 2019
in Object-Based Media
#augmented reality #technology #gesture interface
Publication Research

Experimental characterization of leaky-mode spatial light modulators fabricated via direct laser writing

Sundeep Jolly, Bianca Datta, Vik Parthiban, Daniel Smalley, and V. Michael Bove Jr. "Experimental characterization of leaky-mode spatial light modulators fabricated via direct laser writing", Proc. SPIE 10944, Practical Holography XXXIII: Displays, Materials, and Applications, 109440V (1 March 2019); https://doi.org/10.1117/12.2510174

Academic Paper, March 2019
in Object-Based Media
#augmented reality #holography
Publication Research

Experimental demonstration of precise holograms using complex light modulation

Vik Parthiban, Rudolph N. Kohn Jr., Jinyang Liang, and Michael F. Becker "Experimental demonstration of precise holograms using complex light modulation", Proc. SPIE 9761, Emerging Digital Micromirror Device Based Systems and Applications VIII, 97610M (15 March 2016); https://doi.org/10.1117/12.2208316

Proceedings, March 2016
in Object-Based Media
#augmented reality #holography
Article Research

Siggraph 2019 offers a sneak peek into what’s next for AR, VR, and CG

Held this week at the Los Angeles Convention Center, Siggraph 2019 is all about the future of 2D and 3D digital worlds.

via VentureBeat · July 30, 2019
in Fluid Interfaces
#virtual reality #augmented reality
Article Research

Augmented reality changing the factory landscape from PTC's room with a view

Valentin Heun describes his work with the PTC Reality Lab to transform factory operations by using augmented reality.

via Forbes · June 25, 2019
in Fluid Interfaces
#augmented reality #interfaces #fabrication
Archived
Project Research

Living Observatory Installation: A Transductive Encounter with Ecology

In the Living Observatory installation at the Other Festival, we invite participants into a transductive encounter with a wetland environme…

in Responsive Environments
Joseph A. Paradiso · Brian Mayton +1 more
#virtual reality #augmented reality #ecology +2 more
Archived
More

  • News + Updates
  • Research
  • About
  • Graduate Program
  • People
  • Events
  • Videos
  • Member Portal

More ways to explore

  • Videos
  • Publications
  • Job Opportunities
  • Contact

Massachusetts Institute of Technology
School of Architecture + Planning

Accessibility
Donate to the Lab