• Search Search
  • User Login
  • Nav Nav
Search
Work for a Member company and need a Member Portal account? Register here with your company email address. Work for a Member company and forgot your password?
  • News + Updates
  • Research
  • About
  • Support the Media Lab
  • Graduate Program
  • People
  • Events
  • Videos
  • Member Portal
We are an interdisciplinary research lab working to invent the future of
  • art

  • health

  • artificial intelligence

  • human-machine interaction

  • learning + teaching

  • robotics

  • design

  • technology

  • architecture

  • consumer electronics

  • kids

  • music

  • human-computer interaction

  • wearable computing

  • politics

  • bioengineering

  • data

  • networks

  • machine learning

  • sensors

  • entertainment

  • social science

  • cognition

  • economy

  • environment

  • space

  • wellbeing

  • history

  • storytelling

  • computer science

  • interfaces

  • covid19

  • ethics

  • prosthetics

  • engineering

  • developing countries

  • creativity

  • alumni

  • civic technology

  • biology

  • privacy

  • social robotics

  • community

  • social media

  • communications

  • neurobiology

  • computer vision

  • public health

  • urban planning

  • augmented reality

  • imaging

  • virtual reality

  • synthetic biology

  • industry

  • biotechnology

  • food

  • transportation

  • biomechanics

  • affective computing

  • energy

  • government

  • data visualization

  • social change

  • startup

  • social networks

  • ocean

  • zero gravity

  • fabrication

  • data science

  • behavioral science

  • medicine

  • women

  • climate change

  • blockchain

  • agriculture

  • cognitive science

  • prosthetic design

  • materials

  • manufacturing

  • genetics

  • 3d printing

  • racial justice

  • neural interfacing and control

  • diversity

  • fashion

  • gaming

  • banking and finance

  • cryptocurrency

  • electrical engineering

  • construction

  • performance

  • bionics

  • ecology

  • civic action

  • security

  • human augmentation

  • systems

  • open source

  • marginalized communities

  • microfabrication

  • autonomous vehicles

  • internet of things

  • natural language processing

  • collective intelligence

  • healthcare

  • mechanical engineering

  • perception

  • microbiology

  • interactive

  • language learning

  • visualization

  • voice

  • water

  • nonverbal behavior

  • mapping

  • sustainability

  • physiology

  • rfid

  • social justice

  • physics

  • nanoscience

  • code

  • chemistry

  • clinical science

  • long-term interaction

  • orthotic design

  • algorithms

  • cities

  • networking

  • trust

  • open access

  • sports and fitness

  • mechatronics

  • soft-tissue biomechanics

  • biomedical imaging

  • hacking

  • autism research

  • member company

  • pharmaceuticals

  • assistive technology

  • mental health

  • law

  • textiles

  • internet

  • exhibit

  • real estate

  • culture

  • gender studies

  • wireless

  • news

  • science

  • cells

  • business

  • decision-making

  • asl

  • Groups
  • Projects
  • Publications
  • Centers
  • Initiatives
  • Research Themes
More Close
Project Research

Tapis Magique: A Choreomusical Interactive Carpet

Ancient textiles have played a major role in the social, economic, and religious structures of communities around the world. Iconic, indige…

in Responsive Environments
Irmandy Wicaksono · Don Derek Haddad
#design #human-computer interaction #architecture +15 more
Project Research

KnittedKeyboard II

Spanning from the early Musical Telegraph and Electronic Sackbut, to the late EMS Synthi AKS and Moog Synthesizers, electronic music and mu…

in Responsive Environments
Irmandy Wicaksono · Mike Hao Jiang +1 more
#design #human-computer interaction #architecture +13 more
Archived
Project Research

BrainBeat: Breath-based music therapy

Can we sonfiy calming breathing and passively influence a state of calm?Deep breathing has been scientifically proven to affect the heart, …

in Affective Computing
Asma Ghandeharioun · Grace Leslie +1 more
#human-machine interaction #music #affective computing
Archived
Project Research

Modulating peripheral and cortical arousal using a musical motor response task

We are conducting EEG studies to identify the musical features and musical interaction patterns that universally impact measures of arousal…

in Affective Computing
Rosalind W. Picard · Grace Leslie
#human-machine interaction #music #affective computing
Archived
Project Research

An EEG and motion-capture based expressive music interface for affective neurofeedback

This project examines how the expression granted by new musical interfaces can be harnessed to create positive changes in health and wellbe…

in Affective Computing
Rosalind W. Picard · Grace Leslie
#human-machine interaction #music #affective computing
Archived
Project Research

With(in)

With(in) is a multi-stage project that includes an exhibit, installation, qualitative exploration, and visual storytelling.This is a s…

in City Science
Margaret Church · Gabriela Bila Advincula +6 more
#design #architecture #art +5 more
Archived
Project Research

KnittedKeyboard

In this work, we have developed  a textile-based interactive surface fabricated through machine knitting technology. Our prototype exp…

in Responsive Environments
Irmandy Wicaksono · Joseph A. Paradiso
#design #human-computer interaction #consumer electronics +9 more
Archived
Post Research

Xiao Xiao wins second place in the 2022 Guthman Musical Instrument Competition

For the project T-Voks: The Singing and Speaking Theremin. Congratulations!

March 25, 2022
in Object-Based Media · Opera of the Future · Tangible Media
#art #music #creativity +2 more
Project Research

MM-RT

MM-RT is a tabletop tangible musical interface that employs electromagnetic actuators and small permanent magnets to physically induce soun…

in Opera of the Future
Akito Oshiro van Troyer
#art #music #creativity +2 more
Archived
Project Research

Breathing Garment: A respiratory regulation garment for voice pedagogy

Using OmniFiber technology, we fabricated a type of undergarment that singers can wear to monitor and play back the movement of respiratory…

in Tangible Media
Ozgun Kilic Afsar · Hiroshi Ishii
#robotics #design #human-computer interaction +6 more
Archived
Post Research

Tapis Magique nominated for SXSW Innovation Awards 2022 in two categories

Developed in collaboration with dancer Loni Landon, Tapis Magique is a pressure-sensitive, knitted electronic textile carpet.

Jan. 26, 2022
in Responsive Environments
#design #human-computer interaction #art +4 more
Article Research

Q&A: Dolapo Adedokun on computer technology, Ireland, and all that jazz

MIT EECS student and Mitchell Scholar hopes to play music in Dublin while working on his MS in intelligent systems.

via MIT News · Jan. 11, 2022
in Media Lab Spinoffs
#entertainment #music #computer science +2 more
Article Research

Gramophone reviews Tod Machover's Death and the Powers

Gramophone contributor Laurence Vittes spotlights Tod Machover’s “Death and the Powers,” an opera about robots and humans.

via Gramophone · Jan. 3, 2022
in Opera of the Future
#robotics #music #technology
Article Research

Harmonix keeps innovating, with lasting impact

The MIT spinout has been releasing iconic video games for more than 25 years.

via MIT News · Dec. 14, 2021
in Opera of the Future · Media Lab Spinoffs
#entertainment #gaming #music +4 more
Article Research

Scientists and musicians tackle climate change together

Discussion at MIT explores ways the music industry can help in the battle to reduce global greenhouse gas emissions.

via MIT News · Dec. 1, 2021
in Director's Office
#art #environment #music +2 more
Post Research

Xiao Xiao named as a semifinalist in the 2022 Guthman Musical Instrument Competition

Xiao Xiao, an alum and research affiliate of the Tangible Media group, recognized for her project T-Voks: The Singing and Speaking Theremin

Nov. 29, 2021
in Tangible Media
#art #music #creativity +2 more
Article Research

RadioWest 20th Anniversary: The Human Voice

Opera of the Future alum Rébecca Kleinberger discusses the human voice—how our voices affect our identities, how we hear ourselves, etc.

via RadioWest · Nov. 11, 2021
in Opera of the Future
#music #alumni #voice
How buildings and cities can become more intelligently responsive to the needs and desires of their inhabitants.
#robotics #architecture #art +19 more
Not Accepting Applicants
Archived
Project Research

Tree Clocks: an interactive rhythm and language work

By Chelsi Cocking and Manaswi MishraCode Cypher, hosted by CAST Visiting Artist and Grammy-winning rapper Lupe Fiasco and Pr…

in Future Sketches · Opera of the Future
Chelsi Cocking · Manaswi Mishra
#art #music #computer science +2 more
Article Research

Industry Talk | Tapis Magique: a choreomusical interactive carpet

Pressure-sensitive, knitted electronic textile carpet generates 3D sensor data based on body gestures, drives an immersive sonic environment

via Knitting Industry · Nov. 8, 2021
in Responsive Environments
#design #human-computer interaction #consumer electronics +7 more
Publication Research

Image2Reverb: Cross-Modal Reverb Impulse Response Synthesis

Image2Reverb: Cross-Modal Reverb Impulse Response Synthesis. Nikhil Singh, Jeff Mentch, Jerry Ng, Matthew Beveridge, Iddo Drori; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 286-295

Academic Paper, Oct. 2021
in Opera of the Future
#computer vision #music #machine learning
Article Research

Robotic Textiles in Action: OmniFiber

AZoM talks to Ozgun Kilic Afsar, a visiting doctoral student in the Tangible Media group, about her work on the OmniFiber project.

via AZoM · Nov. 2, 2021
in Tangible Media
#robotics #design #health +3 more
Article Research

Epi/20: Fluid Music | Mutating Music with MIT Media Lab’s Charles Holbrow

Alum Charles Holbrow talks about his work and shares his views on the past, present, and future of music and technology.

via Beatseeker Podcast · Oct. 29, 2021
in Opera of the Future
#environment #music #computer science +2 more
Article Research

New fibers can make breath-regulating garments

Robotic textiles could help performers and athletes train their breathing, and potentially help patients recovering from postsurgery changes

via MIT News · Oct. 15, 2021
in Tangible Media
#robotics #design #health +3 more
Archived
Project Research

superpose - A connected experience of sound and space

The superpose installation mediates continuously changing wave phenomena within a space that are visible, audible, and react to the presenc…

in Opera of the Future
Karsten Schuhl
#design #architecture #art +1 more
Archived
Archived
Project Research

Gravity Proof: Speculating Cosmic Futures

Gravity Proof is a performance and mission to prepare and cook bread in space. Inspired by ancient recipes and archaeological bread re…

in Space Exploration Initiative
Maggie Coblentz
#robotics #architecture #art +12 more
Archived
Article Research

Ekene Ijeoma on ‘Trying to Portray Hidden Things’

Professor Ijeoma, spoke with Evan Moffitt from Frieze about his recent group exhibition at Bemis Center for Contemporary Arts, Omaha.

via Frieze · Sept. 20, 2021
in Poetic Justice
#design #art #data +2 more
Project Research

Tune Field

Novel Antenna-Based Controller for Musical ExpressionTune Field is a 3-dimensional tangible interface that combines and alters previously e…

Guadalupe Babio Fernandez
#design #human-computer interaction #art +3 more
Project Research

Death and the Powers: Redefining Opera

Death and the Powers is a groundbreaking opera that brings a variety of technological, conceptual, and aesthetic innovations to the th…

in Opera of the Future
Tod Machover · Akito Oshiro van Troyer +4 more
#multimodal representation #performance technologies #digital opera +22 more
Publication Research

Disembodied Performance

Peter Alexander Torpey and Elena Naomi Jessop. 2009. Disembodied performance. CHI '09 Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 3685–3690. DOI:https://doi.org/10.1145/1520340.1520555

Academic Paper
in Opera of the Future
#music #sensors #performance
Article Research

Robot opera and how tech affects your love life

via Sky News | Swipe · June 22, 2017
in Opera of the Future
#robotics #music
Article Research

Dallas Opera's Simulcast: Tod Machover's Death and the Powers

There is a subtle air of complicity amongst the music-loving audience.

via LOFT · Jan. 18, 2017
in Opera of the Future
#music
Project Research

Bio-Digital Wearables or Space Health Enhancement

Living in space could have significant physical and mental impacts on astronauts. Wearables have the potential to play a critical role in m…

in Fluid Interfaces · Space Exploration Initiative
Pat Pataranutaporn · M.S. Suryateja Jammalamadaka +3 more
#robotics #architecture #art +12 more
Article Research

Life in space: Preparing for an increasingly tangible reality

The Space Exploration Initiative supports research across and beyond MIT in two microgravity flights this spring.

via MIT News · July 28, 2021
in Opera of the Future · Responsive Environments · Fluid Interfaces +2 more
#robotics #architecture #art +12 more
Publication Research

FabricKeyboard: Multimodal Textile Sensate Media as an Expressive and Deformable Musical Interface

Wicaksono, I and Paradiso, J.A."FabricKeyboard: Multimodal Textile Sensate Media as an Expressive and Deformable Musical Interface
", New Interfaces for Musical Expression (NIME) May 15-19, 2017. Aalborg University Copenhagen, Denmark.

Academic Paper, May 2017
in Responsive Environments
#design #music #sensors +1 more
Archived
Project Research

FabricKeyboard

Multimodal textile sensate media as an expressive and deformable musical interfaceIn the area of intelligent textiles, we are exploring a m…

in Responsive Environments
Joseph A. Paradiso · Irmandy Wicaksono
#design #fashion #music +2 more
Archived
Article Research

Kronos releases five more free string quartet scores

Explore five new releases from the Kronos Quartet’s Fifty for the Future collection, including Tod Machover’s GAMMIFIED

via Kronos Quartet · Feb. 17, 2021
in Opera of the Future
#music
Article Research

Tod Machover: GAMMIFIED

Gammified includes stereo electronics that play continuously throughout the piece, with the start of each of the five tracks marked in score

via Kronos Quartet · Jan. 1, 2021
in Opera of the Future
#music
Article Research

Transforming quantum computing’s promise into practice

Electrical engineer William Oliver develops technology to enable reliable quantum computing at scale.

via MIT News · Jan. 19, 2021
in Opera of the Future
#music #computer science #alumni
Archived
Research
Synthetic Neurobiology

Revealing insights into the human condition and repairing brain disorders via novel tools for mapping and fixing brain computations

#art #artificial intelligence #bioengineering +25 more
Not Accepting Applicants
Archived
Project Research

The universal decay of collective memory and attention

Collective memory and attention are sustained by two channels: oral communication (communicative memory) and the physical recording of info…

in Collective Learning
Cristian Esteban Candia Vallejos · Cesar A. Hidalgo +1 more
#art #communications #entertainment +5 more
Archived
Archived
Project Research

Pantheon

What if we could look at the entire history of humanity at once? Pantheon aims to create a data-driven view of history by collecting, …

in Collective Learning
Cesar A. Hidalgo · Kevin Zeng Hu +2 more
#art #communications #data +5 more
Archived
Archived
Research
New Media Medicine

How radical new collaborations will catalyze a revolution in health.

#robotics #architecture #art +20 more
Not Accepting Applicants
Archived
Project Research

The Telemetron Orchestra

When contemplating the future of life in space, we dream not only of rockets and off-world societies, but also of art, of leisure, and freq…

in Space Exploration Initiative
Thomas Sanchez Lengeling · Nicole L'Huillier +1 more
#design #music #interfaces +3 more
Archived
Project Research

Cognition-Driven Audio Summarization

As we move towards an increasingly IoT-enabled ecosystem, we find that it is easier than ever before to capture vast amounts of audio data.…

in Responsive Environments
Ishwarya Ananthabhotla · David Ramsay
#artificial intelligence #music #technology
Project Research

Scratch

Scratch is the world's most popular coding community for kids. Millions of kids around the world are using Scratch to program their ow…

in Lifelong Kindergarten
Mitchel Resnick · Natalie Rusk +30 more
#robotics #design #art +15 more
Project Research

SoundSignaling

Drawing inspiration from the notion of cognitive incongruence associated with Stroop's famous experiment, from musical principles, and from…

in Responsive Environments
Ishwarya Ananthabhotla
#human-computer interaction #environment #music
Project Research

Modeling Auditory Memory

When we form memories, not everything that we perceive is noticed; not everything that we notice is remembered. Humans are excellent at f…

in Responsive Environments
Ishwarya Ananthabhotla · David Ramsay
#artificial intelligence #augmented reality #cognition +4 more
Archived
Project Research

LeakyPhones

LeakyPhones is a public/private headset that was designed to encourage face-to-face interactions, curiosity, and healthier s…

in Tangible Media · Fluid Interfaces
Amos Golan · Hiroshi Ishii +1 more
#design #communications #music +3 more
Archived
Archived
Project Research

PerForm

PerForm explores the intuitive meanings associated with the shape of objects, and how a deformable tool can allow for interaction based on …

in Object-Based Media
Caroline Rozendo · Irmandy Wicaksono +1 more
#design #human-computer interaction #music +2 more
Archived
Post Research

Tales from Virtuality – Research under quarantine at the MIT Media Lab

Joe Paradiso shares his experience running the Responsive Environments group, teaching classes, among other things during the Covid-19 era.

May 18, 2020
in Responsive Environments
#human-computer interaction #learning + teaching #music +3 more
Project Research

Mediated Atmosphere

The Mediated Atmosphere project envisions a smart office that is capable of dynamically transforming itself to enhance occupants' work expe…

in Responsive Environments
Joseph A. Paradiso · Nan Zhao +2 more
#human-computer interaction #architecture #health +8 more
Project Research

DoppelLab: Experiencing multimodal sensor data

Homes and offices are being filled with sensor networks to answer specific queries and solve pre-determined problems, but no comprehensive …

Joseph A. Paradiso · Brian Mayton +1 more
#human-computer interaction #learning + teaching #music +3 more
Project Research

Soundscape Resynthesis

Sound and space are fundamentally intertwined, at both a physical and perceptual level. Sound radiates from vibrating materials, filling …

in Responsive Environments
Spencer Russell
#robotics #design #environment +8 more
Archived
Post Research

Meet the 2020 LEGO Papert Fellows

The new LEGO Papert Fellows will spend one week at LEGO headquarters in Denmark to share ideas and collaborate on projects.

April 22, 2020
in Lifelong Kindergarten · Opera of the Future · Fluid Interfaces
#artificial intelligence #kids #learning + teaching +5 more
How to build characters that have the everyday common sense, the ability to learn, and the sense of empathy that one finds in animals such a
#robotics #architecture #art +13 more
Not Accepting Applicants
Archived
Digital Life
#robotics #human-computer interaction #architecture +26 more
Archived
Post Research

Jamming to Knitting, Music to Machines: Bringing interdisciplinary research to the manufacturing ecosystem

Here's my take on the future of textiles, as well as the connection between research and manufacturing.

April 13, 2020
in Responsive Environments
#design #human-computer interaction #consumer electronics +7 more
Article Research

ETH Zurich at the WEF – RETHINKING Creativity

KnittedKeyboard at ETH Rethinking Creativity Pavilion

via ETH Zurich · Jan. 24, 2020
in Responsive Environments
#design #human-computer interaction #consumer electronics +5 more
Post Research

Composer's Remarks: ....but not simpler...

By Tod MachoverFor the past five years or so, I’ve been working on some wild and unusual operas (the last one featured robots—or “Operabots…

Oct. 21, 2016
in Opera of the Future
#robotics #music #performance
Article Research

I performed at the super bowl. You might have missed me.

Director's fellow Christine Sun Kim expresses her pride and frustration at signing the National Anthem at the Super Bowl.

via The New York Times · Feb. 3, 2020
in Director's Fellows Program
#art #music #sports and fitness +1 more
Article Research

Christine Sun Kim, the transgressive deaf artist, will sign the national anthem alongside Demi Lovato during the Super Bowl

Kim explains why she accepted the opportunity to perform during one of America’s most-watched events and what it means to the Deaf community

via Artnet News · Jan. 28, 2020
in Director's Fellows Program
#music #sports and fitness
Article Research

Joe Paradiso in the podcast

He built one of the largest modular synthesizers in the world: Joe Paradiso is in the new episode of our podcast.

via ETH Zurich · Jan. 22, 2020
in Responsive Environments
#music #technology
Project Research

Sonic Murals

Giving voice and information to objects and spaces around us.Objects in our lives are usually either digital or not; mostly a wall is just …

in Opera of the Future
Alexandra Rieger
#music #sensors
Post Research

Evergreen Blues receives Honorable Mention for Best Student Game @ 2020 Independent Games Festival

A previous collaboration between Su and Star, Seasons (季节), also received an Honorable Mention for Best Student Game at the 2019 IGF.

Jan. 13, 2020
in Opera of the Future
#music
Article Research

Chance the Rapper enlists Chicago students to code "I Love You So Much" video game

SuperMe features superheroes designed by Chicago Public School students

via Rolling Stone · Dec. 10, 2019
in Lifelong Kindergarten
#entertainment #learning + teaching #music +1 more
Thesis Research

Massively Multiplayer Operas: Interactive Systems for Collaborative Musical Narrative

Su, D. (2019). Massively Multiplayer Operas: Interactive Systems for Collaborative Musical Narrative. Massachusetts Institute of Technology.

Thesis, June 2019
in Opera of the Future
#human-computer interaction #gaming #music +1 more
Publication Research

AMAI: Adaptive Music for Affect Improvement

Su, D., Picard, R., Liu, Y. "AMAI: Adaptive Music for Affect Improvement." Proceedings of the 44th International Computer Music Conference (ICMC), Daegu, Korea, August 2018.

Proceedings, Aug. 2018
in Opera of the Future
#music #affective computing
More

  • News + Updates
  • Research
  • About
  • Support the Media Lab
  • Graduate Program
  • People
  • Events
  • Videos
  • Member Portal

More ways to explore

  • Videos
  • Publications
  • Job Opportunities
  • Contact

Massachusetts Institute of Technology
School of Architecture + Planning

Accessibility
Donate to the Lab