LocationLe Laboratoire Cambridge DescriptionVOCAL VIBRATIONS is Le Laboratoire Cambridge's exciting opening exhibition. Composer and invent…
LocationLe Laboratoire, Paris DescriptionVocal Vibrations, an original installation and design, invites the public to discover the relation…
Expressive Performance for Body-Mind WellbeingThe Vocal Vibrations music is now available for exclusive download from Bowers & Wilkins.…
« Vocal Vibrations » is an installation which invites the public to discover the relationship between sound vibrations stimulated by voice …
Holbrow, C., Jessop, E., Kleinberger R. NIME’14, June 30 – July 03, 2014, Goldsmiths, University of London, UK
Hum, and sound buzzes through your lips. Sing, and it vibrates through your head and body.Sing at “Vocal Vibrations,” the musical installat…
Former Research Assistant
Former Postdoctoral Associate
Nattinger, E. J. "The Body Parametric: Abstraction of Vocal and Physical Expression in Performance"
Yan, W., Noel, G., Loke, G., Meiklejohn, E., Khiduyev, T., Marion, J., Rui, G., Lin, J., Cherston, J., Saharasbudhe, A., Wilbert, J., Wicaksono, I., Hoyt, R.W., Missakian, A., Zhu, L., Ma, C., Joannopoulos, J., and Fink, Y. Single fibre enables acoustic fabrics via nanometre-scale vibrations. Nature (2022). https://doi.org/10.1038/s41586-022-04476-9
Jessop, E.
A.P. Pentland, J. Williams
The ability to display and perceive emotion is a key component in intelligent behavior. Emotion helps to guide both human and animal behavi…
Narain, J.*, Johnson, K.T.*, Ferguson, C., O’Brien, A., Talkar, T., Zhang, Y., Wofford, P., Quatieri, T., Picard, R.W.,Maes, P., "Personalized Modeling of Real-World Vocalizations from Nonverbal Individuals," Proceedings of the International Conference on Multimodal Interaction (ICMI), Utrecht, Netherlands, October 2020. (*Co-first authors/Equal contribution)
LocationMIT Media Lab, E14-493 DescriptionComputational behavioral science is making significant efforts in analysis and understanding of n…
The Vocal Augmentation and Manipulation Prosthesis (VAMP) is a gesture-based, wearable controller for live-time vocal performance. This con…
Narain, J., Johnson, K., Quatieri, T., Picard, R., and Maes, P. “Transfer Learning with Real-World Vocalizations from Minimally Speaking Individuals”. Workshop in Interpretable ML in Healthcare at International Conference on Machine Learning. July 2021.
Despite many studies of marine mammal vocalizations, there is no generally accepted theory of sound production by whales or dolphins, and o…
Narain, J.*, Johnson, K.T.*, O’Brien, A., Wofford, P., Maes, P., Picard, R.W. "Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism," Proceedings of the Workshop on Laughter and Other Nonverbal Vocalisations, Bielefeld, Germany, October 2020. (*Co-first authors/Equal contribution)
Vikrant Soman, Anmol Madan
The close relationship between touch, gesture, and sound plays a critical role in expressive musical performance. Many acoustic instruments…
“A Counting,” an art project from the Poetic Justice group, invites people to call in and count to 100 in their native language.
Former Visiting Scientist
Some links to accompany a talk on “Possible Futures for Music and Medicine.”
Muriel R. Cooper Professor of Music and Media; Academic Head, Program in Media Arts and Sciences
Professor Emeritus
Former Research Assistant
Most art galleries have a “look, don’t touch” policy, maintaining the barrier between exhibit and observer, but not the new installation at…
In contributing to the digital revolution, the Media Lab helped fuel a society where increasing numbers of people are obese, sedentary, and…
The Opera of the Future group (formerly known as Hyperinstruments) explores concepts and techniques to help advance the future of musical c…
Congratulations, Arnav!
Addae received the award for VocalCords, which was developed as part of his master's thesis at the Media Lab.
Nataliya Kosmyna, Pattie Maes. AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning. Sensors 2019, 19, 5200.
Interested in learning more about the Commalla project? Fill out this form!
Inspired by the human ear, a new acoustic fabric converts audible sounds into electrical signals.
This work is recently submitted as a Full Paper to ACM CHI 2023.Corsetto is a full stack system design and platform for upper-body haptics…
The Music, Mind and Machine group is working towards bridging the gap between the current generation of audio technologies and those that w…
Johnson, K.T.* & Narain, J.*, Maes, P., Picard, R.W., "Augmenting Natural Communication in Nonverbal Individuals with Autism," International Society for Autism Research (INSAR), Seattle, Washington, May 2020. (*Co-first authors/equal contribution)
Vocal Connection: Rethinking the voice as a medium for personal, interpersonal, and interspecies understanding
The themes and concerns of Death and the Powers seem even more relevant and resonant than when the opera premiered a decade ago.
This project is a collaboration between the MIT Media Lab and the San Diego Zoo to design and build interactive sonic enrichment systems fo…
Underwater sonar signals cause vibrations that can be decoded by an airborne receiver
Alum Rébecca Kleinberger discusses her work at the intersection of new technology, animal-computer interaction, and the sonic environment.
In Tense Dimensions is the premiere live performance of VocalCords, a stretch-sensor based voice controller/processor I have been deve…
The Synthetic Characters group works to create creatures whose behavior, form, and underlying architecture not only inform our understandin…
Prior research with preschool children has established that book reading, especially when children are encouraged to actively process the s…
RF-SCG is a new system that can capture seismocardiogram (SCG) recordings without requiring any contact with the human body. Such an u…
What if wearable and implantable devices could harvest energy from the heat, sweat or vibrations of the wearer?
Char Stiles debuted "Fastest Integer Multiplier" at Amant Gallery's "For Your Reference." This performance used a custom tool CARL&nbs…
"It's straight out of the pages of science fiction: a 'wearable' book, which uses temperature controls and lighting to mimic the experience…
By Po-Hao ChiHow could microgravity/hypergravity shape our perceptual experience of listening with weightlessness? How can we seek to explo…
People express and communicate their mental states—such as emotions, thoughts, and desires—through facial expressions, vocal nuances, gestu…
Alex 'Sandy' Pentland, Jared Curhan, J. Khilnani, M. Martin, N. Eagle, R.Caneel, A. Madan
C. Breazeal
Narain, J.*, Johnson, K.T.*, Picard, R.W., Maes, P. "Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data," NeurIPS Workshop on AI for Social Good, December 2019. (*Co-first authors/Equal contribution)
S. Srinivasan, S., M. Herr, H. A cutaneous mechanoneural interface for neuroprosthetic feedback. Nat Biomed Eng (2021). https://doi.org/10.1038/s41551-020-00669-7
Low-cost, modular, open source, and portable bio-reactor for urban bio-sensor development.
"The Weirdest Thing I Learned This Week" dives into research by alum Rébecca Kleinberger showing that parrots seem to enjoy video chats.
C. Breazeal
C. Breazeal