Designing systems for cognitive enhancement

MIT Media Lab / Fluid Interfaces

Publication

AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning

Nataliya Kosmyna, Pattie Maes. AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning. Sensors 2019, 19, 5200.

Publication

Paper Dreams: Real-Time Human and Machine Collaboration for Visual Story Development

Bernal, Guillermo, Lily Zhou, Erica Yuen, and Pattie Maes. “Paper Dreams: Real-Time Human and Machine Collaboration for Visual Story Development.” XXII Generative Art Conference - GA2019, December 21, 2019.

Publication

Paper Dreams: An Interactive Interface for Generative Visual Expression

Bernal, Guillermo, Lily Zhou, Haripriya Mehta, and Pattie Maes. NeurIPS Workshop on Machine Learning for Creativity and Design, December 14, 2019.

Publication

Enhancing human emotions with interoceptive technologies delivering controlled somatosensory stimulation

Felix Schoeller, Adam Haar Horowitz, Abhinandan Jain, Pattie Maes. Physics of Life Reviews. 2019

Publication

Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data

Narain, J*., Johnson, K*., Picard, R., and Maes, P. “Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data”. NeurIPS 2019 Joint Workshop on AI for Social Good. Accepted. *Equal Contribution.

Publication

AttentivU: Designing EEG and EOG Compatible Glasses for Physiological Sensing and Feedback in the Car

Nataliya Kosmyna, Caitlin Morris, Thanh Nguyen, Sebastian Zepf, Javier Hernandez, and Pattie Maes. 2019. AttentivU: Designing EEG and EOG Compatible Glasses for Physiological Sensing and Feedback in the Car. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '19). ACM, New York, NY, USA, 355-368. DOI: https://doi.o

Publication

Gut-Brain Computer Interfacing (GBCI) : Wearable Monitoring of Gastric Myoelectric Activity

Vujic, A., Krause, C., Tso, G., Lin, J., Han, B., Maes, P. (2019) Gut-Brain Computer Interfacing (GBCI): Wearable Monitoring of Gastric Myoelectric Activity. In 41st Engineering in Medicine and Biology Conference (EMBC), 5886-5889.

Publication

Deep Reality: An Underwater VR experience to promote relaxation by unconscious HR, EDA and brain activity biofeedback

Judith Amores, Anna Fuste, Robert Richer and Pattie Maes. 2019. Deep Reality: An Underwater VR experience to promote relaxation by unconscious HR, EDA and brain activity biofeedback. In ACM SIGGRAPH 2019 Virtual, Augmented, and Mixed Reality (SIGGRAPH '19). ACM, Los Angeles, CA, USA, ACM 978-1-4503-6320-4/19/07. 10.1145/3306449.3328818

Publication

AttentivU: a Biofeedback Device to Monitor and Improve Engagement in the Workplace

Nataliya Kosmyna, Pattie Maes. 2019. AttentivU: a Biofeedback Device to Monitor and Improve Engagement in the Workplace. In the 41st International Engineering in Medicine and Biology Conference, Berlin, Germany, July 23-27.

Publication

Exploring Human-Machine Synergy and Interaction on a Robotic Instrument

Sang-won Leigh, Abhinandan Jain, Pattie Maes. 2019. Exploring Human-Machine Synergy and Interaction on a Robotic Instrument. In International Conference on New Interfaces for Musical Expression (NIME-2019)

Publication

Paper Dreams: An Adaptive canvas that assists users with generating and visualizing stories

Bernal, Guillermo R, et al. “Paper Dreams: An Adaptive Canvas That Assists Users with Generating and Visualizing Stories.” GANocracy Workshop on Theory, Practice and Artistry of Deep Generative Modeling , 31 May 2019, p. 1., http://ganocracy.csail.mit.edu/.

Publication

Real-time Smartphone-based Sleep Staging using 1-Channel EEG

Koushik, A., Amores, J., & Maes, P. (2019, May). Real-time Smartphone-based Sleep Staging using 1-Channel EEG . In 2019 IEEE 16th International Conference on Wearable and Implantable Body Sensor Networks (BSN). IEEE.

Publication

Deep Reality: Towards Increasing Relaxation in VR with subtly changing light, sound and movement based on HR, EDA, and EEG

Amores, J., Fuste, A., Richer, R., & Maes, P. (2019, May). Deep Reality: Towards Increasing Relaxation in VR with subtly changing light, sound and movement based on HR, EDA, and EEG. In Proceedings of the 2019 CHI Conference Extended Abstracts on Human Factors in Computing Systems . ACM.

Publication

Cyborg Botany: Augmented Plants as Sensors, Displays and Actuators

Harpreet Sareen, Jiefu Zheng, and Pattie Maes. 2019. Cyborg Botany: Augmented Plants as Sensors, Displays and Actuators. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). ACM, New York, NY, USA.

Publication

AttentivU: a Wearable Pair of EEG and EOG Glasses for Real-Time Physiological Processing

Nataliya Kosmyna, Caitlin Morris, Utkarsh Sarawgi, Thanh Nguyen, Pattie Maes. 2019. AttentivU: a Wearable Pair of EEG and EOG Glasses for Real-Time Physiological Processing. In the 16th IEEE International Conference on Wearable and Implantable Body Sensor Networks (BSN’19), Chicago, IL, United States, May 19-22.

Publication

AttentivU: A Biofeedback System for Real-time Monitoring and Improvement of Engagement

Nataliya Kosmyna, Caitlin Morris, Utkarsh Sarawgi, Thanh Nguyen and Pattie Maes. 2019. AttentivU: A Biofeedback System for Real-time Monitoring and Improvement of Engagement. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). ACM, New York, NY, USA, Paper VS07, 2 pages. DOI: https://doi.org/10.1145/3290607.3311768

Publication

Adding Proprioceptive Feedback to Virtual Reality Experiences Using Galvanic Vestibular Stimulation

Misha Sra, Abhinandan Jain, and Pattie Maes. 2019. Adding Proprioceptive Feedback to Virtual Reality Experiences Using Galvanic Vestibular Stimulation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Paper 675, 14 pages. DOI: https://doi.org/10.1145/3290605.3300905

Publication

Cyborg Botany: Exploring In-Planta Cybernetic Systems for Interaction

Harpreet Sareen and Pattie Maes. 2019. Cyborg Botany: Exploring In-Planta Cybernetic Systems for Interaction. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). ACM, New York, NY, USA

Publication

Wearable Lab on Body: Combining Sensing of Biochemical and Digital Markers in a Wearable Device

P. Pataranutaporn, A. Jain, C. M. Johnson, P. Shah and P. Maes, "Wearable Lab on Body: Combining Sensing of Biochemical and Digital Markers in a Wearable Device," 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany, 2019, pp. 3327-3332. doi: 10.1109/EMBC.2019.8857479

Publication

Combining Virtual Reality and Biofeedback to Foster Empathic Abilities in Humans

Schoeller, Felix, et al. "Combining virtual reality and biofeedback to foster empathic abilities in humans." Frontiers in psychology 9 (2018): 2741.

Publication

Real-Time Sleep Staging using Deep Learning on a Smartphone for a Wearable EEG

Abhay Koushik, Judith Amores, Pattie Maes, Real-Time Sleep Staging using Deep Learning on a Smartphone for a Wearable EEG, Machine Learning for Health (ML4H) Workshop at NeurIPS 2018 arXiv:1811.07216

Publication

Wearable Motion-based Heart-rate at Rest: A Workplace Evaluation

Hernandez J., McDuff D., Quigley K., Maes P., and Picard R., "Wearable Motion-based Heart-rate at Rest: A Workplace Evaluation," Journal of Biomedical and Health Informatics, 2018.

Publication

PhysioHMD: a conformable, modular toolkit for collecting physiological data from head-mounted displays

Bernal, Guillermo, et al. "PhysioHMD: a conformable, modular toolkit for collecting physiological data from head-mounted displays." Proceedings of the 2018 ACM International Symposium on Wearable Computers. ACM, 2018.

Publication

AttentivU: Evaluating the Feasibility of Biofeedback Glasses to Monitor and Improve Attention

Nataliya Kosmyna, Utkarsh Sarawgi, and Pattie Maes. 2018. AttentivU: Evaluating the Feasibility of Biofeedback Glasses to Monitor and Improve Attention. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers (UbiComp '18). ACM, New York, NY, USA, 999-1005. DOI: https://doi.org/10.1145/3267305.32741

Publication

ROBOTIC SYMBIONTS: Exploring Integrated Human-Machine Action and Expression

Publication

BioEssence: A Wearable Olfactory Display that Monitors Cardio-Respiratory Information to Support Mental Wellbeing

Amores, J., Hernandez, J., Dementyev, A., Wang, X., Maes, P. "BioEssence: A Wearable Olfactory Display that Monitors Cardio-respiratory Information to Support Mental Wellbeing," Proceedings of the International Conference of IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, Hawaii, July 2018

Publication

Towards Gut-Brain Computer Interfacing: Gastric Myoelectric Activity as an Index of Subcortical Phenomena

Vujic, A., Tong, S., Picard, R., Maes, P. (2018) Towards Gut-Brain Computer Interfacing: Gastric Myoelectric Activity as an Index of Subcortical Phenomena. In 3rd International Mobile Brain/Body Imaging Conference, 135-136.

Publication

Words in Motion: Kinesthetic language learning in virtual reality

Christian Vázquez, Lei Xia, Takako Aikawa, Pattie Maes "Words in Motion: Kinesthetic Language Learning in Virtual Reality", 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT)

Publication

Robotic Symbionts: Interweaving human and machine actions

Sang-won Leigh, Harshit Agrawal, Pattie Maes

Publication

Mathland: Constructionist Mathematical Learning in the Real World Using Immersive Mixed Reality

Mina Khan, Fernando Trujano, Pattie Maes, "Mathland: Constructionist Mathematical Learning in the Real World Using Immersive Mixed Reality" International Conference on Immersive Learning

Publication

Mathland: Playful Mathematical Learning in Mixed Reality

Mina Khan, Fernando Trujano, Ashris Choudhury, Pattie Maes, "Mathland: Playful Mathematical Learning in Mixed Reality" CHI EA '18 Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

Publication

BreathVR: Leveraging Breathing as a Directly Controlled Interface for Virtual Reality Games

Sra, Misha, Xuhai Xu, and Pattie Maes. "BreathVR: Leveraging Breathing as a Directly Controlled Interface for Virtual Reality Games." Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 2018.

Publication

Dormio: Interfacing with Dreams

Haar Horowitz, A. et al. Dormio: Interfacing with dreams.Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, 2018.

Publication

Morphology Extension Kit: A Modular Robotic Platform for Physically Reconfigurable Wearables.

Sang-won Leigh, et al. "Morphology Extension Kit: A Modular Robotic Platform for Physically Reconfigurable Wearables." TEI 18, pp 11-18, March 3, 2018.

Publication

AlterEgo: A Personalized Wearable Silent Speech Interface

A. Kapur, S. Kapur, and P. Maes, "AlterEgo: A Personalized Wearable Silent Speech Interface." 23rd International Conference on Intelligent User Interfaces (IUI 2018), pp 43-53, March 5, 2018.

Publication

Promoting relaxation using virtual reality, olfactory interfaces and wearable EEG

Judith Amores ; Robert Richer ; Nan Zhao ; Pattie Maes ; Bjoern M. Eskofier. "Promoting relaxation using virtual reality, olfactory interfaces and wearable EEG." Institute of Electrical and Electronics Engineers (IEEE). April 5, 2018.

Publication

Assistive Augmentation

Jochen Huber, Roy Shilkrot, Pattie Maes, Suranga Nanayakkara. https://doi.org/10.1007/978-981-10-6404-3

Publication

Hand Development Kit: Soft Robotic Fingers as Prosthetic Augmentation of the Hand

Yuhan Hu, Sang-won Leigh, and Pattie Maes. 2017. Hand Development Kit: Soft Robotic Fingers as Prosthetic Augmentation of the Hand. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 27-29.

Publication

The Reality Editor: An Open and Universal Tool for Understanding and Controlling the Physical World

Valentin Heun

Publication

The dermal abyss: interfacing with the skin by tattooing biosensors

Katia Vega, Nan Jiang, Xin Liu, Viirj Kan, Nick Barry, Pattie Maes, Ali Yetisen, Joe Paradiso. " The dermal abyss: interfacing with the skin by tattooing biosensors." Proceedings of the 2017 ACM International Symposium on Wearable Computers, ISWC '17 , p. 138-145, 2017.

Publication

Investigating Social Presence and Communication with Embodied Avatars in Room-Scale Virtual Reality

Greenwald, Scott W., Wang, Zhangyuan, Funk, Markus & Maes, Pattie (2017). Investigating Social Presence and Communication with Embodied Avatars in Room-Scale Virtual Reality. Immersive Learning Research Network Conference, iLRN 2017. http://hdl.handle.net/1721.1/108441

Publication

Safety++: Designing IoT and Wearable Systems for Industrial Safety through a User Centered Design Approach

Guillermo Bernal, Sara Colombo, Mohammed Al Ai Baky, and Federico Casalegno. 2017. Safety++: Designing IoT and Wearable Systems for Industrial Safety through a User Centered Design Approach. In Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments (PETRA '17). ACM, New York, NY, USA, 163-170. DOI: https://doi.org/10.1145/3056540.3056557

Publication

Serendipitous Language Learning in Mixed Reality

Vazquez, Christian David, et al. "Serendipitous Language Learning in Mixed Reality." Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2017.

Publication

Printflatables

Sareen, H., Umapathi, U., Shin, P., Kakehi, Y., Ou, J., Ishii, H., & Maes, P. (2017, May). Printflatables: Printing Human-Scale, Functional and Dynamic Inflatable Objects. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 3669-3680). ACM.

Publication

Emotional Beasts: Visually Expressing Emotions through Avatars in VR

Bernal, Guillermo, and Pattie Maes. "Emotional Beasts: Visually Expressing Emotions through Avatars in VR." Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2017.

Publication

FaceDisplay: Enabling Multi-User Interaction for Mobile Virtual Reality

Gugenheimer, J., Stemasov, E., Sareen, H., & Rukzio, E. (2017, May). FaceDisplay: Enabling Multi-User Interaction for Mobile Virtual Reality. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (pp. 369-372). ACM.

Publication

Essence: Olfactory Interfaces for Unconscious Influence of Mood and Cognitive Performance

Judith Amores and Pattie Maes. 2017. Essence: Olfactory Interfaces for Unconscious Influence of Mood and Cognitive Performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '17). ACM, Denver, CO, USA. DOI: http://dx.doi.org/10.1145/3025453.3026004

Publication

Body-Borne Computers as Extensions of Self

Leigh, S. W., Sareen, H., Kao, H. L. C., Liu, X., & Maes, P. (2017). Body-Borne Computers as Extensions of Self. Computers, 6(1), 12.

Publication

Procedurally generated virtual reality from 3D reconstructed physical space

Misha Sra, Sergio Garrido-Jurado, Chris Schmandt, and Pattie Maes. 2016. Procedurally generated virtual reality from 3D reconstructed physical space. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology (VRST '16).

Publication

Fluxa: Body movements as a social display

Xin Liu, Katia Vega, Jing Qian, Joe Paradiso, Pattie Maes