Pattie Maes

Professor of Media Technology; Germeshausen Professor
Publication

Human-AI Co-Dancing: Evolving Cultural Heritage through Collaborative Choreography with Generative Virtual Characters

Under review at ACM MOCO

Publication

Influencing human–AI interaction by priming beliefs about AI can increase perceived trustworthiness, empathy and effectiveness

Pataranutaporn, P., Liu, R., Finn, E. et al. Influencing human–AI interaction by priming beliefs about AI can increase perceived trustworthiness, empathy and effectiveness. Nat Mach Intell (2023). https://doi.org/10.1038/s42256-023-00720-7

Publication

Olfactory Wearables for Mobile Targeted Memory Reactivation

Amores Fernandez, J., Mehra, N., Rasch, B., & Maes, P. (2023). Olfactory Wearables for Mobile Targeted Memory Reactivation. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery.

Publication

"Picture the Audience...": Exploring Private AR Face Filters for Online Public Speaking

Joanne Leong, Florian Perteneder, Muhender Raj Rajvee, and Pattie Maes. 2023. “Picture the Audience...”: Exploring Private AR Face Filters for Online Public Speaking. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 13 pages. https://doi.org/10.1145/3544548.3581039

Publication

Targeted dream incubation at sleep onset increases post-sleep creative performance

Horowitz*, A.H., Esfahany*, K., Gálvez, T.V. et al. Targeted dream incubation at sleep onset increases post-sleep creative performance. Sci Rep 13, 7319 (2023). https://doi.org/10.1038/s41598-023-31361-w

Publication

Modulating Interoceptive Signals for Influencing the Conscious Experience

Publication

Aesthetic chills cause an emotional drift in valence and arousal

Jain A, Schoeller F, Horowitz A, Hu X, Yan G, Salomon R and Maes P (2023) Aesthetic chills cause an emotional drift in valence and arousal. Front. Neurosci. 16:1013117. doi: 10.3389/fnins.2022.1013117

Publication

ChillsDB, A gold standard for aesthetic chills stimuli

Publication

Adaptive Virtual Neuroarchitecture

Jain, A., Maes, P., Sra, M. (2023). Adaptive Virtual Neuroarchitecture. In: Simeone, A., Weyers, B., Bialkova, S., Lindeman, R.W. (eds) Everyday Virtual and Augmented Reality. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-031-05804-2_9

Publication

Frisson: Leveraging Metasomatic Interactions for Generating Aesthetic Chills

Jain, A., Schoeller, F., Zhang, E., & Maes, P. (2022, November). Frisson: Leveraging Metasomatic Interactions for Generating Aesthetic Chills. In Proceedings of the 2022 International Conference on Multimodal Interaction (pp. 148-158).

Publication

Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality

Joanne Leong, Olivia Seow, Cathy Mengying Fang, Benny J. Tang, Rajan Vaish, and Pattie Maes. 2022. Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality. In The Adjunct Publication of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22 Adjunct), October 29-November 2, 2022, Bend, OR, USA. ACM, New York, NY, USA, 3 pages.

Publication

AI-Generated Virtual Instructors Based on Liked or Admired People Can Improve Motivation and Foster Positive Emotions for Learning

P. Pataranutaporn* J. Leong*, V. Danry*, A. Lawson, P. Maes, M. Sra. 2022. *Co-first authorship ”AI-Generated Virtual Instructors Based on Liked or Admired People Can Improve Motivation and Foster Positive Emotions for Learning” to appear in FIE 2022, October 8-11, Uppsala, Sweden.

Publication

Interfacing With Dreams: Novel Technologies and Protocols for Targeted Dream Incubation

Haar Horowitz, Adam Jedidiah. Interfacing With Dreams: Novel Technologies and Protocols for Targeted Dream Incubation. Diss. Massachusetts Institute of Technology, 2022.

Publication

Towards Enhancing Empathy Through Emotion Augmented Remote Communication

Rojas, C., Patekar, G., Zuccarelli, E., Chin, A., Esquivel, D., Maes, P. Towards Enhancing Empathy Through Emotion Augmented Remote. 2022. Proc. ACM Conference on Human Factors in Computing Systems - CHI (Accepted)

Publication

SpaceCHI 2.0: Advancing Human-Computer Interaction Systems for Space Exploration

Pat Pataranutaporn, Valentina Sumini, Melodie Yashar, Susanna Testa, Marianna Obrist, Scott Davidoff, Amber M. Paul, Dorit Donoviel, Jimmy Wu, Sands A Fish, Ariel Ekblaw, Albrecht Schmidt, Joe Paradiso, and Pattie Maes. 2022. SpaceCHI 2.0: Advancing Human-Computer Interaction Systems for Space Exploration. In CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI EA '22).

Publication

AI-Generated Characters: Putting Deepfakes to Good Use

Valdemar Danry, Joanne Leong, Pat Pataranutaporn, Pulkit Tandon, Yimeng Liu, Roy Shilkrot, Parinya Punpongsanon, Tsachy Weissman, Pattie Maes, and Misha Sra. 2022. AI-Generated Characters: Putting Deepfakes to Good Use. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. Association for Computing Machinery, New York, NY, USA, Article 119, 1–5.

Publication

What We Talk About When We Talk About Human-Computer Integration

Nathan Arthur Semertzidis, Zoe Xiao Fang, Pedro Lopes, Kai Kunze, Paul Pangaro, Florian Floyd Mueller, and Pattie Maes. 2022. What We Talk About When We Talk About Human-Computer Integration. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. Association for Computing Machinery, New York, NY, USA, Article 149, 1–4.

Publication

Deceptive AI systems that give explanations are just as convincing as honest AI systems in human-machine decision making

Danry, Valdemar, Pat Pataranutaporn, Ziv Epstein, Matthew Groh, and Pattie Maes (Under review). “Deceptive AI systems that give explanations are just as convincing as honest AI systems in human-machine decision making.” Extended Abstract. Presented at the International Conference on Computational Social Science (IC2S2) 2022.

Publication

AI-generated characters for supporting personalized learning and well-being

Pataranutaporn, P., Danry, V., Leong, J. et al. AI-generated characters for supporting personalized learning and well-being. Nat Mach Intell (2021). https://doi.org/10.1038/s42256-021-00417-9

Publication

Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity

Leong, Joanne, et al. "Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity." Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 2021.

Publication

“The Thinking Cap”: Fostering Growth Mindset Of Children By Means Of Electroencephalography And Perceived Magic of Harry Potter Universe

Nataliya Kosmyna, Cassandra Scheirer, and Pattie Maes. 2021. The Thinking Cap: Fostering Growth Mindset Of Children By Means Of Electroencephalography And Perceived Magic of Harry Potter Universe. In CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI ’21 Extended Abstracts), May 08–13, 2021, Yokohama, Japan. ACM, New York, NY, USA, 6 pages. https://doi.org/10.1145/34

Publication

A Scalable Solution for Signaling Face Touches to Reduce the Spread of Surface-based Pathogens

Camilo Rojas, Niels Poulsen, Mileva Van Tuyl, Daniel Vargas, Zipporah Cohen, Joe Paradiso, Pattie Maes, Kevin Esvelt, and Fadel Adib. 2021. A Scalable Solution for Signaling Face Touches to Reduce the Spread of Surface-based Pathogens.. Proc. ACM IMWUT

Publication

Investigating the Use of Synthetic Media and Real-Time Virtual Camera Filters for Supporting Communication and Creativity

Leong, Joanne. Investigating the Use of Synthetic Media and Real-Time Virtual Camera Filters for Supporting Communication and Creativity. 2021. Massachusetts Institute of Technology, MS Thesis.

Publication

Augmenting aesthetic chills using a wearable prosthesis improves their downstream effects on reward and social cognition

Haar, A.J.H., Jain, A., Schoeller, F. et al. Augmenting aesthetic chills using a wearable prosthesis improves their downstream effects on reward and social cognition. Sci Rep 10, 21603 (2020). https://doi.org/10.1038/s41598-020-77951-w

Publication

Going with our Guts: Potentials of Wearable Electrogastrography (EGG) for Affect Detection

Vujic, A., Tong, S., Picard, R., & Maes, P. (2020). Going with our Guts: Potentials of Wearable Electrogastrography (EGG) for Affect Detection. Proceedings of the 2020 International Conference on Multimodal Interaction.

Publication

Designing Interactions Beyond Conscious Control: A New Model for Wearable Interfaces

Abhinandan Jain, Adam Haar Horowitz, Felix Schoeller, Sang-won Leigh, Pattie Maes, and Misha Sra. 2020. Designing Interactions Beyond Conscious Control: A New Model for Wearable Interfaces. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 3, Article 108 (September 2020), 23 pages. DOI:https://doi.org/10.1145/3411829

Publication

Designing Interactions Beyond Conscious Control: A New Model for Wearable Interfaces

Abhinandan Jain, Adam Haar Horowitz, Misha Sra, Sang-won Leigh, Pattie Maes. "Designing Interactions Beyond Conscious Control: A New Model for Wearable Interfaces." Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, no. 3 (2020): 1-23.

Publication

Dream engineering: Simulating worlds through sensory stimulation

Carr, Michelle, Adam Haar, Judith Amores, Pedro Lopes, Guillermo Bernal, Tomás Vega, Oscar Rosello, Abhinandan Jain, and Pattie Maes. "Dream engineering: Simulating worlds through sensory stimulation." Consciousness and cognition 83 (2020): 102955.

Publication

Towards Engineering Dreams

Carr, Michelle, Adam Haar Horowitz, Judith Amores, and Pattie Maes. "Towards engineering dreams." (2020).

Publication

The Thinking Cap 2.0: Preliminary Study on Fostering Growth Mindset of Children by means of Electroencephalography and Perceived Magic

Nataliya Kosmyna, Alexandra Gross and Pattie Maes. “The Thinking Cap 2.0”: Preliminary Study on Fostering Growth Mindset of Children by means of Electroencephalography and Perceived Magic using Artifacts from Fictional Sci-Fi Universes. In Proceedings of the 2020 Conference on Interaction Design and Children (IDC ’20). Association for Computing Machinery, New York, NY, USA, 761–767.

Publication

Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism

Narain, J.*, Johnson, K.T.*, O’Brien, A., Wofford, P., Maes, P., Picard, R.W. "Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism," Proceedings of the Workshop on Laughter and Other Nonverbal Vocalisations, Bielefeld, Germany, October 2020. (*Co-first authors/Equal contribution)

Publication

Augmenting Natural Communication in Nonverbal Individuals with Autism

Johnson, K.T.* & Narain, J.*, Maes, P., Picard, R.W., "Augmenting Natural Communication in Nonverbal Individuals with Autism," International Society for Autism Research (INSAR), Seattle, Washington, May 2020. (*Co-first authors/equal contribution)

Publication

Dormio: A Targeted Dream Incubation Device

Haar Horowitz, Adam, Tony J. Cunningham, Pattie Maes, and Robert Stickgold. "Dormio: A targeted dream incubation device." Consciousness and Cognition, Volume 83, August 2020, 102938. https://doi.org/10.1016/j.concog.2020.102938

Publication

The ECHOS Platform to Enhance Communication for Nonverbal Children with Autism: A Case Study

Johnson, K.T.*, Narain, J.*, Ferguson, C., Picard, R.W., and Maes, P. The ECHOS Platform to Enhance Communication for Nonverbal Children with Autism: A Case Study. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Case Studies Track of CHI 2020). (*Co-first authors/Equal contribution)

Publication

Body-Borne Reality: Risky Disembodiment in VR

Publication

Living Bits : Opportunities and Challenges for Integrating Living Microorganisms in Human-Computer Interaction (*Best Paper)

Pataranutaporn, P* ., Vujic, A.* , Kong, D. S., Maes, P., & Sra, M. (2020, March). Living Bits: Opportunities and Challenges for Integrating Living Microorganisms in Human-Computer Interaction. In Proceedings of the Augmented Humans International Conference (pp. 1-12).

Publication

Wearable Reasoner: Towards Enhanced Human Rationality Through A Wearable Device With An Explainable AI Assistant

Danry, Valdemar, et al. "Wearable Reasoner: Towards Enhanced Human Rationality Through A Wearable Device With An Explainable AI Assistant." ACM Augmented Humans 2020.

Publication

Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data

Narain, J.*, Johnson, K.T.*, Picard, R.W., Maes, P. "Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data," NeurIPS Workshop on AI for Social Good, December 2019. (*Co-first authors/Equal contribution)

Publication

AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning

Nataliya Kosmyna, Pattie Maes. AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning. Sensors 2019, 19, 5200.

Publication

Enhancing human emotions with interoceptive technologies delivering controlled somatosensory stimulation

Schoeller, F., Haar, A. J. H., Jain, A., & Maes, P. (2019). Enhancing human emotions with interoceptive technologies. Physics of life reviews.

Publication

Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data

Narain, J.*, Johnson, K.T.*, Picard, R.W., and Maes, P. “Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data”. NeurIPS 2019 Joint Workshop on AI for Social Good. (*Co-first authors/Equal contribution)

Publication

AttentivU: Designing EEG and EOG Compatible Glasses for Physiological Sensing and Feedback in the Car

Nataliya Kosmyna, Caitlin Morris, Thanh Nguyen, Sebastian Zepf, Javier Hernandez, and Pattie Maes. 2019. AttentivU: Designing EEG and EOG Compatible Glasses for Physiological Sensing and Feedback in the Car. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '19). ACM, New York, NY, USA, 355-368.

Publication

Gut-Brain Computer Interfacing (GBCI) : Wearable Monitoring of Gastric Myoelectric Activity

Vujic, A., Krause, C., Tso, G., Lin, J., Han, B., Maes, P. (2019) Gut-Brain Computer Interfacing (GBCI): Wearable Monitoring of Gastric Myoelectric Activity. In 41st Engineering in Medicine and Biology Conference (EMBC), 5886-5889.

Publication

AttentivU: a Biofeedback Device to Monitor and Improve Engagement in the Workplace

Nataliya Kosmyna, Pattie Maes. 2019. AttentivU: a Biofeedback Device to Monitor and Improve Engagement in the Workplace. In the 41st International Engineering in Medicine and Biology Conference, Berlin, Germany, July 23-27.

Publication

Exploring Human-Machine Synergy and Interaction on a Robotic Instrument

Sang-won Leigh, Abhinandan Jain, Pattie Maes. 2019. Exploring Human-Machine Synergy and Interaction on a Robotic Instrument. In International Conference on New Interfaces for Musical Expression (NIME-2019)

Publication

Byte.it: Discreet Teeth Gestures for Mobile Device Interaction

Tomás Vega Gálvez, Shardul Sapkota, Alexandru Dancu, Pattie Maes, CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI’19 Extended Abstracts), May 4–9, 2019, Glasgow, Scotland UK, ACM, New York, NY, USA, 6 pages, https://doi.org/10.1145/3290607.3312925

Publication

Adding Proprioceptive Feedback to Virtual Reality Experiences Using Galvanic Vestibular Stimulation

Misha Sra, Abhinandan Jain, and Pattie Maes. 2019. Adding Proprioceptive Feedback to Virtual Reality Experiences Using Galvanic Vestibular Stimulation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Paper 675, 14 pages. DOI: https://doi.org/10.1145/3290605.3300905

Publication

AttentivU: a Wearable Pair of EEG and EOG Glasses for Real-Time Physiological Processing

Nataliya Kosmyna, Caitlin Morris, Utkarsh Sarawgi, Thanh Nguyen, Pattie Maes. 2019. AttentivU: a Wearable Pair of EEG and EOG Glasses for Real-Time Physiological Processing. In the 16th IEEE International Conference on Wearable and Implantable Body Sensor Networks (BSN’19), Chicago, IL, United States, May 19-22.

Publication

AttentivU: A Biofeedback System for Real-time Monitoring and Improvement of Engagement

Nataliya Kosmyna, Caitlin Morris, Utkarsh Sarawgi, Thanh Nguyen and Pattie Maes. 2019. AttentivU: A Biofeedback System for Real-time Monitoring and Improvement of Engagement. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). ACM, New York, NY, USA, Paper VS07, 2 pages. DOI: https://doi.org/10.1145/3290607.3311768

Publication

Wearable Lab on Body: Combining Sensing of Biochemical and Digital Markers in a Wearable Device

P. Pataranutaporn, A. Jain, C. M. Johnson, P. Shah and P. Maes, "Wearable Lab on Body: Combining Sensing of Biochemical and Digital Markers in a Wearable Device," 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany, 2019, pp. 3327-3332. doi: 10.1109/EMBC.2019.8857479

Publication

Wearable Motion-based Heart-rate at Rest: A Workplace Evaluation

Hernandez J., McDuff D., Quigley K., Maes P., and Picard R., "Wearable Motion-based Heart-rate at Rest: A Workplace Evaluation," Journal of Biomedical and Health Informatics, 2018.

Publication

PhysioHMD: a conformable, modular toolkit for collecting physiological data from head-mounted displays

Bernal, Guillermo, et al. "PhysioHMD: a conformable, modular toolkit for collecting physiological data from head-mounted displays." Proceedings of the 2018 ACM International Symposium on Wearable Computers. ACM, 2018.

Publication

AttentivU: Evaluating the Feasibility of Biofeedback Glasses to Monitor and Improve Attention

Nataliya Kosmyna, Utkarsh Sarawgi, and Pattie Maes. 2018. AttentivU: Evaluating the Feasibility of Biofeedback Glasses to Monitor and Improve Attention. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers (UbiComp '18). ACM, New York, NY, USA, 999-1005. DOI: https://doi.org/10.1145/3267305.32741

Publication

BioEssence: A Wearable Olfactory Display that Monitors Cardio-Respiratory Information to Support Mental Wellbeing

Amores, J., Hernandez, J., Dementyev, A., Wang, X., Maes, P. "BioEssence: A Wearable Olfactory Display that Monitors Cardio-respiratory Information to Support Mental Wellbeing," Proceedings of the International Conference of IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, Hawaii, July 2018

Publication

Towards Gut-Brain Computer Interfacing: Gastric Myoelectric Activity as an Index of Subcortical Phenomena

Vujic, A., Tong, S., Picard, R., Maes, P. (2018) Towards Gut-Brain Computer Interfacing: Gastric Myoelectric Activity as an Index of Subcortical Phenomena. In 3rd International Mobile Brain/Body Imaging Conference, 135-136.

Publication

Words in Motion: Kinesthetic language learning in virtual reality

Christian Vázquez, Lei Xia, Takako Aikawa, Pattie Maes "Words in Motion: Kinesthetic Language Learning in Virtual Reality", 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT)

Publication

Mathland: Constructionist Mathematical Learning in the Real World Using Immersive Mixed Reality

Mina Khan, Fernando Trujano, Pattie Maes, "Mathland: Constructionist Mathematical Learning in the Real World Using Immersive Mixed Reality" International Conference on Immersive Learning

Publication

Robotic Symbionts: Interweaving human and machine actions

Sang-won Leigh, Harshit Agrawal, Pattie Maes