MIT Media Lab / Fluid Interfaces
P. Tandon et al., "Txt2Vid: Ultra-Low Bitrate Compression of Talking-Head Videos via Text," in IEEE Journal on Selected Areas in Communications, 2022, doi: 10.1109/JSAC.2022.3221953.
Joanne Leong, Olivia Seow, Cathy Mengying Fang, Benny J. Tang, Rajan Vaish, and Pattie Maes. 2022. Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality. In The Adjunct Publication of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22 Adjunct), October 29-November 2, 2022, Bend, OR, USA. ACM, New York, NY, USA, 3 pages.
Kosmyna, N., Balyan, A., Hauptmann, E. (2023). Decoding Visual Imagery Using EEG/EOG Glasses: A Pilot Study. In: Arai, K. (eds) Proceedings of the Future Technologies Conference (FTC) 2022, Volume 2. FTC 2022 2022. Lecture Notes in Networks and Systems, vol 560. Springer, Cham. https://doi.org/10.1007/978-3-031-18458-1_29
Kosmyna, N., Balyan, A., Hauptmann, E. (2023). Target Speaker Detection with EEG/EOG Glasses: A Pilot Study. In: Arai, K. (eds) Proceedings of the Future Technologies Conference (FTC) 2022, Volume 2. FTC 2022 2022. Lecture Notes in Networks and Systems, vol 560. Springer, Cham. https://doi.org/10.1007/978-3-031-18458-1_30
P. Pataranutaporn* J. Leong*, V. Danry*, A. Lawson, P. Maes, M. Sra. 2022. *Co-first authorship ”AI-Generated Virtual Instructors Based on Liked or Admired People Can Improve Motivation and Foster Positive Emotions for Learning” to appear in FIE 2022, October 8-11, Uppsala, Sweden.
Whitmore, N. W., Harris, J. C., Kovach, T. & Paller, K. A. Improving Memory via Automated Targeted Memory Reactivation during Sleep. Journal of Sleep Research 2022.06.28.497977 (2022) doi:10.1101/2022.06.28.497977.
Haar Horowitz, Adam Jedidiah. Interfacing With Dreams: Novel Technologies and Protocols for Targeted Dream Incubation. Diss. Massachusetts Institute of Technology, 2022.
Rojas, C., Patekar, G., Zuccarelli, E., Chin, A., Esquivel, D., Maes, P. Towards Enhancing Empathy Through Emotion Augmented Remote. 2022. Proc. ACM Conference on Human Factors in Computing Systems - CHI (Accepted)
Pat Pataranutaporn, Valentina Sumini, Melodie Yashar, Susanna Testa, Marianna Obrist, Scott Davidoff, Amber M. Paul, Dorit Donoviel, Jimmy Wu, Sands A Fish, Ariel Ekblaw, Albrecht Schmidt, Joe Paradiso, and Pattie Maes. 2022. SpaceCHI 2.0: Advancing Human-Computer Interaction Systems for Space Exploration. In CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI EA '22).
Valdemar Danry, Joanne Leong, Pat Pataranutaporn, Pulkit Tandon, Yimeng Liu, Roy Shilkrot, Parinya Punpongsanon, Tsachy Weissman, Pattie Maes, and Misha Sra. 2022. AI-Generated Characters: Putting Deepfakes to Good Use. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. Association for Computing Machinery, New York, NY, USA, Article 119, 1–5.
Nathan Arthur Semertzidis, Zoe Xiao Fang, Pedro Lopes, Kai Kunze, Paul Pangaro, Florian Floyd Mueller, and Pattie Maes. 2022. What We Talk About When We Talk About Human-Computer Integration. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. Association for Computing Machinery, New York, NY, USA, Article 149, 1–4.
Danry, Valdemar, Pat Pataranutaporn, Ziv Epstein, Matthew Groh, and Pattie Maes (Under review). “Deceptive AI systems that give explanations are just as convincing as honest AI systems in human-machine decision making.” Extended Abstract. Presented at the International Conference on Computational Social Science (IC2S2) 2022.
Bernal, G., Hidalgo, N., Russomanno, C., & Maes, P. (2022, March). Galea: A physiological sensing system for behavioral research in Virtual Environments. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (pp. 66-76). IEEE.
Pataranutaporn, P., Danry, V., Leong, J. et al. AI-generated characters for supporting personalized learning and well-being. Nat Mach Intell (2021). https://doi.org/10.1038/s42256-021-00417-9
Nataliya Kosmyna, Chi-Yun Hu, Yujie Wang, Qiuxuan Wu, Cassandra Scheirer, and Pattie Maes. 2021. A Pilot Study using Covert Visuospatial Attention as an EEG-based Brain Computer Interface to Enhance AR Interaction. In 2021 International Symposium on Wearable Computers (ISWC '21). Association for Computing Machinery, New York, NY, USA, 43–47. DOI:https://doi.org/10.1145/3460421.3480420
N. Kosmyna, Q. Wu, C. -Y. Hu, Y. Wang, C. Scheirer and P. Maes, "Assessing Internal and External Attention in AR using Brain Computer Interfaces: A Pilot Study," 2021 IEEE 17th International Conference on Wearable and Implantable Body Sensor Networks (BSN), 2021, pp. 1-6, doi: 10.1109/BSN51625.2021.9507034.
Narain, J., Johnson, K., Quatieri, T., Picard, R., and Maes, P. “Transfer Learning with Real-World Vocalizations from Minimally Speaking Individuals”. Workshop in Interpretable ML in Healthcare at International Conference on Machine Learning. July 2021.
Pataranutaporn, Pat, Valdemar Danry, and Pattie Maes. "Machinoia, Machine of Multiple Me: Integrating with Past, Future and Alternative Selves." Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 2021.
Leong, Joanne, et al. "Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity." Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 2021.
Nataliya Kosmyna, Cassandra Scheirer, and Pattie Maes. 2021. The Thinking Cap: Fostering Growth Mindset Of Children By Means Of Electroencephalography And Perceived Magic of Harry Potter Universe. In CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI ’21 Extended Abstracts), May 08–13, 2021, Yokohama, Japan. ACM, New York, NY, USA, 6 pages. https://doi.org/10.1145/34
Bernal, Guillermo, Sean Montgomery, and Pattie Maes. "Brain-Computer Interfaces, Open Source and Democratizing the Future of Augmented Consciousness." Frontiers in Computer Science 3 (2021): 23.
Simonson, Aubrey and Pattie Maes. “Increasing Embodiment for Desktop-Based Participants in Mixed Desktop and Immersive Collaborative Virtual Environments.” (May 7, 2020).
Camilo Rojas, Niels Poulsen, Mileva Van Tuyl, Daniel Vargas, Zipporah Cohen, Joe Paradiso, Pattie Maes, Kevin Esvelt, and Fadel Adib. 2021. A Scalable Solution for Signaling Face Touches to Reduce the Spread of Surface-based Pathogens.. Proc. ACM IMWUT
Haar, A.J.H., Jain, A., Schoeller, F. et al. Augmenting aesthetic chills using a wearable prosthesis improves their downstream effects on reward and social cognition. Sci Rep 10, 21603 (2020). https://doi.org/10.1038/s41598-020-77951-w
Mohsenvand, M.N., Izadi, M.R. & Maes, P.. (2020). Contrastive Representation Learning for Electroencephalogram Classification. Proceedings of the Machine Learning for Health NeurIPS Workshop, in Proceedings of Machine Learning Research 136:238-253 Available from http://proceedings.mlr.press/v136/mohsenvand20a.html.
Vujic, A., Tong, S., Picard, R., & Maes, P. (2020). Going with our Guts: Potentials of Wearable Electrogastrography (EGG) for Affect Detection. Proceedings of the 2020 International Conference on Multimodal Interaction.
Narain, J.*, Johnson, K.T.*, Ferguson, C., O’Brien, A., Talkar, T., Zhang, Y., Wofford, P., Quatieri, T., Picard, R.W.,Maes, P., "Personalized Modeling of Real-World Vocalizations from Nonverbal Individuals," Proceedings of the International Conference on Multimodal Interaction (ICMI), Utrecht, Netherlands, October 2020. (*Co-first authors/Equal contribution)
Abhinandan Jain, Adam Haar Horowitz, Misha Sra, Sang-won Leigh, Pattie Maes. "Designing Interactions Beyond Conscious Control: A New Model for Wearable Interfaces." Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, no. 3 (2020): 1-23.
@article{sarawgi2020multimodal, title={Multimodal Inductive Transfer Learning for Detection of Alzheimer's Dementia and its Severity}, author={Sarawgi, Utkarsh and Zulfikar, Wazeer and Soliman, Nouran and Maes, Pattie}, journal={arXiv preprint arXiv:2009.00700}, year={2020} }
Carr, Michelle, Adam Haar, Judith Amores, Pedro Lopes, Guillermo Bernal, Tomás Vega, Oscar Rosello, Abhinandan Jain, and Pattie Maes. "Dream engineering: Simulating worlds through sensory stimulation." Consciousness and cognition 83 (2020): 102955.
Carr, Michelle, Adam Haar Horowitz, Judith Amores, and Pattie Maes. "Towards engineering dreams." (2020).
Pataranutaporn, Pat. Wearable Lab and BioFab on Body : Towards Closed-Loop Bio-Digital Human Augmentation. Diss. Massachusetts Institute of Technology, 2020.
Nataliya Kosmyna, Alexandra Gross and Pattie Maes. “The Thinking Cap 2.0”: Preliminary Study on Fostering Growth Mindset of Children by means of Electroencephalography and Perceived Magic using Artifacts from Fictional Sci-Fi Universes. In Proceedings of the 2020 Conference on Interaction Design and Children (IDC ’20). Association for Computing Machinery, New York, NY, USA, 761–767.
Narain, J.*, Johnson, K.T.*, O’Brien, A., Wofford, P., Maes, P., Picard, R.W. "Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism," Proceedings of the Workshop on Laughter and Other Nonverbal Vocalisations, Bielefeld, Germany, October 2020. (*Co-first authors/Equal contribution)
Johnson, K.T.* & Narain, J.*, Maes, P., Picard, R.W., "Augmenting Natural Communication in Nonverbal Individuals with Autism," International Society for Autism Research (INSAR), Seattle, Washington, May 2020. (*Co-first authors/equal contribution)
Haar Horowitz, Adam, Tony J. Cunningham, Pattie Maes, and Robert Stickgold. "Dormio: A targeted dream incubation device." Consciousness and Cognition, Volume 83, August 2020, 102938. https://doi.org/10.1016/j.concog.2020.102938
Johnson, K.T.*, Narain, J.*, Ferguson, C., Picard, R.W., and Maes, P. The ECHOS Platform to Enhance Communication for Nonverbal Children with Autism: A Case Study. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Case Studies Track of CHI 2020). (*Co-first authors/Equal contribution)
Narain, J., Ananthabhotla, I., Mendez, S., Taylor, C., Siu, H., Brugnaro, L., and Mallozzi, A. "ATHack: Co-Design and Education in Assistive Technology Development". Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. Accepted.
Simonson, Aubrey and Pattie Maes. “Pervasive Augmented Reality and the Panopticon.” (April 24, 2020).
Rojas, Camilo, et al. "Project Us: A Wearable for Enhancing Empathy." ACM DIS 2020 Conference (July 6, 2020).
Nataliya Kosmyna "AttentivU: A Wearable Pair of EEG and EOG Glasses for Real-Time Physiological Processing (Conference Presentation)", Proc. SPIE 11310, Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR), 113101P (2 April 2020); https://doi.org/10.1117/12.2566398
Pataranutaporn, P* ., Vujic, A.* , Kong, D. S., Maes, P., & Sra, M. (2020, March). Living Bits: Opportunities and Challenges for Integrating Living Microorganisms in Human-Computer Interaction. In Proceedings of the Augmented Humans International Conference (pp. 1-12).
Danry, Valdemar, et al. "Wearable Reasoner: Towards Enhanced Human Rationality Through A Wearable Device With An Explainable AI Assistant." ACM Augmented Humans 2020.
Narain, J.*, Johnson, K.T.*, Picard, R.W., Maes, P. "Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data," NeurIPS Workshop on AI for Social Good, December 2019. (*Co-first authors/Equal contribution)
Nataliya Kosmyna, Pattie Maes. AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning. Sensors 2019, 19, 5200.
Bernal, Guillermo, Lily Zhou, Haripriya Mehta, and Pattie Maes. NeurIPS Workshop on Machine Learning for Creativity and Design, December 14, 2019.
Bernal, Guillermo, Lily Zhou, Erica Yuen, and Pattie Maes. “Paper Dreams: Real-Time Human and Machine Collaboration for Visual Story Development.” XXII Generative Art Conference - GA2019, December 21, 2019.
Schoeller, F., Haar, A. J. H., Jain, A., & Maes, P. (2019). Enhancing human emotions with interoceptive technologies. Physics of life reviews.
Narain, J.*, Johnson, K.T.*, Picard, R.W., and Maes, P. “Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data”. NeurIPS 2019 Joint Workshop on AI for Social Good. (*Co-first authors/Equal contribution)
Nataliya Kosmyna, Caitlin Morris, Thanh Nguyen, Sebastian Zepf, Javier Hernandez, and Pattie Maes. 2019. AttentivU: Designing EEG and EOG Compatible Glasses for Physiological Sensing and Feedback in the Car. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '19). ACM, New York, NY, USA, 355-368.
Jones, N., Jaques, N., Pataranutaporn, P., Ghandeharioun, A., & Picard, R. (2019, September). Analysis of Online Suicide Risk with Document Embeddings and Latent Dirichlet Allocation. In 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) (pp. 1-5). IEEE.
Vujic, A., Krause, C., Tso, G., Lin, J., Han, B., Maes, P. (2019) Gut-Brain Computer Interfacing (GBCI): Wearable Monitoring of Gastric Myoelectric Activity. In 41st Engineering in Medicine and Biology Conference (EMBC), 5886-5889.
Judith Amores, Anna Fuste, Robert Richer and Pattie Maes. 2019. Deep Reality: An Underwater VR experience to promote relaxation by unconscious HR, EDA and brain activity biofeedback. In ACM SIGGRAPH 2019 Virtual, Augmented, and Mixed Reality (SIGGRAPH '19). ACM, Los Angeles, CA, USA, ACM 978-1-4503-6320-4/19/07. 10.1145/3306449.3328818
Nataliya Kosmyna, Pattie Maes. 2019. AttentivU: a Biofeedback Device to Monitor and Improve Engagement in the Workplace. In the 41st International Engineering in Medicine and Biology Conference, Berlin, Germany, July 23-27.
Sang-won Leigh, Abhinandan Jain, Pattie Maes. 2019. Exploring Human-Machine Synergy and Interaction on a Robotic Instrument. In International Conference on New Interfaces for Musical Expression (NIME-2019)
Bernal, Guillermo R, et al. “Paper Dreams: An Adaptive Canvas That Assists Users with Generating and Visualizing Stories.” GANocracy Workshop on Theory, Practice and Artistry of Deep Generative Modeling , 31 May 2019, p. 1., http://ganocracy.csail.mit.edu/.
Koushik, A., Amores, J., & Maes, P. (2019, May). Real-time Smartphone-based Sleep Staging using 1-Channel EEG . In 2019 IEEE 16th International Conference on Wearable and Implantable Body Sensor Networks (BSN). IEEE.