Advance human wellbeing by developing new ways to communicate, understand, and respond to emotion

Publication

Forecasting Mental Distress using Healthcare Claims Data

Taylor, Sara. Forecasting Mental Distress using Healthcare Claims Data. 2020. MIT, PhD dissertation.

Publication

Towards Assessing and Recommending Combinations of Behaviors for Improving Health and Well-Being

Nosakhare, E., and Picard. R. 2019. Toward Assessing and Recommending Combinations of Behaviors for Improving Health and Well-Being. ACM Trans. Comput. Healthcare 1, 1, Article 4 (December 2019), 29 pages.

Publication

Holistic Affect Recognition using PaNDA: Paralinguistic Non-metric Dimensional Analysis

Zhang Y, Weninger F, Schuller B, Picard R "Holistic Affect Recognition using PaNDA: Paralinguistic Non-metric Dimensional Analysis." IEEE Transactions on Affective Computing, December 2019.

Publication

Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data

Narain, J.* & Johnson, K.T.*, Picard, R.W., Maes, P. "Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data," NeurIPS Workshop on AI for Social Good, December 2019. (*equal contribution)

Publication

Characterizing Sources of Uncertainty to Proxy Calibration and Disambiguate Annotator and Data Bias

Ghandeharioun, A., Eoff, B., Jou, B., & Picard, R. W. (2019). Characterizing Sources of Uncertainty to Proxy Calibration and Disambiguate Annotator and Data Bias. arXiv preprint arXiv:1909.09285.

Publication

Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks

Umematsu, T., Sano, A., Taylor, S., and Picard, R. "Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks.", 2019 IEICE Society Conference, Japan, September 2019.

Publication

Automatic Triage and Analysis of Online Suicide Risk with Document Embeddings and Latent Dirichlet Allocation

Jones, N., Jaques, N., Pataranutaporn, P., Ghandeharioun, A., & Picard, R. (2019, September). Analysis of Online Suicide Risk with Document Embeddings and Latent Dirichlet Allocation. In 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) (pp. 1-5). IEEE.

Publication

Multi-modal Active Learning From Human Data: A Deep Reinforcement Learning Approach

Rudovic, O., Zhang, M, Schuller, B., Picard, R. "Multi-modal Active Learning From Human Data: A Deep Reinforcement Learning Approach", In 2019 International Conference on Multimodal Interaction (ICMI ’19), October 14–18, 2019, Suzhou, China. ACM, New York, NY, USA.

Publication

Probabilistic Latent Variable Modeling for Assessing Behavioral Influences on Well-Being

Nosakhare, E., Picard, R. W. Probabilistic Latent Variable Modeling for Assessing Behavioral Influences on Well-Being," ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD ’19), August 4–8, 2019, Anchorage, AK, USA. ACM, New York, NY, USA. https://doi.org/10.1145/3292500.3330738

Publication

Meta-weighted Gaussian Process Experts for Personalized Forecasting of AD Cognitive Changes

Rudovic, O., Utsumi, Y., Guerrero, R., Peterson, K., Rueckert, D., Picard, R. W. "Meta-weighted Gaussian Process Experts for Personalized Forecasting of AD Cognitive Changes" Machine Learning for Healthcare Conference (ML4HC2019), August 2019.

Publication

Daytime Data and LSTM can Forecast Tomorrow's Stress, Health, and Happiness

Umematsu, T., Sano, A., and Picard, R. "Daytime Data and LSTM can Forecast Tomorrow's Stress, Health, and Happiness," the 41st International Engineering in Medicine and Biology Conference (EMBC), p.2186-2190, Berlin, July 2019.

Publication

Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks

Umematsu, T., Sano, A., Taylor, S., and Picard, R. "Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks." IEEE International Conference on Biomedical and Health Informatics (BHI), Chicago, Illinois, May 2019. (BEST PAPER AWARD - 1st Prize)

Publication

Towards Empathetic Car Interfaces: Emotional Triggers while Driving

Zepf, S., Dittrich, M., Hernandez, J., Schmitt, A. "Towards Empathetic Car Interfaces: Emotional Triggers while Driving," In the Late Breaking Work of CHI, Glasgow, UK, May 2019.

Publication

Deep Reinforcement Learning for Optimal Critical Care Pain Management with Morphine using Dueling Double-Deep Q Networks

Lopez-Martinez D, Eschenfeldt P, Ostvar S, Ingram M, Hur C, Picard R. Deep Reinforcement Learning for Optimal Critical Care Pain Management with Morphine using Dueling Double-Deep Q Networks, in Engineering in Medicine and Biology (EMBC). Berlin, Germany ; 2019.

Publication

Personalized Estimation of Engagement from Videos Using Active Learning with Deep Reinforcement Learning

Rudovic, O., Park, H-W., Busche, J., Schuller, B. , Breazeal, C., Picard, R. W., " Personalized Estimation of Engagement from Videos Using Active Learning with Deep Reinforcement Learning," IEEE CVPR -AMFG W, June 2019.

Publication

Stress measurement using speech: Recent advancements, validation issues, and ethical and privacy considerations

Slavich G.M., Taylor S., Picard R.W. "Stress measurement using speech: Recent advancements, validation issues, and ethical and privacy considerations," Stress, 2019.

Publication

A Generic Human–Machine Annotation Framework Based on Dynamic Cooperative Learning

Zhang Y, Michi A, Wagner J, Andre E, Schuller B, Weninger F. "A Generic Human-Machine Annotation Framework Based on Dynamic Cooperative Learning." IEEE Transactions on Cybernetics, March 2019.

Publication

Use of In-Game Rewards to Motivate Daily Self-Report Compliance: Randomized Controlled Trial

Taylor S., Ferguson C., Peng F., Schoeneich M., Picard R.W. "Use of In-Game Rewards to Motivate Daily Self-Report Compliance: Randomized Controlled Trial," Journal of Medical Internet Research, 21(1), e11683, 2019.

Publication

EMMA: An Emotion-Aware Wellbeing Chatbot

A. Ghandeharioun, D. McDuff, M. Czerwinski and K. Rowan, "EMMA: An Emotion-Aware Wellbeing Chatbot," 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII), Cambridge, United Kingdom, 2019, pp. 1-7.

Publication

Wearable Motion-based Heart-rate at Rest: A Workplace Evaluation

Hernandez J., McDuff D., Quigley K., Maes P., and Picard R., "Wearable Motion-based Heart-rate at Rest: A Workplace Evaluation," Journal of Biomedical and Health Informatics, 2018.

Publication

CultureNet: A Deep Learning Approach for Engagement Intensity Estimation from Face Images of Children with Autism

Rudovic, O., Utsumi, Y., Lee, J., Hernandez, J., Castello Ferrer, E., Schuller, B., Picard, R. "CultureNet: A Deep Learning Approach for Engagement Intensity Estimation from Face Images of Children with Autism." IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018).

Publication

Characterizing Electrodermal Activity Using Point Processes in Young Children

Subramanian, S., Barbieri, R., Johnson, K.T., Brown, E. "Characterizing Electrodermal Activity Using Point Processes in Young Children," 50th Annual Meeting of the Biomedical Engineering Society (BMES), Atlanta, Georgia, October 2018.

Publication

Intrinsic Social Motivation via Causal Influence in Multi-Agent RL

Jaques, N., Lazaridou, A., Hughes, E., Gulcehre, C., Ortega, P. A., Strouse, D. J., Leibo, J. Z., and de Freitas, N. "Intrinsic Social Motivation via Causal Influence in Multi-Agent RL," International Conference on Representation Learning (ICLR), New Orleans, Louisiana, May 2019 (submitted).

Publication

Epidermal Robots: Wearable Sensors that Climb on The Skin

Dementyev A., Hernandez J., Choi I., Follmer S., Paradiso J., "Epidermal Robots: Wearable Sensors That Climb On The Skin" In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2 (3), September 2018.

Publication

Affective Keys: Towards Unobtrusive Stress Sensing of Smartphone Users

Exposito, M., Hernandez, J., Picard, R., "Affective Keys: Towards Unobtrusive Stress Sensing of Smartphone Users" In Proceedings of Mobile Human Computer Interaction, Barcelona, Spain, September, 2018

Publication

Probabilistic Latent Variable Modeling for Predicting Future Well-Being and Assessing Behavioral Influences on Mood, Stress and Health

Nosakhare, E. "Probabilistic Latent Variable Modeling for Predicting Future Well-Being and Assessing Behavioral Influences on Mood, Stress and Health", MIT PhD Thesis, September 2018

Publication

Multi-task multiple kernel machines for personalized pain recognition from functional near-infrared spectroscopy brain signals

Lopez-Martinez D, Peng K, Steele S, Lee A, Borsook D, Picard R. "Multi-task multiple kernel machines for personalized pain recognition from functional near-infrared spectroscopy brain signals." International Conference on Pattern Recognition (ICPR), Beijing, China, August 2018. "BEST STUDENT PAPER AWARD"

Publication

Multimodal Ambulatory Sleep Detection Using LSTM Recurrent Neural Networks

Sano A, Chen W, Lopez-Martinez D, Taylor S, Picard R. Multimodal Ambulatory Sleep Detection Using LSTM Recurrent Neural Networks. Journal of Biomedical and Health Informatics. 2018.

Publication

Vomit Comet Physiology: Autonomic Changes in Novice Flyers

Johnson, K.T., Taylor, S., Fedor, S., Jaques, N., Chen, W., Picard, R.W. "Vomit Comet Physiology: Autonomic Changes in Novice Flyers." Proceedings of the International Conference of IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, Hawaii, July 2018.

Publication

Mood, Stress and Sleep Sensing with Wearable Sensors and Mobile Phone

Sano,A., Taylor,S., Jaques,N., Chen,W., Lopez-Martinez,D., Nosakhare,E., Rudovic,O., Umematsu,T., and Picard,R., "Mood, Stress and Sleep Sensing with Wearable Sensors and Mobile Phone," The 40th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), July 2018.

Publication

BioEssence: A Wearable Olfactory Display that Monitors Cardio-Respiratory Information to Support Mental Wellbeing

Amores, J., Hernandez, J., Dementyev, A., Wang, X., Maes, P. "BioEssence: A Wearable Olfactory Display that Monitors Cardio-respiratory Information to Support Mental Wellbeing," Proceedings of the International Conference of IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, Hawaii, July 2018

Publication

Continuous pain intensity estimation from autonomic signals with recurrent neural networks

Lopez-Martinez D, Picard R. Continuous pain intensity estimation from autonomic signals with recurrent neural networks, in IEEE Engineering in Medicine and Biology Society (EMBC). Hawaii ; 2018.

Publication

A Mixture of Personalized Experts for Human Affect Estimation

Feffer, M., Rudovic, O., Picard, R. "A Mixture of Personalized Experts for Human Affect Estimation." The 14th International Conference on Machine Learning and Data Mining (MLDM). July 2018.

Publication

Personalized Machine Learning for Robot Perception of Affect and Engagement in Autism Therapy

Rudovic, O., Lee, J., Dai, M., Schuller, B. , Picard, R. W., " Personalized machine learning for robot perception of affect and engagement in autism therapy," Science Robotics, June 2018.

Publication

Improving Stress Forecasting using LSTM Neural Networks

Umematsu, T., Sano, A., Taylor, S., and Picard, R. "Improving Stress Forecasting using LSTM Neural Networks." The 40th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, Hawaii, July 2018.

Publication

Dyadic Physiological Interdependence and Social Reciprocity in ASD

Saunders Wilder, O., Sullivan, J., Johnson, K.T., Palumbo, R.V., Cumpanasiou, C., Picard, R.W., Goodwin, M.S. "Dyadic Physiological Interdependence and Social Reciprocity in ASD," International Society for Autism Research (INSAR), Rotterdam, Netherlands, May 2018.

Publication

Multi-SPRING: Facilitating Social Interaction through a Customizable, Multimodal Learning Platform

Johnson, K.T., Ferguson, C.S., Picard, R.W., "Multi-SPRING: Facilitating Social Interaction through a Customizable, Multimodal Learning Platform," International Society for Autism Research (INSAR), Rotterdam, Netherlands, May 2018.

Publication

Identifying objective physiological markers and modifiable behaviors for self-reported stress and mental health status using wearable sensor

Sano, A., Taylor, S., McHill, A. W., Phillips, A. J. K., Barger, L. K., Klerman, E., and Picard, R., "Identifying objective physiological markers and modifiable behaviors for self-reported stress and mental health status using wearable sensors and Mobile Phones: Observational Study," Journal of Medical Internet Research, 2018;20(6):e210

Publication

Personalized Gaussian Processes for Forecasting of Alzheimer's Disease Assessment Scale-Cognition Sub-Scale (ADAS-Cog13)

Utsumi, Y., Rudovic, O., Peterson, K., Guerrero, R., Picard, R. "Personalized Gaussian Processes for Forecasting of Alzheimer's Disease Assessment Scale-Cognition Sub-Scale (ADAS-Cog13)." The 40th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). May 2018.

Publication

A Trip to the Moon: Personalized Animated Movies for Self-reflection

Peng F., LaBelle V., Yue E., and Picard R.. "A Trip to the Moon: Personalized Animated Movies for Self-reflection." Proceedings of Conference on Human Factors in Computing Systems. ACM, 2018.

Publication

Digital phenotyping of suicidal thoughts

Kleiman, E. M., Turner, B. J., Fedor, S., Beale, E. E., Picard, R. W., Huffman, J. C., & Nock, M. K. "Digital phenotyping of suicidal thoughts." Depression and anxiety, April 2018

Publication

QuantifyMe: An Open-Source Automated Single-Case Experimental Design Platform

Taylor, S.*, Sano, A.*, Ferguson, C., Mohan, A., Picard, R. "QuantifyMe: An Open-Source Automated Single-Case Experimental Design Platform," Sensors, April 2018. (*equal contribution)

Publication

Learning via social awareness: improving sketch representations with facial feedback

Jaques, N., Engel, J., Ha, D., Bertsch, F., Picard, R., and Eck, D. "Learning via social awareness: improving sketch representations with facial feedback." International Conference on Learning Representations (ICLR) Workshop, Vancouver, Canada, April 2018.

Publication

Skin conductance deconvolution for pain estimation

Lopez-Martinez, D., and Picard, R. "Skin conductance deconvolution for pain estimation". International Conference on Biomedical and Health Informatics (BHI), Las Vegas, USA, March 2018

Publication

Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health

Taylor, S.*, Jaques, N.*, Nosakhare, E., Sano, A. and Picard, R., "Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health," in IEEE Transactions on Affective Computing, vol. PP, no. 99, pp. 1-1. doi: 10.1109/TAFFC.2017.2784832 *Both authors contributed equally.

Publication

Personalized Gaussian Processes for Future Prediction of Alzheimer's Disease Progression

Peterson, K., Rudovic, O., Guerrero, R., Picard, R. "Personalized Gaussian Processes for Future Prediction of Alzheimer's Disease Progression." ML4H: Machine Learning for Health. NIPS'W (2017)

Publication

Physiological and behavioral profiling for nociceptive pain estimation using personalized multitask learning

Lopez-Martinez, D., Rudovic, O., Picard, R. "Physiological and behavioral profiling for nociceptive pain estimation using personalized multitask learning," NIPS Workshop on Machine Learning for Healthcare, Long Beach, CA, December 2017.

Publication

QuantifyMe: An Automated Single-Case Experimental Design Platform

Sano, A.*, Taylor, S.*, Ferguson, C., Mohan A., Picard, R. "QuantifyMe: An Automated Single-Case Experimental Design Platform," In Proc. International Conference on Wireless Mobile Communication and Healthcare (MobiHealth), Vienna, Austria, November 2017. (*equal contribution)

Publication

Location Patterns from Phone Sensors May Help Predict Depressive Symptoms: A Longitudinal Pilot Study

Howe, E., Ghandeharioun, A., Pedrelli, P., Mischoulon, D., Picard, R., Fedor, S. "Location Patterns from Phone Sensors May Help Predict Depressive Symptoms: A Longitudinal Pilot Study," Association for Behavioral and Cognitive Therapies Annual Convention – Tech SIG, San Diego, CA, November 2017.

Publication

Regularization approaches for support vector machines with applications to biomedical data

arXiv:1710.10600

Publication

Multimodal Autoencoder: A Deep Learning Approach to Filling In Missing Sensor Data and Enabling Better Mood Prediction

Jaques, N., Taylor, S., Sano, A., and Picard, R. International Conference on Affective Computing and Intelligent Interaction (ACII), San Antonio, Texas, October 2017

Publication

Multi-task Neural Networks for Personalized Pain Recognition from Physiological Signals

Lopez-Martinez, D., and Picard, R. "Multi-task Neural Networks for Personalized Pain Recognition from Physiological Signals," International Conference on Affective Computing and Intelligent Interaction (ACII) Workshop on Tools and Algorithms for Mental Health and Wellbeing, Pain, and Distress (MHWPD), San Antonio, Texas, October 2017

Publication

Designing Opportune Stress Intervention Delivery Timing using Multi-modal Data

Sano, A., Johns, P., Czerwinski, M. "Designing Opportune Stress Intervention Delivery Timing using Multi-modal Data," International Conference on Affective Computing and Intelligent Interaction (ACII), San Antonio, Texas, October 2017.

Publication

Integrating EMA, clinical assessment and wearable sensors to examine the association between MDD and alcohol use

Pedrelli, P., Howe, E., Mischoulon, D., Picard, R., Ghandeharioun, A., Fedor, S."Integrating EMA, clinical assessment and wearable sensors to examine the association between MDD and alcohol use," Connected Health Conference, Boston, MA, October 2017.

Publication

Objective assessment of depressive symptoms with machine learning and wearable sensors data

Ghandeharioun, A., Fedor, S., Sangermano, L., Ionescu, D., Alpert, J., Dale, C., Sontag, D., Picard, R. "Objective assessment of depressive symptoms with machine learning and wearable sensors data," International Conference on Affective Computing and Intelligent Interaction (ACII), San Antonio, Texas, October 2017.

Publication

Multicenter clinical assessment of improved wearable multimodal convulsive seizure detectors

Francesco Onorati, Giulia Regalia, Chiara Caborni, Matteo Migliorini, Daniel Bender, Ming-Zher Poh, Cherise Frazier, Eliana Kovitch Thropp, Elizabeth D. Mynatt, Jonathan Bidwell, Roberto Mai, W. Curt LaFrance Jr, Andrew S. Blum, Daniel Friedman, Tobias Loddenkemper, Fatemeh Mohammadpour-Touserkani, Claus Reinsberger, Simone Tognetti, Rosalind W. Picard. DOI: 10.1111/epi.13899

Publication

Stress Measurement from Tongue Color Imaging

Hernandez J., Ferguson C., Sano A., Chen W., Weihui L., Yeung A. and Picard R. "Stress Measurement from Tongue Color Imaging," International Conference on Affective Computing and Intelligent Interaction (ACII), San Antonio, Texas, October 2017.

Publication

SkinBot: A Wearable Skin Climbing Robot

A. Dementyev, J. Hernandez, S. Follmer, I. Choi, and J. Paradiso. "SkinBot: A Wearable Skin Climbing Robot." ACM User Interface Software and Technology Symposium, October 2017.

Publication

Predicting Tomorrow's Mood, Health, and Stress Level using Personalized Multitask Learning and Domain Adaptation

Jaques, N., Rudovic, O., Taylor, S., Sano, A., and Picard, R. Proceedings of Machine Learning Research, 48, 17-33. August 2017.

Publication

Sequence Tutor: Conservative Fine-Tuning of Sequence Generation Models with KL-Control

Jaques, N., Gu, S., Bahdanau, D., Hernandez-Lobato, J., Turner, R., and Eck, D. International Conference on Machine Learning (ICML), Sydney, Australia, August 2017.

Publication

Measuring Engagement in Robot-Assisted Autism Therapy: A Cross-Cultural Study

Rudovic, O., Lee, J., Mascarell-Maricic, L., Schuller, B., Picard, R. "Measuring Engagement in Robot-assisted Autism Therapy: A Cross-cultural Study," Frontiers in Robotics and AI, July 2017.

Publication

Personalized Automatic Estimation of Self-reported Pain Intensity from Facial Expressions

Lopez-Martinez, D., Rudovic, O., and Picard, R. "Personalized Automatic Estimation of Self-reported Pain Intensity from Facial Expressions," Computer Vision and Pattern Recognition (CVPR) Workshop on Deep Affective Learning and Context Modeling, Honolulu, Hawaii, July 2017.

Publication

Personalized automatic estimation of self-reported pain intensity from facial expressions

Daniel Lopez-Martinez, Ognjen Rudovic and Rosalind W. Picard. “Personalized Automatic Estimation of Self-Reported Pain Intensity from Facial Expressions.” 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (2017): 2318-2327.

Publication

Wrist sensor reveals sympathetic hyperactivity and hypoventilation before probable SUDEP

Rosalind W. Picard, ScD, Matteo Migliorini, PhD, Chiara Caborni, MSc, Francesco Onorati, PhD, Giulia Regalia, PhD, Daniel Friedman, MD, Orrin Devinsky, MD Neurology; published ahead of print July 12, 2017, doi:10.1212/WNL.0000000000004208: 1526-632X

Publication

SPRING: Customizable, Motivation-Driven Technology for Children with Autism or Neurodevelopmental Differences

Johnson, K.T. and Picard, R.W. Proceedings of Interaction Design and Children (IDC'17), ACM Press, Stanford, CA, June 2017.

Publication

Irregular sleep/wake patterns are associated with poorer academic performance and delayed circadian and sleep/wake timing

Phillips AJ, Clerx WM, Sano A, Barger LK, Picard RW, Lockley WE, Klerman EB, Czeisler CA, "Irregular sleep/wake patterns are associated with poorer academic performance and delayed circadian and sleep/wake timing," Scientific Reports 7, Article number: 3216 (2017).