Advancing human wellbeing by developing new ways to communicate, understand, and respond to emotion

Affective Computing group, MIT Media Lab

Publication

Key Issues as Wearable Digital Health Technologies Enter Clinical Care

Geoffrey S. Ginsburg, Rosalind W. Picard, and Stephen H. Friend. "Key Issues as Wearable Digital Health Technologies Enter Clinical Care." New England Journal of Medicine 2024; 390:1118-27. DOI: 10.1056/NEJMra2307160

Publication

Wearable Digital Health Technology for Epilepsy

Elizabeth Donner, Orrin Devinsky, and Daniel Friedman; guest editors Stephen H. Friend, Geoffrey S. Ginsburg, Rosalind W. Picard, Jeffrey M. Drazen. "Wearable Digital Health Technology for Epilepsy." New England Journal of Medicine 2024; 390:736-745. DOI: 10.1056/NEJMra2301913

Publication

Deep learning-aided decision support for diagnosis of skin disease across skin tones

Groh, M., Badri, O., Daneshjou, R. et al. Deep learning-aided decision support for diagnosis of skin disease across skin tones. Nat Med (2024). https://doi.org/10.1038/s41591-023-02728-3

Publication

Wearable Digital Health Technologies for Monitoring in Cardiovascular Medicine

Erica S. Spatz, Geoffrey S. Ginsburg, John S. Rumsfeld, and Mintu P. Turakhia; guest editors Stephen H. Friend, Geoffrey S. Ginsburg, Rosalind W. Picard, Jeffrey M. Drazen. "Wearable Digital Health Technologies for Monitoring in Cardiovascular Medicine." New England Journal of Medicine 2024; 390:346-356. DOI: 10.1056/NEJMra2301903

Publication

Wearable technology in clinical practice for depressive disorder

Fedor, S., Lewis, R., Pedrelli, P., Mischoulon, D., Curtiss, J., & Picard, R. W. (2023). Wearable technology in clinical practice for depressive disorder. New England Journal of Medicine, 389(26), 2457-2466.

Publication

Improving Domain Generalization in Contrastive Learning using Adaptive Temperature Control

*Lewis, R. A., *Matton, K., Picard, R., & Guttag, J. (2023, December). Improving Domain Generalization in Contrastive Learning using Domain-Aware Temperature Control. In NeurIPS 2023 Workshop on Distribution Shifts: New Frontiers with Foundation Models & Neurips 2023 Workshop on Self-supervised Learning (*Equal contribution)

Publication

Sleep Deficiency Is Associated with Higher Next-Day Generalized Tonic-Clonic Seizure Risk

B. Zhang, W. V. Chen, G. Regalia, D. M. Goldenholz, and R. W. Picard, “Sleep deficiency is associated with higher next-day generalized tonic-clonic seizure risk”, in American Epilepsy Society 2023 Annual Meeting, 2023.

Publication

Wearable Digital Health Technology

Friend, Stephen H., Geoffrey S. Ginsburg, and Rosalind W. Picard. "Wearable Digital Health Technology." New England Journal of Medicine 389.22 (2023): 2100-2101.

Publication

Digital Technology for Diabetes

Michael S. Hughes, Ananta Addala, and Bruce Buckingham; guest editors Stephen H. Friend, Geoffrey S. Ginsburg, Rosalind W. Picard, Jeffrey M. Drazen. "Digital Technology for Diabetes." New England Journal of Medicine 2023; 389:2076-2086. DOI: 10.1056/NEJMra2215899

Publication

FOSTERING WELL-BEING: Designing Technology to Improve the Psychological Well-being of Foster-Involved Youth

Kumar, I. K. (2023). FOSTERING WELL-BEING: Designing Technology to Improve the Psychological Well-being of Foster-Involved Youth (thesis).

Publication

Art and the science of generative AI

Epstein, Hertzmann, et al. "Art and the science of generative AI." Science 380.6650 (2023): 1110-1111.

Publication

Real-time digital monitoring of a suicide attempt by a hospital patient

Coppersmith DDL, Wang SB, Kleiman EM, Maimone JS, Fedor S, Bentley KH, Millner AJ, Fortgang RG, Picard RW, Beck S, Huffman JC, Nock MK. Real-time Digital Monitoring of a Suicide Attempt by a Hospital Patient. General Hospital Psychiatry. 2023;80:35-39. doi: 10.1016/j.genhosppsych.2022.12.005

Publication

Contrastive Learning of Electrodermal Activity Representations for Stress Detection

Contrastive Learning of Electrodermal Activity Representations for Stress Detection; Matton, K*, Lewis, R*, Guttag, J, Picard, R.W. Conference on Health, Inference, and Learning (CHIL) 2023. *Equal contribution

Publication

Human detection of political deepfakes across transcripts, audio, and video

Groh, Matthew, Aruna Sankaranarayanan, Andrew Lippman, and Rosalind Picard. "Human detection of political deepfakes across transcripts, audio, and video." arXiv preprint arXiv:2202.12883 (2022).

Publication

Towards Transparency in Dermatology Image Datasets with Skin Tone Annotations by Experts, Crowds, and an Algorithm

Groh, Matthew, Caleb Harris, Roxana Daneshjou, Omar Badri, and Arash Koochek. "Towards transparency in dermatology image datasets with skin tone annotations by experts, crowds, and an algorithm." CSCW (2022).

Publication

Identifying the Context Shift between Test Benchmarks and Production Data

Groh, Matthew. "Identifying the Context Shift between Test Benchmarks and Production Data." arXiv preprint arXiv:2207.01059 (2022).

Publication

Computational Empathy Counteracts the Effects of Anger on Human Creative Problem Solving

Groh, Matthew, Craig Ferguson, Robert Lewis, and Rosalind W. Picard. "Computational Empathy Counteracts the Negative Effects of Anger on Creative Problem Solving." In 2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 1-8. IEEE, 2022.

Publication

Acu.ation: Real Time Acupoint Stimulation To Mediate The Urge To Smoke.

Richter-Lunn, K., & Krishna Kumar, I. (2022). Acu.ation: Real Time Acupoint Stimulation To Mediate The Urge To Smoke. Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems, 1–7. https://doi.org/10.1145/3491101.3519636

Publication

Can a Recommender System Support Treatment Personalisation in Digital Mental Health Therapy?

Can a Recommender System Support Treatment Personalisation in Digital Mental Health Therapy? A Quantitative Feasibility Assessment Using Data from a Behavioural Activation Therapy App, Lewis, R., Ferguson, F., Wilks, C., Jones, N., Picard, R.W.; CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI ’22 Extended Abstracts)

Publication

Deepfake detection by human crowds, machines, and machine-informed crowds

Matthew Groh, Ziv Epstein, Chaz Firestone, Rosalind Picard. "Deepfake detection by human crowds, machines, and machine-informed crowds." Proceedings of the National Academy of Sciences Jan 2022, 119 (1) e2110013119; DOI: 10.1073/pnas.2110013119

Publication

Predicting Driver Self-Reported Stress by Analyzing the Road Scene

Cristina Bustos, Neska Elhaouij, Albert Sole-Ribalta, Javier Borge-Holthoefer, Agata Lapedriza, and Rosalind Picard. "Predicting Driver Self-Reported Stress by Analyzing the Road Scene." in Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII 2021), preprint arXiv:2109.13225 (2021).

Publication

Presidential Deepfakes Dataset

Sankaranarayanan, Aruna, Matthew Groh, Rosalind Picard, and Andrew Lippman. "The Presidential Deepfakes Dataset." (2021).

Publication

The Guardians: Designing a Game for Long-term Engagement with Mental Health Therapy

Ferguson, C.* and Lewis, R.*, Wilks, C., Picard, R.W.; The Guardians: Designing a Game for Long-term Engagement with Mental Health Therapy; IEEE Conference of Games 2021. *Equal contribution

Publication

Habit Formation Dynamics: Finding Factors Associated with Building Strong Mindfulness Habits

Robert Lewis, Yuanbo Liu, Matthew Groh and Rosalind Picard, "Habit Formation Dynamics: Finding Factors Associated with Building Strong Mindfulness Habits" HCI International 2021

Publication

Mixed Effects Random Forests for Personalised Predictions of Clinical Depression Severity

R. Lewis, A. Ghandeharioun, S. Fedor, P. Pedrelli, R.W. Picard, D. Mischoulon, "Mixed Effects Random Forests for Personalised Predictions of Clinical Depression Severity", ICML 2021 Computational Approaches to Mental Health workshop

Publication

AmbientBreath: Unobtrusive Just-in-time Breathing Intervention Using Multi-sensory Stimulation and its Evaluation in a Car Simulator

Jinmo Lee, Neska Elhaouij, and Rosalind Picard. 2021. AmbientBreath: Unobtrusive Just-in-time Breathing Intervention Using Multi-sensory Stimulation and its Evaluation in a Car Simulator. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 2, Article 71 (June 2021), 30 pages. DOI:https://doi.org/10.1145/3463493

Publication

Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Dataset

Groh, Matthew, Caleb Harris, Luis Soenksen, Felix Lau, Rachel Han, Aerin Kim, Arash Koochek, and Omar Badri. "Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Dataset." arXiv preprint arXiv:2104.09957 (2021). Accepted at CVPR ISIC 2021 workshop. Publication pending.

Publication

aSpire: Clippable, Mobile Pneumatic-Haptic Device for Breathing Rate Regulation via Personalizable Tactile Feedback

Kyung Yun Choi, Jinmo Lee, Neska El Haouij, Rosalind W. Picard, and Hiroshi Ishii. 2021. aSpire: Clippable, Mobile Pneumatic-Haptic Device for Breathing Rate Regulation via Personalizable Tactile Feedback. In CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI ’21 Extended Abstracts), May 8–13, 2021, Yokohama, Japan. ACM, New York, NY, USA, 7 pages.

Publication

Shaping Habit Formation Insights with Shapley Values: Towards an Explainable AI-system for Self-understanding and Health Behavior Change

Lewis, Robert, et al. "Shaping Habit Formation Insights with Shapley Values: Towards an Explainable AI-system for Self-understanding and Health Behavior Change." CHI 2021 Workshop Paper. Realizing AI in Healthcare: Challenges Appearing in the Wild.

Publication

Monitoring Changes in Depression Severity Using Wearable and Mobile Sensors

Pedrelli, P., Fedor, S., Ghandeharioun, A., Howe, E., Ionescu, D. F., Bhathena, D., ... & Picard, R. W. (2020). Monitoring changes in depression severity using wearable and mobile sensors. Frontiers in psychiatry, 11, 1413.

Publication

Personalized Modeling of Real-World Vocalizations from Nonverbal Individuals

Narain, J.*, Johnson, K.T.*, Ferguson, C., O’Brien, A., Talkar, T., Zhang, Y., Wofford, P., Quatieri, T., Picard, R.W.,Maes, P., "Personalized Modeling of Real-World Vocalizations from Nonverbal Individuals," Proceedings of the International Conference on Multimodal Interaction (ICMI), Utrecht, Netherlands, October 2020. (*Co-first authors/Equal contribution)

Publication

Advancing Neuroscience through Wearable Devices

Johnson, K.T. & Picard, R.W. (2020). Advancing Neuroscience through Wearable Devices. Neuron 108(1), 8-12.

Publication

A Robotic Positive Psychology Coach to Improve College Students’ Wellbeing

Jeong, Sooyeon, et al. "A Robotic Positive Psychology Coach to Improve College Students’ Wellbeing." Proceedings of the 29th IEEE International Conference on Robot and Human Interactive Communication (Ro-Man 2020) **Best Paper Award**

Publication

Driver Emotion Recognition for Intelligent Vehicles: A Survey

Sebastian Zepf, Javier Hernandez, Alexander Schmitt, Wolfgang Minker, and Rosalind W. Picard. 2020. Driver Emotion Recognition for Intelligent Vehicles: A Survey. ACM Comput. Surv. 53, 3, Article 64 (June 2020), 30 pages. DOI:https://doi.org/10.1145/3388790

Publication

Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism

Narain, J.*, Johnson, K.T.*, O’Brien, A., Wofford, P., Maes, P., Picard, R.W. "Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism," Proceedings of the Workshop on Laughter and Other Nonverbal Vocalisations, Bielefeld, Germany, October 2020. (*Co-first authors/Equal contribution)

Publication

Forecasting Mental Distress using Healthcare Claims Data

Taylor, Sara. Forecasting Mental Distress using Healthcare Claims Data. 2020. MIT, PhD dissertation.

Publication

Augmenting Natural Communication in Nonverbal Individuals with Autism

Johnson, K.T.* & Narain, J.*, Maes, P., Picard, R.W., "Augmenting Natural Communication in Nonverbal Individuals with Autism," International Society for Autism Research (INSAR), Seattle, Washington, May 2020. (*Co-first authors/equal contribution)

Publication

The ECHOS Platform to Enhance Communication for Nonverbal Children with Autism: A Case Study

Johnson, K.T.*, Narain, J.*, Ferguson, C., Picard, R.W., and Maes, P. The ECHOS Platform to Enhance Communication for Nonverbal Children with Autism: A Case Study. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Case Studies Track of CHI 2020). (*Co-first authors/Equal contribution)

Publication

EmpathicGPS: Exploring the Role of Voice Tonality in Navigation Systems during Simulated Driving

Sebastian Zepf, Neska ElHaouij, Wolfgang Minker, Javier Hernandez, and Rosalind W. Picard. 2020. EmpathicGPS: Exploring the Role of Voice Tonality in Navigation Systems during Simulated Driving. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1–7. DOI:https://doi.org/10.1145/3334480.338293

Publication

Hierarchical reinforcement learning for open-domain dialog

Saleh, A.*, Jaques, N.*, Ghandeharioun, A., Shen, J. H., & Picard, R. (2020). Hierarchical reinforcement learning for open-domain dialog. AAAI 2020.

Publication

Towards Assessing and Recommending Combinations of Behaviors for Improving Health and Well-Being

Nosakhare, E., and Picard. R. 2019. Toward Assessing and Recommending Combinations of Behaviors for Improving Health and Well-Being. ACM Trans. Comput. Healthcare 1, 1, Article 4 (December 2019), 29 pages.

Publication

Holistic Affect Recognition using PaNDA: Paralinguistic Non-metric Dimensional Analysis

Zhang Y, Weninger F, Schuller B, Picard R "Holistic Affect Recognition using PaNDA: Paralinguistic Non-metric Dimensional Analysis." IEEE Transactions on Affective Computing, December 2019.

Publication

Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data

Narain, J.*, Johnson, K.T.*, Picard, R.W., Maes, P. "Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data," NeurIPS Workshop on AI for Social Good, December 2019. (*Co-first authors/Equal contribution)

Publication

Detection of Real-World Driving-Induced Affective State Using Physiological Signals and Multi-View Multi-Task Machine Learning

Lopez-Martinez, Daniel, Neska Elhaouij, and Rosalind Picard. "Detection of Real-world Driving-induced Affective State Using Physiological Signals and Multi-view Multi-task Machine Learning." In 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), pp. 356-361. IEEE, 2019.

Publication

Way off-policy batch deep reinforcement learning of implicit human preferences in dialog

Jaques N., Ghandeharioun, A., Shen, J., Ferguson, C., Jones, N., Lapedriza, A., Gu, S., Picard, R. (2019). Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialog, NeurIPS workshop, Conversational AI.

Publication

Approximating interactive human evaluation with self-play for open-domain dialog systems

Ghandeharioun, A.*, Shen, J. H.*, Jaques, N.*, Ferguson, C., Jones, N., Lapedriza, A., & Picard, R. (2019). Approximating interactive human evaluation with self-play for open-domain dialog systems. In Advances in Neural Information Processing Systems (pp. 13658-13669).

Publication

Characterizing Sources of Uncertainty to Proxy Calibration and Disambiguate Annotator and Data Bias

Ghandeharioun, A., Eoff, B., Jou, B., & Picard, R. W. (2019). Characterizing Sources of Uncertainty to Proxy Calibration and Disambiguate Annotator and Data Bias. arXiv preprint arXiv:1909.09285.

Publication

Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks

Umematsu, T., Sano, A., Taylor, S., and Picard, R. "Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks.", 2019 IEICE Society Conference, Japan, September 2019.

Publication

EMMA: An Emotion-Aware Wellbeing Chatbot

A. Ghandeharioun, D. McDuff, M. Czerwinski and K. Rowan, "EMMA: An Emotion-Aware Wellbeing Chatbot," 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII), Cambridge, United Kingdom, 2019, pp. 1-7.

Publication

Towards Understanding Emotional Intelligence for Behavior Change Chatbots

A. Ghandeharioun, D. McDuff, M. Czerwinski and K. Rowan, "Towards Understanding Emotional Intelligence for Behavior Change Chatbots," 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII), Cambridge, United Kingdom, 2019, pp. 8-14.

Publication

Engineering Music to Slow Breathing and Invite Relaxed Physiology

Leslie, G.*, Ghandeharioun, A.*, Zhou, D., & Picard, R. W. (2019, September). Engineering Music to Slow Breathing and Invite Relaxed Physiology. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII) (pp. 1-7). IEEE.

Publication

Automatic Triage and Analysis of Online Suicide Risk with Document Embeddings and Latent Dirichlet Allocation

Jones, N., Jaques, N., Pataranutaporn, P., Ghandeharioun, A., & Picard, R. (2019, September). Analysis of Online Suicide Risk with Document Embeddings and Latent Dirichlet Allocation. In 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) (pp. 1-5). IEEE.

Publication

Multi-modal Active Learning From Human Data: A Deep Reinforcement Learning Approach

Rudovic, O., Zhang, M, Schuller, B., Picard, R. "Multi-modal Active Learning From Human Data: A Deep Reinforcement Learning Approach", In 2019 International Conference on Multimodal Interaction (ICMI ’19), October 14–18, 2019, Suzhou, China. ACM, New York, NY, USA.

Publication

Probabilistic Latent Variable Modeling for Assessing Behavioral Influences on Well-Being

Nosakhare, E., Picard, R. W. Probabilistic Latent Variable Modeling for Assessing Behavioral Influences on Well-Being," ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD ’19), August 4–8, 2019, Anchorage, AK, USA. ACM, New York, NY, USA. https://doi.org/10.1145/3292500.3330738

Publication

Meta-weighted Gaussian Process Experts for Personalized Forecasting of AD Cognitive Changes

Rudovic, O., Utsumi, Y., Guerrero, R., Peterson, K., Rueckert, D., Picard, R. W. "Meta-weighted Gaussian Process Experts for Personalized Forecasting of AD Cognitive Changes" Machine Learning for Healthcare Conference (ML4HC2019), August 2019.

Publication

Daytime Data and LSTM can Forecast Tomorrow's Stress, Health, and Happiness

Umematsu, T., Sano, A., and Picard, R. "Daytime Data and LSTM can Forecast Tomorrow's Stress, Health, and Happiness," the 41st International Engineering in Medicine and Biology Conference (EMBC), p.2186-2190, Berlin, July 2019.

Publication

Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks

Umematsu, T., Sano, A., Taylor, S., and Picard, R. "Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks." IEEE International Conference on Biomedical and Health Informatics (BHI), Chicago, Illinois, May 2019. (BEST PAPER AWARD - 1st Prize)

Publication

Towards Empathetic Car Interfaces: Emotional Triggers while Driving

Zepf, S., Dittrich, M., Hernandez, J., Schmitt, A. "Towards Empathetic Car Interfaces: Emotional Triggers while Driving," In the Late Breaking Work of CHI, Glasgow, UK, May 2019.

Publication

Deep Reinforcement Learning for Optimal Critical Care Pain Management with Morphine using Dueling Double-Deep Q Networks

Lopez-Martinez D, Eschenfeldt P, Ostvar S, Ingram M, Hur C, Picard R. Deep Reinforcement Learning for Optimal Critical Care Pain Management with Morphine using Dueling Double-Deep Q Networks, in Engineering in Medicine and Biology (EMBC). Berlin, Germany ; 2019.

Publication

Personalized Estimation of Engagement from Videos Using Active Learning with Deep Reinforcement Learning

Rudovic, O., Park, H-W., Busche, J., Schuller, B. , Breazeal, C., Picard, R. W., " Personalized Estimation of Engagement from Videos Using Active Learning with Deep Reinforcement Learning," IEEE CVPR -AMFG W, June 2019.

Publication

Stress measurement using speech: Recent advancements, validation issues, and ethical and privacy considerations

Slavich G.M., Taylor S., Picard R.W. "Stress measurement using speech: Recent advancements, validation issues, and ethical and privacy considerations," Stress, 2019.

Publication

A Generic Human–Machine Annotation Framework Based on Dynamic Cooperative Learning

Zhang Y, Michi A, Wagner J, Andre E, Schuller B, Weninger F. "A Generic Human-Machine Annotation Framework Based on Dynamic Cooperative Learning." IEEE Transactions on Cybernetics, March 2019.

Publication

Use of In-Game Rewards to Motivate Daily Self-Report Compliance: Randomized Controlled Trial

Taylor S., Ferguson C., Peng F., Schoeneich M., Picard R.W. "Use of In-Game Rewards to Motivate Daily Self-Report Compliance: Randomized Controlled Trial," Journal of Medical Internet Research, 21(1), e11683, 2019.

Publication

Wearable Motion-based Heart-rate at Rest: A Workplace Evaluation

Hernandez J., McDuff D., Quigley K., Maes P., and Picard R., "Wearable Motion-based Heart-rate at Rest: A Workplace Evaluation," Journal of Biomedical and Health Informatics, 2018.

Publication

CultureNet: A Deep Learning Approach for Engagement Intensity Estimation from Face Images of Children with Autism

Rudovic, O., Utsumi, Y., Lee, J., Hernandez, J., Castello Ferrer, E., Schuller, B., Picard, R. "CultureNet: A Deep Learning Approach for Engagement Intensity Estimation from Face Images of Children with Autism." IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018).

Publication

Characterizing Electrodermal Activity Using Point Processes in Young Children

Subramanian, S., Barbieri, R., Johnson, K.T., Brown, E. "Characterizing Electrodermal Activity Using Point Processes in Young Children," 50th Annual Meeting of the Biomedical Engineering Society (BMES), Atlanta, Georgia, October 2018.

Publication

Intrinsic Social Motivation via Causal Influence in Multi-Agent RL

Jaques, N., Lazaridou, A., Hughes, E., Gulcehre, C., Ortega, P. A., Strouse, D. J., Leibo, J. Z., and de Freitas, N. "Intrinsic Social Motivation via Causal Influence in Multi-Agent RL," International Conference on Representation Learning (ICLR), New Orleans, Louisiana, May 2019 (submitted).