Advancing human wellbeing by developing new ways to communicate, understand, and respond to emotion

Groh, M., Sankaranarayanan, A., Singh, N. et al. Human detection of political speech deepfakes across transcripts, audio, and video. Nat Commun 15, 7629 (2024). https://doi.org/10.1038/s41467-024-51998-z

Geoffrey S. Ginsburg, Rosalind W. Picard, and Stephen H. Friend. "Key Issues as Wearable Digital Health Technologies Enter Clinical Care." New England Journal of Medicine 2024; 390:1118-27. DOI: 10.1056/NEJMra2307160

Elizabeth Donner, Orrin Devinsky, and Daniel Friedman; guest editors Stephen H. Friend, Geoffrey S. Ginsburg, Rosalind W. Picard, Jeffrey M. Drazen. "Wearable Digital Health Technology for Epilepsy." New England Journal of Medicine 2024; 390:736-745. DOI: 10.1056/NEJMra2301913

Groh, M., Badri, O., Daneshjou, R. et al. Deep learning-aided decision support for diagnosis of skin disease across skin tones. Nat Med (2024). https://doi.org/10.1038/s41591-023-02728-3

Vanderkruik RC, Ferguson C, Kobylski LA, Locascio JJ, Hamlett GE, Killenberg PC, Lewis R, Jones N, Rossa ET, Dineen H, Picard R, Cohen LS Testing a Behavioral Activation Gaming App for Depression During Pregnancy: Multimethod Pilot Study JMIR Form Res 2024;8:e44029

Erica S. Spatz, Geoffrey S. Ginsburg, John S. Rumsfeld, and Mintu P. Turakhia; guest editors Stephen H. Friend, Geoffrey S. Ginsburg, Rosalind W. Picard, Jeffrey M. Drazen. "Wearable Digital Health Technologies for Monitoring in Cardiovascular Medicine." New England Journal of Medicine 2024; 390:346-356. DOI: 10.1056/NEJMra2301903

Fedor, S., Lewis, R., Pedrelli, P., Mischoulon, D., Curtiss, J., & Picard, R. W. (2023). Wearable technology in clinical practice for depressive disorder. New England Journal of Medicine, 389(26), 2457-2466.

*Lewis, R. A., *Matton, K., Picard, R., & Guttag, J. (2023, December). Improving Domain Generalization in Contrastive Learning using Domain-Aware Temperature Control. In NeurIPS 2023 Workshop on Distribution Shifts: New Frontiers with Foundation Models & Neurips 2023 Workshop on Self-supervised Learning (*Equal contribution)

B. Zhang, W. V. Chen, G. Regalia, D. M. Goldenholz, and R. W. Picard, “Sleep deficiency is associated with higher next-day generalized tonic-clonic seizure risk”, in American Epilepsy Society 2023 Annual Meeting, 2023.

Friend, Stephen H., Geoffrey S. Ginsburg, and Rosalind W. Picard. "Wearable Digital Health Technology." New England Journal of Medicine 389.22 (2023): 2100-2101.

Michael S. Hughes, Ananta Addala, and Bruce Buckingham; guest editors Stephen H. Friend, Geoffrey S. Ginsburg, Rosalind W. Picard, Jeffrey M. Drazen. "Digital Technology for Diabetes." New England Journal of Medicine 2023; 389:2076-2086. DOI: 10.1056/NEJMra2215899

Kumar, I. K. (2023). FOSTERING WELL-BEING: Designing Technology to Improve the Psychological Well-being of Foster-Involved Youth (thesis).

Epstein, Hertzmann, et al. "Art and the science of generative AI." Science 380.6650 (2023): 1110-1111.

Kubzansky LD, Kim ES, Boehm JK, Davidson RJ, Huffman JC, Loucks EB, Lyubomirsky S, Picard RW, Schueller SM, Trudel-Fitzgerald C, VanderWeele TJ, Warran K, Yeager DS, Yeh CS, Moskowitz JT. Interventions to Modify Psychological Well-Being: Progress, Promises, and an Agenda for Future Research. Affect Sci. 2023 Mar 3;4(1):174-184. doi: 10.1007/s42761-022-00167-w. PMID: 37064816; PMCID: PMC9982781.

Coppersmith DDL, Wang SB, Kleiman EM, Maimone JS, Fedor S, Bentley KH, Millner AJ, Fortgang RG, Picard RW, Beck S, Huffman JC, Nock MK. Real-time Digital Monitoring of a Suicide Attempt by a Hospital Patient. General Hospital Psychiatry. 2023;80:35-39. doi: 10.1016/j.genhosppsych.2022.12.005

Contrastive Learning of Electrodermal Activity Representations for Stress Detection; Matton, K*, Lewis, R*, Guttag, J, Picard, R.W. Conference on Health, Inference, and Learning (CHIL) 2023. *Equal contribution

Groh, Matthew, Caleb Harris, Roxana Daneshjou, Omar Badri, and Arash Koochek. "Towards transparency in dermatology image datasets with skin tone annotations by experts, crowds, and an algorithm." CSCW (2022).

Groh, Matthew. "Identifying the Context Shift between Test Benchmarks and Production Data." arXiv preprint arXiv:2207.01059 (2022).

Groh, Matthew, Craig Ferguson, Robert Lewis, and Rosalind W. Picard. "Computational Empathy Counteracts the Negative Effects of Anger on Creative Problem Solving." In 2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 1-8. IEEE, 2022.

Richter-Lunn, K., & Krishna Kumar, I. (2022). Acu.ation: Real Time Acupoint Stimulation To Mediate The Urge To Smoke. Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems, 1–7. https://doi.org/10.1145/3491101.3519636

Can a Recommender System Support Treatment Personalisation in Digital Mental Health Therapy? A Quantitative Feasibility Assessment Using Data from a Behavioural Activation Therapy App, Lewis, R., Ferguson, F., Wilks, C., Jones, N., Picard, R.W.; CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI ’22 Extended Abstracts)

Matthew Groh, Ziv Epstein, Chaz Firestone, Rosalind Picard. "Deepfake detection by human crowds, machines, and machine-informed crowds." Proceedings of the National Academy of Sciences Jan 2022, 119 (1) e2110013119; DOI: 10.1073/pnas.2110013119

Schuller, Björn & Picard, Rosalind & Andre, Elisabeth & Gratch, Jonathan & Tao, Jianhua. (2021). Intelligent Signal Processing for Affective Computing [From the Guest Editors]. IEEE Signal Processing Magazine. 38. 9-11. 10.1109/MSP.2021.3096415.

Chiang S, Picard RW, Chiong W, Moss R, Worrell GA, Rao VR, Goldenholz DM. Guidelines for Conducting Ethical Artificial Intelligence Research in Neurology: A Systematic Approach for Clinicians and Researchers. Neurology. 2021 Sep 28;97(13):632-640. doi: 10.1212/WNL.0000000000012570. Epub 2021 Jul 27. PMID: 34315785; PMCID: PMC8480407.

Cristina Bustos, Neska Elhaouij, Albert Sole-Ribalta, Javier Borge-Holthoefer, Agata Lapedriza, and Rosalind Picard. "Predicting Driver Self-Reported Stress by Analyzing the Road Scene." in Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII 2021), preprint arXiv:2109.13225 (2021).

Sankaranarayanan, Aruna, Matthew Groh, Rosalind Picard, and Andrew Lippman. "The Presidential Deepfakes Dataset." (2021).

Onorati F, Regalia G, Caborni C, LaFrance WC Jr, Blum AS, Bidwell J, De Liso P, El Atrache R, Loddenkemper T, Mohammadpour-Touserkani F, Sarkis RA, Friedman D, Jeschke J, Picard R. Prospective Study of a Multimodal Convulsive Seizure Detection Wearable System on Pediatric and Adult Patients in the Epilepsy Monitoring Unit. Front Neurol. 2021 Aug 18;12:724904. doi: 10.3389/fneur.2021.724904. PMID:

Ferguson, C.* and Lewis, R.*, Wilks, C., Picard, R.W.; The Guardians: Designing a Game for Long-term Engagement with Mental Health Therapy; IEEE Conference of Games 2021. *Equal contribution

Robert Lewis, Yuanbo Liu, Matthew Groh and Rosalind Picard, "Habit Formation Dynamics: Finding Factors Associated with Building Strong Mindfulness Habits" HCI International 2021

R. Lewis, A. Ghandeharioun, S. Fedor, P. Pedrelli, R.W. Picard, D. Mischoulon, "Mixed Effects Random Forests for Personalised Predictions of Clinical Depression Severity", ICML 2021 Computational Approaches to Mental Health workshop

Rosalind W. Picard, Edward W. Boyer, Smartwatch biomarkers and the path to clinical use, Med, Volume 2, Issue 7, 2021, Pages 797-799, ISSN 2666-6340, https://doi.org/10.1016/j.medj.2021.06.005.

Nock, M. K., Kleiman, E. M., Abraham, M., Bentley, K. H., Brent, D. A., Buonopane, R. J., … Pearson, J. L. (2021). Consensus Statement on Ethical & Safety Practices for Conducting Digital Monitoring Studies with People at Risk of Suicide and Related Behaviors. Psychiatric Research and Clinical Practice, 3(2), 57–66. https://doi.org/10.1176/appi.prcp.20200029

Jinmo Lee, Neska Elhaouij, and Rosalind Picard. 2021. AmbientBreath: Unobtrusive Just-in-time Breathing Intervention Using Multi-sensory Stimulation and its Evaluation in a Car Simulator. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 2, Article 71 (June 2021), 30 pages. DOI:https://doi.org/10.1145/3463493

Groh, Matthew, Caleb Harris, Luis Soenksen, Felix Lau, Rachel Han, Aerin Kim, Arash Koochek, and Omar Badri. "Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Dataset." arXiv preprint arXiv:2104.09957 (2021). Accepted at CVPR ISIC 2021 workshop. Publication pending.

Kyung Yun Choi, Jinmo Lee, Neska El Haouij, Rosalind W. Picard, and Hiroshi Ishii. 2021. aSpire: Clippable, Mobile Pneumatic-Haptic Device for Breathing Rate Regulation via Personalizable Tactile Feedback. In CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI ’21 Extended Abstracts), May 8–13, 2021, Yokohama, Japan. ACM, New York, NY, USA, 7 pages.

Lewis, Robert, et al. "Shaping Habit Formation Insights with Shapley Values: Towards an Explainable AI-system for Self-understanding and Health Behavior Change." CHI 2021 Workshop Paper. Realizing AI in Healthcare: Challenges Appearing in the Wild.

McHill AW, Sano A, Hilditch CJ, Barger LK, Czeisler CA, Picard R, Klerman EB. Robust stability of melatonin circadian phase, sleep metrics, and chronotype across months in young adults living in real-world settings. J Pineal Res. 2021 Apr;70(3):e12720. doi: 10.1111/jpi.12720. Epub 2021 Feb 16. PMID: 33523499; PMCID: PMC9135480.

Regalia G, Gerboni G, Migliorini M, Lai M, Pham J, Puri N, Pavlova MK, Picard RW, Sarkis RA, Onorati F. Sleep assessment by means of a wrist actigraphy-based algorithm: agreement with polysomnography in an ambulatory study on older adults. Chronobiol Int. 2021 Mar;38(3):400-414. doi: 10.1080/07420528.2020.1835942. Epub 2020 Nov 19. Erratum in: Chronobiol Int. 2022 Jul;39(7):I. doi: 10.1080/0742052

Pedrelli, P., Fedor, S., Ghandeharioun, A., Howe, E., Ionescu, D. F., Bhathena, D., ... & Picard, R. W. (2020). Monitoring changes in depression severity using wearable and mobile sensors. Frontiers in psychiatry, 11, 1413.

Hedman E, Schoen SA, Miller LJ, Picard R. Wireless Measurement of Sympathetic Arousal During in vivo Occupational Therapy Sessions. Front Integr Neurosci. 2020 Oct 29;14:539875. doi: 10.3389/fnint.2020.539875. PMID: 33192351; PMCID: PMC7659428.

Narain, J.*, Johnson, K.T.*, Ferguson, C., O’Brien, A., Talkar, T., Zhang, Y., Wofford, P., Quatieri, T., Picard, R.W.,Maes, P., "Personalized Modeling of Real-World Vocalizations from Nonverbal Individuals," Proceedings of the International Conference on Multimodal Interaction (ICMI), Utrecht, Netherlands, October 2020. (*Co-first authors/Equal contribution)

Johnson, K.T. & Picard, R.W. (2020). Advancing Neuroscience through Wearable Devices. Neuron 108(1), 8-12.

Johnson, Kristina & Picard, Rosalind. (2020). Advancing Neuroscience through Wearable Devices. Neuron. 108. 8-12. 10.1016/j.neuron.2020.09.030.

Jeong, Sooyeon, et al. "A Robotic Positive Psychology Coach to Improve College Students’ Wellbeing." Proceedings of the 29th IEEE International Conference on Robot and Human Interactive Communication (Ro-Man 2020) **Best Paper Award**

Sebastian Zepf, Javier Hernandez, Alexander Schmitt, Wolfgang Minker, and Rosalind W. Picard. 2020. Driver Emotion Recognition for Intelligent Vehicles: A Survey. ACM Comput. Surv. 53, 3, Article 64 (June 2020), 30 pages. DOI:https://doi.org/10.1145/3388790

Narain, J.*, Johnson, K.T.*, O’Brien, A., Wofford, P., Maes, P., Picard, R.W. "Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism," Proceedings of the Workshop on Laughter and Other Nonverbal Vocalisations, Bielefeld, Germany, October 2020. (*Co-first authors/Equal contribution)

Taylor, Sara. Forecasting Mental Distress using Healthcare Claims Data. 2020. MIT, PhD dissertation.

Johnson, K.T.* & Narain, J.*, Maes, P., Picard, R.W., "Augmenting Natural Communication in Nonverbal Individuals with Autism," International Society for Autism Research (INSAR), Seattle, Washington, May 2020. (*Co-first authors/equal contribution)

Johnson, K.T.*, Narain, J.*, Ferguson, C., Picard, R.W., and Maes, P. The ECHOS Platform to Enhance Communication for Nonverbal Children with Autism: A Case Study. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Case Studies Track of CHI 2020). (*Co-first authors/Equal contribution)

Sebastian Zepf, Neska ElHaouij, Wolfgang Minker, Javier Hernandez, and Rosalind W. Picard. 2020. EmpathicGPS: Exploring the Role of Voice Tonality in Navigation Systems during Simulated Driving. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1–7. DOI:https://doi.org/10.1145/3334480.338293

Saleh, A.*, Jaques, N.*, Ghandeharioun, A., Shen, J. H., & Picard, R. (2020). Hierarchical reinforcement learning for open-domain dialog. AAAI 2020.

Nosakhare, E., and Picard. R. 2019. Toward Assessing and Recommending Combinations of Behaviors for Improving Health and Well-Being. ACM Trans. Comput. Healthcare 1, 1, Article 4 (December 2019), 29 pages.

Zhang Y, Weninger F, Schuller B, Picard R "Holistic Affect Recognition using PaNDA: Paralinguistic Non-metric Dimensional Analysis." IEEE Transactions on Affective Computing, December 2019.

Y. Zhang, F. Weninger, B. Schuller and R. W. Picard, "Holistic Affect Recognition Using PaNDA: Paralinguistic Non-Metric Dimensional Analysis," in IEEE Transactions on Affective Computing, vol. 13, no. 2, pp. 769-780, 1 April-June 2022, doi: 10.1109/TAFFC.2019.2961881.

Zhang, Yue & Weninger, Felix & Schuller, Björn & Picard, Rosalind. (2019). Holistic Affect Recognition Using PaNDA: Paralinguistic Non-Metric Dimensional Analysis. IEEE Transactions on Affective Computing. PP. 1-1. 10.1109/TAFFC.2019.2961881.

Narain, J.*, Johnson, K.T.*, Picard, R.W., Maes, P. "Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data," NeurIPS Workshop on AI for Social Good, December 2019. (*Co-first authors/Equal contribution)

Lopez-Martinez, Daniel, Neska Elhaouij, and Rosalind Picard. "Detection of Real-world Driving-induced Affective State Using Physiological Signals and Multi-view Multi-task Machine Learning." In 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), pp. 356-361. IEEE, 2019.

Jaques N., Ghandeharioun, A., Shen, J., Ferguson, C., Jones, N., Lapedriza, A., Gu, S., Picard, R. (2019). Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialog, NeurIPS workshop, Conversational AI.

Ghandeharioun, A.*, Shen, J. H.*, Jaques, N.*, Ferguson, C., Jones, N., Lapedriza, A., & Picard, R. (2019). Approximating interactive human evaluation with self-play for open-domain dialog systems. In Advances in Neural Information Processing Systems (pp. 13658-13669).