Research
Opera of the Future

Extending expression, learning, and health through innovations in musical composition, performance, and participation
Article Research

This new mental health app gamifies doing simple actions that make you happy

Craig Ferguson discusses Paradise Island, Affective Computing's new game for mental health.
Research
Fluid Interfaces

Designing Systems for Cognitive Support
Project Research

Project Us

“Us” aims to help people develop their sense of empathy. It uses machine learning to analyze interlocutors’ signals (e.g., choice of words,…
Project Research

Emotion Navigation

Before automobiles were invented and widely adopted, animals like horses were the most common mode of transportation. While this change bro…
Project Research

Teddy

Teddy is a cutting edge data collection platform available for both Android and iOS that lets you collect data from study participants in a…
Research
Personal Robots

Building intelligent personified technologies that collaborate with people to help them learn, thrive, and flourish.
Project Research

Privacy-Preserving Depressive Symptoms Estimation

The goal of this project is to develop techniques to remove identifying information from wearable and phone data to protect patients’ priva…
Archived
Archived
Project Research

Adaptive Music for Affect Improvement

Adaptive Music for Affect Improvement (AMAI) is a music generation and playback system with the goal of steering the listener toward a stat…
Archived
Project Research

aSpire: Clippable, Mobile Pneumatic-Haptic Device for Breathing Rate Regulation via Personalizable Tactile Feedback

We introduce–aSpire–a clippable, mobile pneumatic-haptic device designed to help users regulate their breathing rate via subtle tactile fee…
Research
Affective Computing

Advancing human wellbeing by developing new ways to communicate, understand, and respond to emotion
Project Research

The Guardians
Archived
Project Research

EmotionalBeasts

With advances in virtual reality (VR) and physiological sensing technology, even more immersive computer-mediated communication through lif…
Archived
Archived
Project Research

UncNet: Modeling uncertainty in deep learning for inherently subjective tasks

Automatic emotion recognition has become a well-established machine learning task in recent years. The sensitive and subjective nature of e…
Archived
Archived
Project Research

PAL: Project on Affinities + Language

The Project on Affinities and Language (PAL) is designed to help us understand what happens in a child’s brain when they engage with their …
Archived
Project Research

Learning via Social Awareness: Improving sketch representations with facial feedback

In the quest towards general artificial intelligence (AI), researchers have explored developing loss functions that act as intrinsic motiva…
Archived
Project Research

Improving Wellbeing for Office Workers

Excessive stress can decrease office workers' productivity and negatively impact overall health. This project aims to predict office worker…
Archived
Archived
Project Research

BrainBeat: Breath-based music therapy

Can we sonfiy calming breathing and passively influence a state of calm?Deep breathing has been scientifically proven to affect the heart, …
Archived
Archived
Project Research

Personalized Machine Learning for Future Health

​The view on Alzheimer’s Disease (AD) diagnosis has shifted towards a more dynamic process in which clinical and pathological markers evolv…
Archived
Archived
Project Research

WorldBeat: Hearing the world differently

Can we modulate the way we hear the world around us to make it more calming or to induce focus? While technology is usually associated with…
Archived
Archived
Project Research

Personalized Animated Movies

Storytelling is a fundamental way in which human beings understand the world. Imagine watching a movie telling the story of your life, how …
Archived
Archived
Project Research

Machine Learning for Pain Measurement

Pain is a subjective experience commonly measured through patients' self reports. Unfortunately, self-report measures only work when t…
Archived
Archived
Project Research

Behavioral Indications of Depression Severity

In collaboration with Massachusetts General Hospital, we are conducting a clinical trial exploring objective methods for assessing depressi…
Archived
Archived
Project Research

Personalized Machine Learning for Autism Therapy

EngageME: Personalized machine learning and humanoid robots for measuring affect and engagement of children with autismEngageME is a projec…
Archived
Project Research

Modulating peripheral and cortical arousal using a musical motor response task

We are conducting EEG studies to identify the musical features and musical interaction patterns that universally impact measures of arousal…
Archived
Archived
Project Research

SPRING: A Smart Platform for Research, Intervention, and Neurodevelopmental Growth

SPRING is a custom-built hardware and software platform for children with neuro-differences. The system automates data acquisition, optimiz…
Archived
Archived
Project Research

Predicting students' wellbeing from physiology, phone, mobility, and behavioral data

The goal of this project is to apply machine learning methods to model the wellbeing of MIT undergraduate students. Extensive data is obtai…
Archived
Project Research

An EEG and motion-capture based expressive music interface for affective neurofeedback

This project examines how the expression granted by new musical interfaces can be harnessed to create positive changes in health and wellbe…
Archived
Article Research

MIT Chalk Radio: AI Literacy for All with Prof. Cynthia Breazeal

Social robotics pioneer Prof. Cynthia Breazeal discusses artificial intelligence in our lives, digital citizenship, and AI education for all
Research
RAISE

RAISE
Post Research

Picard, Choudhoury, and Schiele Named 2021 ACM Fellows

Fellowship program honors ACM members whose specific accomplishments drive innovation and make broader advances possible.
Article Research

Deploying machine learning to improve mental health

MIT scientist Rosalind Picard collaborates with clinicians to develop tools for mental health care delivery.
Publication Research

Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health

Taylor, S.*, Jaques, N.*, Nosakhare, E., Sano, A. and Picard, R., "Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health," in IEEE Transactions on Affective Computing, vol. PP, no. 99, pp. 1-1. doi: 10.1109/TAFFC.2017.2784832 *Both authors contributed equally. WINNER: BEST OF COLLECTION
Article Research

What every engineer and computer scientist should know: The biggest contributor to happiness

Rosalind Picard presents some principles that engineers and computer scientists can use to create meaningful, authentic human relationships.
Archived
Project Research

QuantifyMe

Unlike traditional randomized controlled trials that generalize relationships in large groups of people, single-case experiments seek to qu…
Archived
Archived
Project Research

ELSA: Empathy learning, socially-aware agents

What is ELSA?ELSA is an AI-powered chatbot that acts as an empathetic companion, encouraging users to talk about their day through a form o…
Archived
Article Research

When AI Recognizes Emotion, with Rosalind Picard

John Ellis talks to Affective Computing head Rosalind Picard about making AI and computers more emotionally intelligent.
Project Research

iNonymize: Empathetic Anonymity in Tele-Mental Health Using AI Generated Avatars

This project was selected to represent MIT at the Microsoft Design Expo 2020 on ‘Healthier Futures.’ iNonymizeA tele-mental health pla…
Project Research

Essence Wearables: Biometric Olfactory Interfaces for Day and Night

Human-computer interaction (HCI) has traditionally focused on designing and investigating interfaces that provide explicit visual, auditory…
Project Research

dementAI

 dementAI is an open-source platform for modeling risk stratification of Alzheimer's dementia using spontaneous speech through a …
Project Research

Leveraging artificial intelligence for the assessment of severity of depressive symptoms

This project is supported by the Abdul Latif Jameel Clinic for Machine Learning in Health (J-Clinic), the National Institutes of Healt…
Publication Research

Multimodal Inductive Transfer Learning for Detection of Alzheimer's Dementia and its Severity

@article{sarawgi2020multimodal, title={Multimodal Inductive Transfer Learning for Detection of Alzheimer's Dementia and its Severity}, author={Sarawgi, Utkarsh and Zulfikar, Wazeer and Soliman, Nouran and Maes, Pattie}, journal={arXiv preprint arXiv:2009.00700}, year={2020} }
Publication Research

Uncertainty-Aware Multi-Modal Ensembling for Severity Prediction of Alzheimer's Dementia

@misc{sarawgi2020uncertaintyaware, title={Uncertainty-Aware Multi-Modal Ensembling for Severity Prediction of Alzheimer's Dementia}, author={Utkarsh Sarawgi and Wazeer Zulfikar and Rishab Khincha and Pattie Maes}, year={2020}, eprint={2010.01440}, archivePrefix={arXiv}, primaryClass={cs.LG} }
Article Research

Embracing neurodiversity to better understand autism

Using personalized, naturalistic experiments, the Gabrieli lab is pioneering new approaches to neurodevelopmental differences.
Project Research

Affective Robotic Ring

An affective robotic ring which allows users to interact with multiple robots using finger gestures.- Runs on Robotic Operating System (ROS…
Digital Life
Archived
Project Research

BioEssence

A wearable olfactory display that monitors cardio-respiratory information with the aspiration to support mental wellbeing.BioEssence is a w…
Publication Research

Characterizing Sources of Uncertainty to Proxy Calibration and Disambiguate Annotator and Data Bias

Ghandeharioun, A., Eoff, B., Jou, B., & Picard, R. W. (2019). Characterizing Sources of Uncertainty to Proxy Calibration and Disambiguate Annotator and Data Bias. arXiv preprint arXiv:1909.09285.
Project Research

Jibo Social Robotic Research Platform

The Jibo Research Platform is an in-the-field deployable Social Robotics experimentation and data collection infrastructure. Built upon the…
Publication Research

AMAI: Adaptive Music for Affect Improvement

Su, D., Picard, R., Liu, Y. "AMAI: Adaptive Music for Affect Improvement." Proceedings of the 44th International Computer Music Conference (ICMC), Daegu, Korea, August 2018.
Archived
Project Research

Predicting Trust Between People

Machine learning model outperforms human judgementOur computational trust model is capable of predicting—above human accuracy—the degree of…
Archived
Archived
Project Research

Intentional Inference of Emotions

Emotion recognition modeled as a goal-directed process!
Archived
Archived
Project Research

Human-Robot Trust

Unconventional mixing of research fields introduces a new method to study human behavior using social robots.
Archived
Archived
Project Research

Artificial listener with social intelligence

A social robot modifies its behavior to change what you think about it!
Archived
Archived
Research
Advancing Wellbeing

Advancing Wellbeing
Article Research

Rosalind Picard: Affective Computing, Emotion, Privacy, and Health | Artificial Intelligence Podcast

In an interview with MIT research scientist Lex Fridman, Rosalind Picard discusses affective computing, privacy, diversity in tech, and more
Post Research

Affective Computing researchers win Best Paper Award at IEEE BHI 2019

"Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks," by Terumi Umematsu, Akane Sano, Sara Taylor, and&…
Project Research

Improving wellbeing prediction performance using temporal machine learning models

This project aims to improve the prediction accuracy of wellbeing (stress, mood, and health levels) using temporal machine learning models.…
Project Research

SNAPSHOT Study

The SNAPSHOT study seeks to measure Sleep, Networks, Affect, Performance, Stress, and Health using Objective Techniques. It is an NIH-funde…
Article Research

Computing Careers: Advice from Rosalind Picard on succeeding in the fast-growing field of "affective computing"

Affective Computing head Rosalind Picard talks to IEEE Computer Society for their series on careers in computing.
Archived
Project Research

MACH: My Automated Conversation coacH

MACH, My Automated Conversation coacH, is a system for people to practice social interactions in face-to-face scenarios. MACH consists of a…
Archived
Project Research

BrightBeat: Effortlessly influencing breathing for cultivating calmness and focus

The relationship between breathing and self-reported stress is bidirectional. Respiration pattern is an indicator of stress, but it can als…
Article Research

Emotion AI, explained

Senior leaders should consider how emotion AI could change their industries and play a critical role in their firms.
Article Research

Six MIT researchers elected to the National Academy of Engineering for 2019

Six MIT researchers are among the 86 new members and 18 foreign associates elected to the National Academy of Engineering.
Publication Research

Personalized Machine Learning for Robot Perception of Affect and Engagement in Autism Therapy

Rudovic, O., Lee, J., Dai, M., Schuller, B. , Picard, R. W., " Personalized machine learning for robot perception of affect and engagement in autism therapy," Science Robotics, June 2018.
Publication Research

Emotional Beasts: Visually Expressing Emotions through Avatars in VR

Bernal, Guillermo, and Pattie Maes. "Emotional Beasts: Visually Expressing Emotions through Avatars in VR." Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2017.
Project Research

Image Sentiment Analysis

 In this project we explore how to recognize and localize affect in images.
Archived
Project Research

Masque

 When the body senses itself internally and localizes its actions, it provides the basis for a material sense of self-existence. At th…
Archived
Article Research

Tech community wrestles over working with government

Hiawatha Bray reports on the unrest bubbling up in the tech industry.
Article Research

Personalized “deep learning” equips robots for autism therapy

Machine learning network offers personalized estimates of children’s behavior.