Creative Commons
Attribution-NonCommercial-NoDerivatives 4.0 International
MIT Media Lab
One of the principal benefits of counterfactual explanations is allowing users to explore "what-if" scenarios through what does not and c...
The purpose of this study is to investigate possible neural correlates of electrodermal activity. Electrodermal activity (EDA) is a...
Automatic emotion recognition has become a well-established machine learning task in recent years. The sensitive and subjective nature of...
The Project on Affinities and Language (PAL) is designed to help us understand what happens in a child’s brain when they engage with thei...
In the quest towards general artificial intelligence (AI), researchers have explored developing loss functions that act as intrinsic moti...
Excessive stress can decrease office workers' productivity and negatively impact overall health. This project aims to predict office work...
The view on Alzheimer’s Disease (AD) diagnosis has shifted towards a more dynamic process in which clinical and pathological markers evo...
Can we sonfiy calming breathing and passively influence a state of calm?Deep breathing has been scientifically proven to affect the heart...
Cube Puzzles: A tangible platform for dynamic assessment of cognitive and psychomotor skillsCognitive and psychomotor assessments are a ...
The delivery of mental health interventions via ubiquitous devices has shown a lot of promise. A natural conversational interface that al...
Can we modulate the way we hear the world around us to make it more calming or to induce focus? While technology is usually associated wi...
The explosion of mHealth in both abundant and resource-constrained countries is both a cause for celebration and for concern. While ...
More information coming soon.
Many drugs, such as monoclonal antibodies, are administrated using parenteral delivery devices via subcutaneous injections. Unfortunately...
This project seeks to examine the effects of altered gravity on an individual’s physiology during parabolic flight. Specifically, we will...
This project investigates a general method for improving the structure and quality of sequences generated by a recurrent neural network (...
Pain is a subjective experience commonly measured through patients' self reports. Unfortunately, self-report measures only work when...
Storytelling is a fundamental way in which human beings understand the world. Imagine watching a movie telling the story of your life, ho...
In collaboration with Massachusetts General Hospital, we are conducting a clinical trial exploring objective methods for assessing depres...
EngageME: Personalized machine learning and humanoid robots for measuring affect and engagement of children with autismEngageME is a proj...
We show that using thin slices (< 1 minute) of facial expression and body language data, we can train a deep neural network to predict...
Animated GIFs are widely used on the Internet to express emotions, but automatic analysis of their content is largel...
Individuals with autism are known to have difficulties connecting with other people, reciprocating social interactions, and being emotion...
SPRING is a custom-built hardware and software platform for children with neuro-differences. The system automates data acquisition, optim...
We are conducting EEG studies to identify the musical features and musical interaction patterns that universally impact measures of arous...
This study aims to bring objective measurement to the multiple "pulse" and "pulse-like" measures made by practitioners of traditional Chi...
This study attempts to examine humans' affective responses to superimposed sinusoidal signals. These signals can be perceived either thro...
Electrodermal Activity (EDA) is a physiological indicator of stress and strong emotion. While an increasing number of wearable devices ca...
We have designed a novel system to promote kindness and gratitude. We leverage pervasive technologies to naturally embed gratitude inspir...
Mental wellbeing is intimately tied to both social support and physical activity. The Challenge is a tool aimed at promoting social conne...
Electrodermal activity (EDA) recording is a powerful, widely used tool for monitoring psychological or physiological arousal. However, an...
The goal of this project is to apply machine learning methods to model the wellbeing of MIT undergraduate students. Extensive data is obt...
This project examines how the expression granted by new musical interfaces can be harnessed to create positive changes in health and well...
We are developing statistical tools for understanding, modeling, and predicting self-harm by using advanced probabilistic graphical model...
The proliferation of smartphones and wearable sensors is creating very large data sets that may contain useful information. However, the ...
We explore advanced machine learning and reflective user interfaces to scale the national Crisis Text Line. We are using state-of-the-art...
With the LEGO Group and Hasbro, we looked at the emotional experience of playing with games and LEGO bricks. We measured participants' sk...
What is ELSA?ELSA is an AI-powered chatbot that acts as an empathetic companion, encouraging users to talk about their day through a form...
Unlike traditional randomized controlled trials that generalize relationships in large groups of people, single-case experiments seek to ...
A common practice in Traditional Chinese Medicine (TCM) is visual examination of the patient's tongue. This study will examine ways to ma...
Stories, language, and art are at the heart StoryScape. While StoryScape began as a tool to meet the challenging language learning needs ...
The wide availability of low-cost, wearable, biophysiological sensors enables us to measure how the environment and our experiences impac...
Panoply is a crowdsourcing application for mental health and emotional wellbeing. The platform offers a novel approach to computer-based ...
Opioid therapy is the cornerstone of management of pain in the ICU. However, opioids present numerous side effects and are highly addicti...
Occupational stress can be described as a harmful emotional and physical response that occurs when high demanding job conditions cannot b...
Physiological arousal is an important part of occupational therapy for children with autism and ADHD, but therapists do not have a way to...
The Hol-Deep-Sense project (funded by the EU’s Horizon 2020 Marie Skłodowska-Curie grant) aims at holistic machine perception o...
We are developing a mobile phone-based platform to assist people with chronic diseases, panic-anxiety disorders, or addictions. Making us...
We are performing long-term measurements of autonomic nervous system (ANS) activity on patients with epilepsy. In certain cases, autonomi...
Teaching multiple AI agents to coordinate their behavior represents a challenging task, that can be difficult to achieve without training...
OverviewWe have created a new customizable, multi-user research-through-play platform designed to facilitate social skill development for...
In this project, we aim to examine the interplay between the brain and body using physiological sensors and functional magnetic resonance...
Project OverviewDepression is one of the most prevailing health problems in the world. Many recent publications have provided statistics ...
We are applying learnings from the SNAPSHOT study to the problem of changing behavior, exploring the design of user-centered tools which ...
Current methods to assess depression and then ultimately select appropriate treatment have many limitations. They are usually based on ha...
Complex and expensive medical devices are mainly used in medical facilities by health professionals. IDA is an attempt to disrupt this pa...
You can test whether a website is usable by making wire frames, but how do you know if that site, product, or store is emotionally engagi...
SmileTracker is a system designed to capture naturally occurring instances of positive emotion during the course of normal interaction wi...
A smile is a multi-purpose expression. We smile to express rapport, polite disagreement, delight, sarcasm, and often, even frustration. I...
MACH, My Automated Conversation coacH, is a system for people to practice social interactions in face-to-face scenarios. MACH consists of...
With skin conductance sensors, we map out what frustrates and excites customers as they shop�from layout to wanting to touch the product....
Got Sleep? is an Android application to help people to be aware of their sleep-related behavioral patterns and tips about how they should...
Working with the New World Symphony, we measured participant skin conductance as they attended a classical concert for the first time. Wi...
What do customers really think about your company or brand? Using skin conductance sensors, we measure what excites and frustrates custom...
This work builds on our earlier work with FaceSense, created to help automate the understanding of facial expressions, both cognitive and...
Can we recognize stress, mood, and health conditions from wearable sensors and mobile-phone usage data? We analyze long-term, multi-modal...
Persons on the autism spectrum often report hypersensitivity to sound. Efforts have been made to manage this condition, but there is wide...
We are examining autonomic sleep patterns using a wrist-worn biosensor that enables comfortable measurement of skin conductance, skin tem...
Cardiocam is a low-cost, non-contact technology for measurement of physiological signals such as heart rate and breathing rate using a ba...
Social-emotional communication difficulties lie at the core of autism spectrum disorders, making interpersonal interactions overwhelming,...
People express and communicate their mental states–such as emotions, thoughts, and desires–through facial expressions, vocal nuances, ges...
This project aims to build a modular lighting system where users can customize the design and lighting patterns.
Emotions are often conveyed through gesture. Instruments that respond to gestures offer musicians new, exciting modes of musical expressi...
How can we better understand people�s emotional experiences with a product or service? Traditional interview methods require people to re...
Frame It is an interactive, blended, tangible-digital puzzle game intended as a play-centered teaching and therapeutic tool. Current work...
Individuals diagnosed with autism spectrum disorder (ASD) often have intense, focused interests. These interests, when harnessed properly...
We are looking at the emotional experience created when children learn games. Why do we start games with the most boring part, reading di...
Have you ever wondered what makes an ad memorable? We have performed a comprehensive review of literature concerning advertising, memory,...
We propose a set of customizable, easy-to-understand, and low-cost physiological toolkits in order to enable people to visualize and util...
To help people improve their reading of faces during natural conversations, we developed a video tool to evaluate this skill. We collecte...
A small number of studies support the notion of a functional relationship between movement stereotypy and arousal in individuals with ASD...
We are automating recognition of positive/negative experiences (valence) and affect from facial expressions. We present a toolkit, Acume,...
We have been developing comfortable, safe, attractive physiological sensors that infants can wear around the clock to wirelessly communic...
We are characterizing changes in autonomic nervous system (ANS) during sleep. This can potentially provide insight into circadian rhythms...
We have developed a low-cost device that can wirelessly detect a beating heart over a short distance (1m) and does not require any sensor...
We are developing wearable sensors that measure cardiovascular parameters such as heart rate and heart rate variability (HRV) in real tim...
Companies would like more new products to be successful in the marketplace, but current evaluation methods such as focus groups do not ac...
Affect as Index is a tool that takes group physiological data as input, aggregates it across different demographic dimensions, and attach...
Recent findings in affective neuroscience and psychology indicate that human affect and emotional experience play a significant and usefu...
People who have difficulty communicating verbally (such as many people with autism) sometimes send nonverbal messages that do not match w...
We have developed a novel market game, Prediction Game and Experience Sharing (PreGES, pronounced PreGuess), that harnesses people's coll...
Light is an important factor in the regulation of all kinds of circadian rhythms in our body, such as heart rate, blood pressure, digesti...
In this research, a proactive emotional health system, geared toward supporting emotional self-awareness and empathy, was built as a part...
This project develops new theory and algorithms to enable computers to make rapid and accurate inferences from multiple modes of data, su...
Humans need sleep, along with food, water, and oxygen, to survive. With about one-third of our lives spent sleeping, there has been incre...
We are exploring innovative use of cell-phone Bluetooth technologies for consumer research and customer measurement. We have developed a...
SmileSeeker is a novel, machine-vision system that captures and provides quantified information about nonverbal communication where socia...
How can technology help us understand ourselves better? In order to measure the physiological arousal of children with sensory challenges...
In collaboration with the Early Childhood Cognition Center at MIT BCS, we are developing sensor-enabled toys and infant affect sensors wi...
A robotic computer that moves its monitor "head" and "neck," but that has no explicit face, is being designed to interact with users in a...
Shybot is a personal mobile robot designed to both embody and elicit reflection on shyness behaviors. Shybot is being designed to detect ...
While modern communication technologies mean that we can connect to more people, these connections lack the affective subtleties inherent...
Sometimes learners have to focus while experiencing strong emotions (e.g., family problems).�They may also face challenges in perserverin...
The Self-Cam is a wearable camera apparatus that consists of a chest-mounted camera aimed at the wearer�s face. Self-Cam was designed to ...
The wonder that occurs while watching a good magic trick or admiring a gorgeous natural vista is a strong emotion that has not been well ...
As the population ages, acuity in one or more sensory channels often diminishes or may be totally lost. Augmenting or compensating for lo...
Given motion capture samples of Charlie Chaplin's walk, is it possible to synthesize other motions�say, ascending or descending stairs�in...
The Emotion Bottles are tangibly enticing objects that embody three emotions: angry, happy, and sad. When a bottle is opened, a vocal ou...
The technology in this project changes facial expressions in videos without the system knowing anything in particular about the person's ...
HandWave is a small, wireless, networked skin conductance sensor that can be worn or used in many different form factors. Skin conductanc...
Affective Remixer is a real-time music-arranging system that reacts to immediate affective cues from a listener. Data was collected on th...
The goal of this project is to produce a guilt detector. We have created an experiment that is designed to produce feelings of guilt of v...
People naturally express frustration through the use of their motor skills. The purpose of the Affective Tangibles project is to develop ...
The computer's emerging capacity to communicate an individual's affect raises critical ethical concerns. Additionally, designers of perce...
EmoteMail is an email client that is augmented to convey aspects of the state of the writer during the composition of email to the recipi...
The goal of this project is to develop tools to sense and adapt to a user's affective state based on his or her mouse behavior. We are de...
This project developed efficient versions of Bayesian techniques for a variety of inference problems, including curve fitting, mixture-de...
The purpose of the INNER-active Journal system is to provide a way for users to reconstruct their emotions around events in their lives, ...
This research aims to classify gene expression data sets into different categories, such as normal vs. cancer. The main challenge is that...
We have created a system for data collection, annotation, and feedback that is part of a longer-term research interest to gather data to ...
"I can't do this" and "I'm not good at this" are common statements made by kids while trying to learn. Usually triggered by affective sta...
Driving is an ideal test bed for detecting stress in natural situations. Four types of physiological signals (electrocardiogram, electrom...
BioMod is an integrated interface for users of mobile and wearable devices, monitoring various physiological signals such as the electroc...
We design and evaluate an ambient blood glucose level visualization and feedback system that uses an Ambient Orb for diabetes self-care a...
The saying, "if you can't measure it, you can't manage it" may be appropriate for stress. Many people are unaware of their stress level, ...
In this project, we propose a new Bayesian receiver for signal detection in flat-fading channels. First, the detection problem is formula...
The Interface Tailor is an agent that attempts to adapt a system in response to affective feedback. Frustration is being used as a fitnes...
We have developed a system to recognize posture patterns and associated affective states in real time, in an unobtrusive way, from a set ...
The Affective Mirror is an attempt to build a fully automated system that intelligently responds to a person's affective state in real ti...
Recognizing non-verbal cues, which constitute a large percentage of our communication, is a prime facet of building emotionally intellige...
This research project is concerned with building computational models for the automatic recognition of affective expression in speech. We...
Relational Agents are computational artifacts designed to build and maintain long-term, social-emotional relationships with their users. ...
PAF (paroxysmal atrial fibrillation) is a dangerous form of cardiac arrhythmia that poses severe health risks, sometimes leading to heart...
While instant messaging clients are frequently and widely used for interpersonal communication, they lack the richness of face-to-face co...
The aim of this project is to build a database of natural speech showing a range of affective variability. It is an extension of our ongo...
The galvactivator is a glove-like wearable device that senses the wearer's skin conductivity and maps its values to a bright LED display....
The Touch-Phone was developed to explore the use of objects to mediate the emotional exchange in interpersonal communication. Through an ...
ASQ investigates ways to teach social-emotion skills to children interactively with toys. One of the first goals is to help autistic chi...
The "Affective Carpet" is a soft, deformable surface made of cloth and foam, which detects continuous pressure with excellent sensitivit...
This project is aimed at building a system to recognize emotional expression given four physiological signals. Data was gathered from a ...
Mr. Java is the Media Lab's wired coffee machine, which keeps track of usage patterns and user preferences. The focus of this project is ...
The Conductor's Jacket is a unique wearable device that measures physiological and gestural signals. Together with the Gesture Construc...
The Affective Tigger is a plush toy designed to recognize and react to certain emotinal behaviors of its playmate. For example the toy e...
We are building a system that can watch for certain signs of stress in drivers, specifically stress related to talking on the car phone...
AboutFace is a user-dependent system that is able to learn patterns and discriminate the different facial movements characterizing confu...
AffQuake is an attempt to incorporate signals that relate to a player's affect into ID Software's Quake II in a way that alters game play...