• Login
  • Register

Work for a Member company and need a Member Portal account? Register here with your company email address.

Advancing human wellbeing by developing new ways to communicate, understand, and respond to emotion

Creative Commons

Attribution 4.0 International

Affective Computing group, MIT Media Lab

Group Contact:
Archived
Project Research

Sound(e)scape

This research explores how acoustic environments can elicit awe and wonder emotions, and how such experiences can contribute to restoration…
Archived
Archived
Project Research

Cultivating a Supportive Sphere: Digital tools for social support amongst current and former foster-involved youth

Over 600,000 youth in the United States experience abuse or neglect each year. Youth who are deemed to be at risk of significant harm in th…
Archived
Archived
Project Research

Cardiac Arrest: Evaluating the Role of Biosignals in Gameplay Strategies and Players' Physiological Synchrony in Social Deception

Social deduction or deception games are games in which a player or team of players actively deceives other players who are trying to discov…
Archived
Archived
Project Research

Detect DeepFakes: How to counteract misinformation created by AI

See for yourself how accurately you can identify AI-generated images at the DetectFakes Experiment and if you want to learn to sp…
Archived
Archived
Project Research

Predicting Driver Self-Reported Stress by Analyzing the Road Scene

Different approaches and models have been used to detect driver’s stress and affective states, using physiology, facial expression, and sel…
Archived
Archived
Project Research

Diagnosing Diagnosis in Dermatology

Addressing Bias in Physician-Machine PartnershipsThis research program addresses how AI assistance can enhance physician decision-making on…
Archived
Project Research

Empathic GPS

Emotional arousal influences focus, attention, and decision-making, which are critical when driving. To help promote an optimal arousal lev…
Archived
Archived
Project Research

aSpire: Clippable, Mobile Pneumatic-Haptic Device for Breathing Rate Regulation via Personalizable Tactile Feedback

We introduce–aSpire–a clippable, mobile pneumatic-haptic device designed to help users regulate their breathing rate via subtle tactile fee…
Archived
Archived
Project Research

Emotion Navigation for Kids

There is a consensus that the hospital experience is stressful for children and leads to anxiety and fear.  Long term effects of stres…
Archived
Archived
Project Research

Emotion Navigation

Before automobiles were invented and widely adopted, animals like horses were the most common mode of transportation. While this change bro…
Archived
Archived
Project Research

Theme | Communication + Collaboration

Communication skills are critical for all. We  design and develop systems to help people with communication issues, fostering more emp…
Archived
Archived
Project Research

Place Recognition and Categorization

The Places dataset (website) is designed following principles of human visual cognition. Our goal is to build a core of visual kn…
Archived
Archived
Project Research

BioEssence

A wearable olfactory display that monitors cardio-respiratory information with the aspiration to support mental wellbeing.BioEssence is a w…
Archived
Archived
Project Research

Emotion/wellbeing x skincare cosmetics

The project aims to investigate the relationships between emotion, wellbeing, skin, and skincare cosmetics. In our first study, we mea…
Archived
Archived
Project Research

Image Sentiment Analysis

 In this project we explore how to recognize and localize affect in images.
Archived
Archived
Project Research

Emotion Recognition in Scene Context

The goal of this project is providing machines with the ability of understanding what a person is experiencing from her frame of reference,…
Archived
Archived
Project Research

BrightBeat: Effortlessly influencing breathing for cultivating calmness and focus

The relationship between breathing and self-reported stress is bidirectional. Respiration pattern is an indicator of stress, but it can als…
Archived
Project Research

Lensing: Cardiolinguistics for Atypical Angina

Conversations between two individuals—whether between doctor and patient, mental health therapist and client, or between two people romanti…
Archived
Archived
Project Research

Open-Source SPRING

Open-Source Instructions for Building SPRING System
Archived
Archived
Project Research

Acuation: Real-Time Acupoint Stimulation To Mediate The Urge To Smoke

Acu.ation is an intervention that aims to mediate the urge to smoke by pairing a wearable device that delivers transcutaneous electric acup…
Archived
Archived
Project Research

SEPTA Alerts: Improving the accessibility of public transportation in Philadelphia for people with disabilities

We designed an app that uses augmented reality to make public transit in Philadelphia more accessible for people with disabilities.The desi…
Archived
Archived
Project Research

Empathetic behavior training for physicians working with patients who have Opioid Use Disorder

The Affective Computing group is collaborating with Weill Cornell Medicine to build empathetic behavior in physicians working with opioid u…
Archived
Archived
Project Research

DISSECT: Disentangled Simultaneous Explanationsvia Concept Traversals

One of the principal benefits of counterfactual explanations is allowing users to explore "what-if" scenarios through what does not and can…
Archived
Project Research

Privacy-Preserving Depressive Symptoms Estimation

The goal of this project is to develop techniques to remove identifying information from wearable and phone data to protect patients’ priva…
Archived
Archived
Project Research

DeepBrainBody

The purpose of this study is to investigate possible neural correlates of electrodermal activity. Electrodermal activity (EDA) is a b…
Archived
Archived
Project Research

UncNet: Modeling uncertainty in deep learning for inherently subjective tasks

Automatic emotion recognition has become a well-established machine learning task in recent years. The sensitive and subjective nature of e…
Archived
Archived
Project Research

PAL: Project on Affinities + Language

The Project on Affinities and Language (PAL) is designed to help us understand what happens in a child’s brain when they engage with their …
Archived
Archived
Project Research

Adaptive Music for Affect Improvement

Adaptive Music for Affect Improvement (AMAI) is a music generation and playback system with the goal of steering the listener toward a stat…
Archived
Archived
Project Research

SkinBot: A wearable, skin-climbing robot

We introduce SkinBot: a lightweight robot that moves over the skin's surface with a two-legged suction-based locomotion mechanism and captu…
Archived
Project Research

Learning via Social Awareness: Improving sketch representations with facial feedback

In the quest towards general artificial intelligence (AI), researchers have explored developing loss functions that act as intrinsic motiva…
Archived
Project Research

Improving Wellbeing for Office Workers

Excessive stress can decrease office workers' productivity and negatively impact overall health. This project aims to predict office worker…
Archived
Archived
Project Research

Personalized Machine Learning for Future Health

​The view on Alzheimer’s Disease (AD) diagnosis has shifted towards a more dynamic process in which clinical and pathological markers evolv…
Archived
Archived
Project Research

BrainBeat: Breath-based music therapy

Can we sonfiy calming breathing and passively influence a state of calm?Deep breathing has been scientifically proven to affect the heart, …
Archived
Archived
Project Research

Cube Puzzles

​Cube Puzzles: A tangible platform for dynamic assessment of cognitive and psychomotor skillsCognitive and psychomotor assessments are a vi…
Archived
Archived
Project Research

EMMA: An emotionally intelligent personal assistant for improving wellbeing

The delivery of mental health interventions via ubiquitous devices has shown a lot of promise. A natural conversational interface that allo…
Archived
Archived
Project Research

WorldBeat: Hearing the world differently

Can we modulate the way we hear the world around us to make it more calming or to induce focus? While technology is usually associated with…
Archived
Archived
Project Research

Electrocardiogram collection in noisy ambulatory environments with Android smartphone devices

The explosion of mHealth in both abundant and resource-constrained countries is both a cause for celebration and for concern. While mH…
Archived
Archived
Project Research

Understanding emotions in multiple sclerosis patients

More information coming soon.
Archived
Archived
Project Research

Injection Study

Many drugs, such as monoclonal antibodies, are administrated using parenteral delivery devices via subcutaneous injections. Unfortunately, …
Archived
Archived
Project Research

Physio FreeFall

This project seeks to examine the effects of altered gravity on an individual’s physiology during parabolic flight. Specifically, we will c…
Archived
Archived
Project Research

Improving RNN Sequence Generation with RL

This project investigates a general method for improving the structure and quality of sequences generated by a recurrent neural network (RN…
Archived
Archived
Project Research

Machine Learning for Pain Measurement

Pain is a subjective experience commonly measured through patients' self reports. Unfortunately, self-report measures only work when t…
Archived
Archived
Project Research

Personalized Animated Movies

Storytelling is a fundamental way in which human beings understand the world. Imagine watching a movie telling the story of your life, how …
Archived
Archived
Project Research

Behavioral Indications of Depression Severity

In collaboration with Massachusetts General Hospital, we are conducting a clinical trial exploring objective methods for assessing depressi…
Archived
Archived
Project Research

Personalized Machine Learning for Autism Therapy

EngageME: Personalized machine learning and humanoid robots for measuring affect and engagement of children with autismEngageME is a projec…
Archived
Archived
Project Research

Predicting Bonding in Conversations

We show that using thin slices (< 1 minute) of facial expression and body language data, we can train a deep neural network to predict w…
Archived
Archived
Project Research

Predicting perceived emotions in animated GIFs with 3D convolutional neural networks

Animated GIFs are widely used on the Internet to express emotions, but automatic analysis of their content is largely …
Archived
Archived
Project Research

The enTRAIN Study: Physiological synchrony in children with autism

Individuals with autism are known to have difficulties connecting with other people, reciprocating social interactions, and being emotional…
Archived
Archived
Project Research

SPRING: A Smart Platform for Research, Intervention, and Neurodevelopmental Growth

SPRING is a custom-built hardware and software platform for children with neuro-differences. The system automates data acquisition, optimiz…
Archived
Project Research

Modulating peripheral and cortical arousal using a musical motor response task

We are conducting EEG studies to identify the musical features and musical interaction patterns that universally impact measures of arousal…
Archived
Project Research

Traditional Chinese medicine-inspired pulse analysis

This study aims to bring objective measurement to the multiple "pulse" and "pulse-like" measures made by practitioners of traditional Chine…
Archived
Project Research

Affective Response to Haptic Signals

This study attempts to examine humans' affective responses to superimposed sinusoidal signals. These signals can be perceived either throug…
Archived
Archived
Project Research

EDA Explorer

Electrodermal Activity (EDA) is a physiological indicator of stress and strong emotion. While an increasing number of wearable devices can …
Archived
Archived
Project Research

"Kind and Grateful": Promoting kindness and gratitude with pervasive technology

We have designed a novel system to promote kindness and gratitude. We leverage pervasive technologies to naturally embed gratitude inspirat…
Archived
Archived
Project Research

The Challenge

Mental wellbeing is intimately tied to both social support and physical activity. The Challenge is a tool aimed at promoting social connect…
Archived
Archived
Project Research

Wavelet-based motion artifact removal for electrodermal activity

Electrodermal activity (EDA) recording is a powerful, widely used tool for monitoring psychological or physiological arousal. However, anal…
Archived
Archived
Project Research

Predicting students' wellbeing from physiology, phone, mobility, and behavioral data

The goal of this project is to apply machine learning methods to model the wellbeing of MIT undergraduate students. Extensive data is obtai…
Archived
Project Research

An EEG and motion-capture based expressive music interface for affective neurofeedback

This project examines how the expression granted by new musical interfaces can be harnessed to create positive changes in health and wellbe…
Archived
Project Research

Valinor: Mathematical models to understand and predict self-harm

We are developing statistical tools for understanding, modeling, and predicting self-harm by using advanced probabilistic graphical models …
Archived
Archived
Project Research

Tributary

The proliferation of smartphones and wearable sensors is creating very large data sets that may contain useful information. However, the ma…
Archived
Archived
Project Research

Fathom: Probabilistic graphical models to help mental health counselors

We explore advanced machine learning and reflective user interfaces to scale the national Crisis Text Line. We are using state-of-the-art p…
Archived
Project Research

Building the Just-Right-Challenge in Games and Toys

With the LEGO Group and Hasbro, we looked at the emotional experience of playing with games and LEGO bricks. We measured participants' skin…
Archived
Archived
Project Research

Meet the Ganimals

New generative AI technologies (such as the Generative Adversarial Network, or GAN) can allow us to imagine new species. Hidden within the …
Archived
Archived
Project Research

ELSA: Empathy learning, socially-aware agents

What is ELSA?ELSA is an AI-powered chatbot that acts as an empathetic companion, encouraging users to talk about their day through a form o…
Archived
Archived
Project Research

QuantifyMe

Unlike traditional randomized controlled trials that generalize relationships in large groups of people, single-case experiments seek to qu…
Archived
Archived
Project Research

Automated Tongue Analysis

A common practice in Traditional Chinese Medicine (TCM) is visual examination of the patient's tongue. This study will examine ways to make…
Archived
Archived
Project Research

StoryScape

Stories, language, and art are at the heart StoryScape. While StoryScape began as a tool to meet the challenging language learning needs of…
Archived
Project Research

FEEL: A cloud system for frequent event and biophysiological signal labeling

The wide availability of low-cost, wearable, biophysiological sensors enables us to measure how the environment and our experiences impact …
Archived
Archived
Project Research

Panoply

Panoply is a crowdsourcing application for mental health and emotional wellbeing. The platform offers a novel approach to computer-based ps…
Archived
Archived
Project Research

Deep Reinforcement Learning for Pain Management

Opioid therapy is the cornerstone of management of pain in the ICU. However, opioids present numerous side effects and are highly addictive…
Archived
Project Research

Onsite Stress Measurement

Occupational stress can be described as a harmful emotional and physical response that occurs when high demanding job conditions cannot be …
Archived
Project Research

Measuring arousal during therapy for children with autism and ADHD

Physiological arousal is an important part of occupational therapy for children with autism and ADHD, but therapists do not have a way to o…
Archived
Archived
Project Research

HOL-DEEP-SENSE

The Hol-Deep-Sense project (funded by the EU’s Horizon 2020 Marie Skłodowska-Curie grant) aims at holistic machine perception of …
Archived
Archived
Project Research

Mobile health interventions for drug addiction and PTSD

We are developing a mobile phone-based platform to assist people with chronic diseases, panic-anxiety disorders, or addictions. Making use …
Archived
Project Research

Autonomic Nervous System Activity in Epilepsy

We are performing long-term measurements of autonomic nervous system (ANS) activity on patients with epilepsy. In certain cases, autonomic …
Archived
Project Research

Causal Influence Intrinsic Social Motivation for Multi-Agent Reinforcement Learning

Teaching multiple AI agents to coordinate their behavior represents a challenging task, that can be difficult to achieve without training a…
Archived
Archived
Project Research

Multi-SPRING

OverviewWe have created a new customizable, multi-user research-through-play platform designed to facilitate social skill development for c…
Archived
Archived
Project Research

BrainBody

In this project, we aim to examine the interplay between the brain and body using physiological sensors and functional magnetic resonance i…
Archived
Project Research

PERSONAlised Mental Health Monitoring System

Project OverviewDepression is one of the most prevailing health problems in the world. Many recent publications have provided statistics ab…
Archived
Project Research

SNAPSHOT Expose

We are applying learnings from the SNAPSHOT study to the problem of changing behavior, exploring the design of user-centered tools which ca…
Archived
Project Research

Objective Asessment of Depression and its Improvement

Current methods to assess depression and then ultimately select appropriate treatment have many limitations. They are usually based on havi…
Archived
Archived
Project Research

IDA: Inexpensive Networked Digital Stethoscope

Complex and expensive medical devices are mainly used in medical facilities by health professionals. IDA is an attempt to disrupt this para…
Archived
Project Research

Emotion Prototyping: Redesigning the Customer Experience

You can test whether a website is usable by making wire frames, but how do you know if that site, product, or store is emotionally engaging…
Archived
Archived
Project Research

SmileTracker

SmileTracker is a system designed to capture naturally occurring instances of positive emotion during the course of normal interaction with…
Archived
Project Research

Exploring Temporal Patterns of Smile

A smile is a multi-purpose expression. We smile to express rapport, polite disagreement, delight, sarcasm, and often, even frustration. Is …
Archived
Archived
Project Research

MACH: My Automated Conversation coacH

MACH, My Automated Conversation coacH, is a system for people to practice social interactions in face-to-face scenarios. MACH consists of a…
Archived
Archived
Project Research

Reinventing the Retail Experience

With skin conductance sensors, we map out what frustrates and excites customers as they shop�from layout to wanting to touch the product. O…
Archived
Project Research

Got Sleep?

Got Sleep? is an Android application to help people to be aware of their sleep-related behavioral patterns and tips about how they should c…
Archived
Archived
Project Research

Making Engaging Concerts

Working with the New World Symphony, we measured participant skin conductance as they attended a classical concert for the first time. With…
Archived
Project Research

Digging into Brand Perception with Psychophysiology

What do customers really think about your company or brand? Using skin conductance sensors, we measure what excites and frustrates customer…
Archived
Archived
Project Research

Facial Expression Analysis Over the Web

This work builds on our earlier work with FaceSense, created to help automate the understanding of facial expressions, both cognitive and a…
Archived
Archived
Project Research

Mobisensus: Predicting Your Stress/Mood from Mobile Sensor Data

Can we recognize stress, mood, and health conditions from wearable sensors and mobile-phone usage data? We analyze long-term, multi-modal p…
Archived
Archived
Project Research

Auditory Desensitization Games

Persons on the autism spectrum often report hypersensitivity to sound. Efforts have been made to manage this condition, but there is wide r…
Archived
Archived
Project Research

Analysis of Autonomic Sleep Patterns

We are examining autonomic sleep patterns using a wrist-worn biosensor that enables comfortable measurement of skin conductance, skin tempe…
Archived
Archived
Project Research

Cardiocam

Cardiocam is a low-cost, non-contact technology for measurement of physiological signals such as heart rate and breathing rate using a basi…
Archived
Project Research

Emotional-Social Intelligence Toolkit

Social-emotional communication difficulties lie at the core of autism spectrum disorders, making interpersonal interactions overwhelming, f…
Archived
Archived
Project Research

FaceSense: Affective-Cognitive State Inference from Facial Video

People express and communicate their mental states–such as emotions, thoughts, and desires–through facial expressions, vocal nuances, gestu…
Archived
Project Research

Modular Light for Better Sleep

This project aims to build a modular lighting system where users can customize the design and lighting patterns.
Archived
Archived
Project Research

Gesture Guitar

Emotions are often conveyed through gesture. Instruments that respond to gestures offer musicians new, exciting modes of musical expression…
Archived
Archived
Project Research

Measuring Customer Experiences with Arousal

How can we better understand people�s emotional experiences with a product or service? Traditional interview methods require people to reme…
Archived
Archived
Project Research

Frame It

Frame It is an interactive, blended, tangible-digital puzzle game intended as a play-centered teaching and therapeutic tool. Current work i…
Archived
Archived
Project Research

Customized Computer-Mediated Interventions

Individuals diagnosed with autism spectrum disorder (ASD) often have intense, focused interests. These interests, when harnessed properly, …
Archived
Project Research

The Frustration of Learning Monopoly

We are looking at the emotional experience created when children learn games. Why do we start games with the most boring part, reading dire…
Archived
Project Research

Emotion and Memory

Have you ever wondered what makes an ad memorable? We have performed a comprehensive review of literature concerning advertising, memory, a…
Archived
Archived
Project Research

Externalization Toolkit

We propose a set of customizable, easy-to-understand, and low-cost physiological toolkits in order to enable people to visualize and utiliz…
Archived
Project Research

Evaluation Tool for Recognition of Social-Emotional Expressions from Facial-Head Movements

To help people improve their reading of faces during natural conversations, we developed a video tool to evaluate this skill. We collected …
Archived
Project Research

Sensor-Enabled Measurement of Stereotypy and Arousal in Individuals with Autism

A small number of studies support the notion of a functional relationship between movement stereotypy and arousal in individuals with ASD, …
Archived
Archived
Project Research

What Do Facial Expressions Mean?

We are automating recognition of positive/negative experiences (valence) and affect from facial expressions. We present a toolkit, Acume, f…
Archived
Project Research

Infant Monitoring and Communication

We have been developing comfortable, safe, attractive physiological sensors that infants can wear around the clock to wirelessly communicat…
Archived
Project Research

Autonomic Nervous System Activity in Sleep

We are characterizing changes in autonomic nervous system (ANS) during sleep. This can potentially provide insight into circadian rhythms a…
Archived
Project Research

Passive Wireless Heart-Rate Sensor

We have developed a low-cost device that can wirelessly detect a beating heart over a short distance (1m) and does not require any sensor p…
Archived
Archived
Project Research

Heartphones

We are developing wearable sensors that measure cardiovascular parameters such as heart rate and heart rate variability (HRV) in real time.…
Archived
Project Research

Affective-Cognitive Product Evaluation and Prediction of Customer Decisions

Companies would like more new products to be successful in the marketplace, but current evaluation methods such as focus groups do not accu…
Archived
Project Research

Affect as Index

Affect as Index is a tool that takes group physiological data as input, aggregates it across different demographic dimensions, and attaches…
Archived
Project Research

Affective-Cognitive Framework for Machine Learning and Decision Making

Recent findings in affective neuroscience and psychology indicate that human affect and emotional experience play a significant and useful …
Archived
Project Research

Emotion Communication in Autism

People who have difficulty communicating verbally (such as many people with autism) sometimes send nonverbal messages that do not match wha…
Archived
Project Research

Prediction Game and Experience Sharing Market for Forecasting Marketplace Success

We have developed a novel market game, Prediction Game and Experience Sharing (PreGES, pronounced PreGuess), that harnesses people's collec…
Archived
Project Research

Lux Meter: Real-Time Feedback in Ambient Light Environment

Light is an important factor in the regulation of all kinds of circadian rhythms in our body, such as heart rate, blood pressure, digestion…
Archived
Archived
Project Research

Girls Involved in Real-Life Sharing

In this research, a proactive emotional health system, geared toward supporting emotional self-awareness and empathy, was built as a part o…
Archived
Project Research

Machine Learning and Pattern Recognition with Multiple Modalities

This project develops new theory and algorithms to enable computers to make rapid and accurate inferences from multiple modes of data, such…
Archived
Archived
Project Research

Improving Sleep-Wake Schedule Using Sleep Behavior Visualization and a Bedtime Alarm

Humans need sleep, along with food, water, and oxygen, to survive. With about one-third of our lives spent sleeping, there has been increas…
Archived
Project Research

Customer Measurement Using Bluetooth

We are exploring innovative use of cell-phone Bluetooth technologies for consumer research and customer measurement. We have developed a s…
Archived
Project Research

SmileSeeker: Customer and Employee Affect Tagging System

SmileSeeker is a novel, machine-vision system that captures and provides quantified information about nonverbal communication where social …
Archived
Project Research

Objective Self: Understanding Internal Responses

How can technology help us understand ourselves better? In order to measure the physiological arousal of children with sensory challenges s…
Archived
Project Research

Causal Learning and Autism

In collaboration with the Early Childhood Cognition Center at MIT BCS, we are developing sensor-enabled toys and infant affect sensors with…
Archived
Project Research

RoCo: A Robotic Desktop Computer

A robotic computer that moves its monitor "head" and "neck," but that has no explicit face, is being designed to interact with users in a n…
Archived
Project Research

ShyBot

Shybot is a personal mobile robot designed to both embody and elicit reflection on shyness behaviors. Shybot is being designed to detect hu…
Archived
Project Research

EyeJacking: See What I See

While modern communication technologies mean that we can connect to more people, these connections lack the affective subtleties inherent i…
Archived
Project Research

Fostering Affect Awareness and Regulation in Learning

Sometimes learners have to focus while experiencing strong emotions (e.g., family problems).�They may also face challenges in perservering …
Archived
Project Research

Self-Cam

The Self-Cam is a wearable camera apparatus that consists of a chest-mounted camera aimed at the wearer�s face. Self-Cam was designed to be…
Archived
Project Research

In Search of Wonder: Measuring Our Response to the Miraculous

The wonder that occurs while watching a good magic trick or admiring a gorgeous natural vista is a strong emotion that has not been well st…
Archived
Project Research

Enhanced Sensory Perception

As the population ages, acuity in one or more sensory channels often diminishes or may be totally lost. Augmenting or compensating for loss…
Archived
Project Research

Human Motion Signatures

Given motion capture samples of Charlie Chaplin's walk, is it possible to synthesize other motions—say, ascending or descending stairs—in h…
Archived
Archived
Project Research

Emotion Bottles

The Emotion Bottles are tangibly enticing objects that embody three emotions: angry, happy, and sad. When a bottle is opened, a vocal outp…
Archived
Archived
Project Research

Emotional DJ

The technology in this project changes facial expressions in videos without the system knowing anything in particular about the person's fa…
Archived
Project Research

HandWave

HandWave is a small, wireless, networked skin conductance sensor that can be worn or used in many different form factors. Skin conductance …
Archived
Project Research

The Affective Remixer: Personalized Music Arranging

Affective Remixer is a real-time music-arranging system that reacts to immediate affective cues from a listener. Data was collected on the …
Archived
Project Research

Guilt Detection

The goal of this project is to produce a guilt detector. We have created an experiment that is designed to produce feelings of guilt of var…
Archived
Project Research

Affective Tangibles

People naturally express frustration through the use of their motor skills. The purpose of the Affective Tangibles project is to develop ph…
Archived
Project Research

Moral Sensors

The computer's emerging capacity to communicate an individual's affect raises critical ethical concerns. Additionally, designers of percept…
Archived
Project Research

EmoteMail

EmoteMail is an email client that is augmented to convey aspects of the state of the writer during the composition of email to the recipien…
Archived
Project Research

Mouse-Behavior Analysis and Adaptive Relational Agents

The goal of this project is to develop tools to sense and adapt to a user's affective state based on his or her mouse behavior. We are deve…
Archived
Project Research

Bayesian Spectral Estimation

This project developed efficient versions of Bayesian techniques for a variety of inference problems, including curve fitting, mixture-dens…
Archived
Project Research

INNER-active Journal

The purpose of the INNER-active Journal system is to provide a way for users to reconstruct their emotions around events in their lives, an…
Archived
Project Research

Gene Expression Data Analysis

This research aims to classify gene expression data sets into different categories, such as normal vs. cancer. The main challenge is that t…
Archived
Project Research

Wearable Relational Devices for Stress Monitoring

We have created a system for data collection, annotation, and feedback that is part of a longer-term research interest to gather data to un…
Archived
Project Research

Learning Companion

"I can't do this" and "I'm not good at this" are common statements made by kids while trying to learn. Usually triggered by affective state…
Archived
Project Research

Detection and Analysis of Driver Stress

Driving is an ideal test bed for detecting stress in natural situations. Four types of physiological signals (electrocardiogram, electromyo…
Archived
Project Research

BioMod

BioMod is an integrated interface for users of mobile and wearable devices, monitoring various physiological signals such as the electrocar…
Archived
Project Research

Ambient Displays for Social Support and Diabetes Management

We design and evaluate an ambient blood glucose level visualization and feedback system that uses an Ambient Orb for diabetes self-care and…
Archived
Project Research

Personal Heart-Stress Monitor

The saying, "if you can't measure it, you can't manage it" may be appropriate for stress. Many people are unaware of their stress level, an…
Archived
Project Research

Adaptive, Wireless, Signal Detection and Decoding

In this project, we propose a new Bayesian receiver for signal detection in flat-fading channels. First, the detection problem is formulate…
Archived
Project Research

Interface Tailor

The Interface Tailor is an agent that attempts to adapt a system in response to affective feedback. Frustration is being used as a fitness …
Archived
Project Research

Posture Recognition Chair

We have developed a system to recognize posture patterns and associated affective states in real time, in an unobtrusive way, from a set of…
Archived
Project Research

Affective Mirror

The Affective Mirror is an attempt to build a fully automated system that intelligently responds to a person's affective state in real time…
Archived
Project Research

Automatic Facial Expression Analysis

Recognizing non-verbal cues, which constitute a large percentage of our communication, is a prime facet of building emotionally intelligent…
Archived
Project Research

Recognizing Affect in Speech

This research project is concerned with building computational models for the automatic recognition of affective expression in speech. We a…
Archived
Project Research

Relational Agents

Relational Agents are computational artifacts designed to build and maintain long-term, social-emotional relationships with their users. Ce…
Archived
Project Research

Cardiac PAF Detection and Prediction

PAF (paroxysmal atrial fibrillation) is a dangerous form of cardiac arrhythmia that poses severe health risks, sometimes leading to heart a…
Archived
Project Research

Conductive Chat

While instant messaging clients are frequently and widely used for interpersonal communication, they lack the richness of face-to-face conv…
Archived
Project Research

Affect in Speech: Assembling a Database

The aim of this project is to build a database of natural speech showing a range of affective variability. It is an extension of our ongoin…
Archived
Project Research

Galvactivator

The galvactivator is a glove-like wearable device that senses the wearer's skin conductivity and maps its values to a bright LED display. I…
Archived
Project Research

Touch-Phone

The Touch-Phone was developed to explore the use of objects to mediate the emotional exchange in interpersonal communication. Through an ab…
Archived
Project Research

Affective Social Quest

ASQ investigates ways to teach social-emotion skills to children interactively with toys. One of the first goals is to help autistic child…
Archived
Project Research

Affective Carpet

The "Affective Carpet" is a soft, deformable surface made of cloth and foam, which detects continuous pressure with excellent sensitivity …
Archived
Project Research

Online Emotion Recognition

This project is aimed at building a system to recognize emotional expression given four physiological signals. Data was gathered from a gr…
Archived
Project Research

Mr. Java: Customer Support

Mr. Java is the Media Lab's wired coffee machine, which keeps track of usage patterns and user preferences. The focus of this project is to…
Archived
Project Research

The Conductor's Jacket

The Conductor's Jacket is a unique wearable device that measures physiological and gestural signals. Together with the Gesture Constructi…
Archived
Project Research

Affective Tigger

The Affective Tigger is a plush toy designed to recognize and react to certain emotinal behaviors of its playmate. For example the toy ent…
Archived
Project Research

Car Phone Stress

We are building a system that can watch for certain signs of stress in drivers, specifically stress related to talking on the car phone, …
Archived
Project Research

AboutFace

AboutFace is a user-dependent system that is able to learn patterns and discriminate the different facial movements characterizing confusi…
Archived
Project Research

AffQuake

AffQuake is an attempt to incorporate signals that relate to a player's affect into ID Software's Quake II in a way that alters game play. …
Archived