Research
Affective Computing

Advance human wellbeing by developing new ways to communicate, understand, and respond to emotion
Project Research

Commalla: Communication for All

(Note: This project was previously called ECHOS.)  Official Commalla website:  https://commallamit.wixsite.com/commal...
Research
Fluid Interfaces

Designing systems for cognitive enhancement
Archived
Research
ML Learning

ML Learning
Publication Research

Personalized Modeling of Real-World Vocalizations from Nonverbal Individuals

Narain, J.*, Johnson, K.T.*, Ferguson, C., O’Brien, A., Talkar, T., Zhang, Y., Wofford, P., Quatieri, T., Picard, R.W.,Maes, P., "Personalized Modeling of Real-World Vocalizations from Nonverbal Individuals," Proceedings of the International Conference on Multimodal Interaction (ICMI), Utrecht, Netherlands, October 2020. (*Co-first authors/Equal contribution)
Publication Research

The ECHOS Platform to Enhance Communication for Nonverbal Children with Autism: A Case Study

Johnson, K.T.*, Narain, J.*, Ferguson, C., Picard, R.W., and Maes, P. The ECHOS Platform to Enhance Communication for Nonverbal Children with Autism: A Case Study. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Case Studies Track of CHI 2020). (*Co-first authors/Equal contribution)
Publication Research

Augmenting Natural Communication in Nonverbal Individuals with Autism

Johnson, K.T.* & Narain, J.*, Maes, P., Picard, R.W., "Augmenting Natural Communication in Nonverbal Individuals with Autism," International Society for Autism Research (INSAR), Seattle, Washington, May 2020. (*Co-first authors/equal contribution)
Publication Research

Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism

Narain, J.*, Johnson, K.T.*, O’Brien, A., Wofford, P., Maes, P., Picard, R.W. "Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism," Proceedings of the Workshop on Laughter and Other Nonverbal Vocalisations, Bielefeld, Germany, October 2020. (*Co-first authors/Equal contribution)
Project Research

SPRING: A Smart Platform for Research, Intervention, and Neurodevelopmental Growth

SPRING is a custom-built hardware and software platform for children with neuro-differences. The system automates data acquisition, optim...
Publication Research

Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data

Narain, J.*, Johnson, K.T.*, Picard, R.W., Maes, P. "Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data," NeurIPS Workshop on AI for Social Good, December 2019. (*Co-first authors/Equal contribution)
Project Research

Multi-SPRING

OverviewWe have created a new customizable, multi-user research-through-play platform designed to facilitate social skill development for...
Project Research

PAL: Project on Affinities + Language

The Project on Affinities and Language (PAL) is designed to help us understand what happens in a child’s brain when they engage with thei...
Publication Research

Multi-modal Active Learning From Human Data: A Deep Reinforcement Learning Approach

Rudovic, O., Zhang, M, Schuller, B., Picard, R. "Multi-modal Active Learning From Human Data: A Deep Reinforcement Learning Approach", In 2019 International Conference on Multimodal Interaction (ICMI ’19), October 14–18, 2019, Suzhou, China. ACM, New York, NY, USA.
Post Research

EngageME chosen as an EU Research success story

The technology being developed can enable personalized interactions with an autistic child, helping therapists to engage their attention.
Project Research

Personalized Machine Learning for Autism Therapy

EngageME: Personalized machine learning and humanoid robots for measuring affect and engagement of children with autismEngageME is a proj...
Publication Research

Personalized Machine Learning for Robot Perception of Affect and Engagement in Autism Therapy

Rudovic, O., Lee, J., Dai, M., Schuller, B. , Picard, R. W., " Personalized machine learning for robot perception of affect and engagement in autism therapy," Science Robotics, June 2018.
Publication Research

Multi-SPRING: Facilitating Social Interaction through a Customizable, Multimodal Learning Platform

Johnson, K.T., Ferguson, C.S., Picard, R.W., "Multi-SPRING: Facilitating Social Interaction through a Customizable, Multimodal Learning Platform," International Society for Autism Research (INSAR), Rotterdam, Netherlands, May 2018.
Publication Research

Customizable, Interactive Toy Platform to Enable Motivation-Driven Cognitive and Physical Development in Children Diagnosed with Autism

Johnson, K.T. and Picard, R.W. "Customizable, Interactive Toy Platform to Enable Motivation-Driven Cognitive and Physical Development in Children Diagnosed with Autism or Developmental Disorders," International Meeting for Autism Research (IMFAR), Baltimore, Maryland, May 2016.