Creative Commons
Attribution-NonCommercial-ShareAlike 4.0 International
MIT Media Lab / Fluid Interfaces
With the expansion of intelligent and ubiquitous computers everywhere, we have in many ways become cognitive cyborgs: most of us are insepa…
Advancements in machine learning have recently enabled the hyper-realistic synthesis of prose, images, audio and video data, in what is ref…
While some Human-Computer Integration (HInt) systems have successfully demonstrated that humans and technology can be physically and functi…
Smart watches contain a wealth of sensors with the potential to transform health research and intervention, but few teams have the the tech…
SleepStim is a framework for automatically recording sleep physiology and presenting sensory stimuli in sleep, using consumer smartph…
Imagine a personal AI agent that you can converse with naturally about your friends and family, helping you remember previous topics you’ve…
CyberBiome is a programmable bio-digital organ, a wearable biosynthesis platform for personalized, on-demand production of therapeutics and…
Mental Machine: Labour in the Self Economy, 2022, is a live performance by Kawita Vatanajyankur made in collaboration with Pat Patara…
The sense of smell is perhaps the most pervasive of all senses, but it is also one of the least understood and least exploited in HCI. We p…
A Conversation with the Sun is an artistic exploration by acclaimed Thai auteur and artist Apichatpong Weerasethakul in collaboration…
NeuraFutures art installation features devices known as Brain-Computer Interfaces (BCIs). BCIs access the user’s brain via sensors that are…
The KALM project consists of a multimodal dataset and a wearable system for managing anxiety. With this set of tools we aim to make n…
We present "MicroPET" mission consists of an autonomous payload for enzymatic reactions and microbial cultivation with fully programmable s…
We explore how AI-systems can effectively assist human reasoning processes by building and evaluating combined human+AI information process…
This extended abstract was presented at the International Conference on Computational Social Science (IC2S2) 2022.In the past few years, th…
This project was produced as part of the 2021 Snap Creative Challenge, focused on "The Future of Co-located Social AR."Wem…
The 'dream' has historically been conceived in the West as internal, entirely private, impossibly personal. This is at odds with much of th…
This research presents the results of a study with 134 participants to explore the effects of learning from an AI-generated virtual in…
Using affective signals to summarize 16 hours of body-cam video into 15 minutes of daily recap. See the video below.
EEG-based biometrics (user identification) has been explored on small datasets of no more than 157 subjects. Here we show that the accuracy…
The human body produces a variety of different electrophysiological signals from brain-waves (EEG) to the electrical activity of the heart …
This project was selected to represent MIT at the Microsoft Design Expo 2020 on ‘Healthier Futures.’ iNonymizeA tele-mental health pla…
The environmental conditions of prolonged spaceflight pose significant psychological risks for astronauts. In particular, crews of future …
The Brain Switch is a real-time, closed-loop brain-computer system allowing for real-time correspondence of simple user needs to a caretake…
There are currently UROP openings for this project. AttentivU is a device, in the form factor of a pair of gla…
“Us” aims to help people develop their sense of empathy. It uses machine learning to analyze interlocutors’ signals (e.g., choice of words,…
EmbER (Embodied Experience Remotely) explores the use of wearable sensory devices, communicating nonverbal signals, as an additional commun…
Skip Norm is a new and flexible building block for Deep Learning that serves as a skip connection and normalization block simultaneously. I…
dementAI is an open-source platform for modeling risk stratification of Alzheimer's dementia using spontaneous speech through a …
Appropriate and adaptive treatment plans are challenging in Parkinson’s disease for several reasons. parkinsAI models drug response a…
In this project we propose a prototype which combines an existing AR headset Hololens 2 with a Brain-Computer Interfaces (BCI) system based…
What Is TDI?Targeted Dream Incubation is a method for guiding dreams towards specific themes. It is a proposal both magnetic and unlik…
Sunny is a Facebook messenger chatbot by Monique Davey, Jaya Narain, and Tina Quach that promotes wellbeing by strengthening connections wi…
A wearable olfactory display that monitors cardio-respiratory information with the aspiration to support mental wellbeing.BioEssence is a w…
Regular disinfection of hands and frequently touched surfaces is a critical factor in preventing the spread of infectious diseases and diso…
Wearable Reasoner: Towards Enhanced Human Rationality through a Wearable AI AssistantWe present "Wearable Reasoner," a proof-of-concep…
Wearable Wisdom: An Intelligent Audio-Based System for Mediating Wisdom and AdviceHaving good mentors and role models is important for pers…
We envision that a close-to-nose interface could be used as a complementary or alternative wearable method to nasal cannulas or masks,…
Living in space could have significant physical and mental impacts on astronauts. Wearables have the potential to play a critical role in m…
Living Bits : Opportunities and Challenges for Integrating Living Microorganisms in Human-Computer InteractionThere are trillions of living…
Find out more about the new version of the system, "The Thinking Cap 2.0" here.Peoples' mindsets, meaning their beliefs about their own int…
Serosa records gastrointestinal (stomach and intestinal) signals. Serosa aims for cognitive enhancement via the mind-gut connection by aidi…
“Don’t touch your face” is seemingly simple advice. Since coronaviruses are stable for days on many surfaces, a person can get COVID-19 by …
In this work we suggest to harness the power of knowledge-seeking positive experiences, engagement, and curiosity that objects perceived as…
Our body and mind relate in ways which are extraordinarily enigmatic and seemingly incomprehensible. Recent findings exemplify this by show…
Flower is a new visualization tool for in-depth study of multi-sensor recordings in the time domain. It has been released for public downlo…
InspirationSleep is a forgotten country of the mind. A vast majority of our technologies are built for our waking state, even though a thir…
Several research projects have recently explored the use of physiological sensors such as electroencephalography (EEG - brain activity) or …
Human-computer interaction (HCI) has traditionally focused on designing and investigating interfaces that provide explicit visual, auditory…
The lotus flower is an ancient symbol that has been associated with spiritual awakening or enlightenment.In yoga and meditation, the lotus…
AlterEgo is a non-invasive, wearable, peripheral neural interface that allows humans to converse in natural language with machin…
Communication skills are critical for all. We design and develop systems to help people with communication issues, eg more empa…
Plants can sense the environment, other living entities and regenerate, actuate or grow in response. Our interaction and communication…
Automatic and real-time sleep scoring is necessary to develop user interfaces that trigger stimuli in specific sleep stages. Howe…
With the exponential increase of personal data in the forms of images, videos, emails, and social media posts, the time is ripe for buildin…
Wearables are being widely researched for monitoring individual's health and wellbeing. Current generation wearable devices sense an indivi…
Interoceptive Technologies: Inducing emotions from the body upInspirationThere’s a feeling that comes tingling down the spine in certain mo…
inSight is a brain decoding system. It uses generative models (BigGAN and MusicVAE) to stimulate the brain with synthetic, but natura…
Paper Dreams explores how human creativity can be supported by artificial intelligence.Prior research on AI and creativity has primarily fo…
MoveU is a wearable vestibular stimulation device for providing proprioceptive haptic feedback in virtual reality (VR). The device in…
Lab on Body, Synthetic Biology, and Bio-Digital Systems for Health and Human Enhancement
We are working on communication interfaces for people with speech and language disorders, incorporating technologies like physiological sen…
OverviewPAL is a wearable platform for personalized, context-aware, and always-present user change. PAL has mult…
Interested in learning more about the Commalla project? Fill out this form!
Situated VR: Towards a Congruent Hybrid RealityThe vision of Extended Reality (XR) systems is living in a hybrid reality or "Metaverse" wh…
Discreet Teeth Gestures for Mobile Device InteractionByte.it is a miniaturized, discreet interface that uses teeth gestures for hands-free …
HeartBit is an interface designed for haptic heart rate biofeedback. A handheld heart beats alongside your own, mirroring the size, weight,…
The World Health Organization estimates that more than 55 million people worldwide suffer from dementia. As the proportion of older people …
This work explores the design of techniques based on the cognitive illusion of "inattentional blindness" which is a failure to notice somet…
Exploring robotic sound generation mixed with human movements on the guitar. Guitar Machine II is a robotic guitar that responds to human g…
Virtual reality can help realize mediated social experiences where we interact as richly with those around the world as we do with those in…
Room-scale virtual reality opens up exciting new possibilities for exploratory learning. Phenomena that otherwise cannot be experienced dir…
Temperature influences our perception and cognition both consciously and subconsciously. These effects are rooted in our bodily experiences…
Mathematical experiences are intrinsic to our everyday lives, yet mathematics education is mostly confined to textbooks. Seymour Papert use…
The Blank Canvas directs immersion inwards using virtual reality, augmenting awareness of the microscopic worlds inside each of us and the …
The brain uses space to index, organize, and retrieve memories. However, our sense of space depends on our perception of gravity. We p…
NeverMind is an interface and application designed to support human memory. We combine the memory palace memorization method with augmented…
We explore an art form where machines take on an essential role in the aesthetics and processes of the creation. Our main theme can be summ…
Real-time collaborative self-expression in virtual reality
Elowan is a cybernetic lifeform, a plant in direct dialogue with a machine. Using its own internal electrical signals, the plant is interfa…
Our traditional manufacturing, fabrication, and electronics have been centered around synthetic and completely artificial techniques. Comin…
We present an interactive virtual reality (VR) experience that uses biometric information for reflection and relaxation. We monit…
Biological neuronal networks are highly complex and interconnected with superior information processing capabilities. Such networks have pr…
Cocoon is our vision of a programmable dream machine from the future. This device would be enabled by the synthesis of many devices under d…