• Login
  • Register

Work for a Member company and need a Member Portal account? Register here with your company email address.

Project Research

Towards Socially-Intelligent Nonverbal Foundation Models

If we want AI to engage with us naturally—in classrooms, therapy, eldercare, and beyond—it needs to understand us, with or without words.&n…
Research
Multisensory Intelligence

Creating human-AI symbiosis across scales and sensory mediums to enhance productivity, creativity, and wellbeing
Research
Tangible Media

Invent new tangible and embodied interactions that inspire and engage people
Project Research

Gaze to the Stars

What if public buildings could share our dreams, and reveal our intimate expressions of struggle and triumph? Inspired by the motto "p…
Research
Critical Matter

Designing across the scale, imagining a transformative future
Project Research

Decentralized AI

As AI evolves beyond screen assistants and into dimensional applications, decentralization emerges as the critical factor for unlocking i…
Publication Research

Federated Conformal Predictors for Distributed Uncertainty Quantification

Lu, Charles, et al. "Federated conformal predictors for distributed uncertainty quantification." International Conference on Machine Learning (ICML). PMLR, 2023.
Research
City Science

Looking beyond smart cities
Project Research

BeWell Biomarkers

Working with leading neuroscientist Richard Davidson and the Healthy Minds Institute, we are developing objective biomarkers to interpret a…
Research
Affective Computing

Advancing human wellbeing by developing new ways to communicate, understand, and respond to emotion
Research
Signal Kinetics

Inventing, building, and deploying wireless sensor technologies to address complex problems in society, industry, and ecology
Research
Viral Communications

People and intelligent machines in a creative, symbiotic loop
Project Research

Large Population Models

Many of society’s most critical risks—from pandemic outbreaks to supply chain disruptions to cyber vulnerabilities—arise from the decisions…
Archived
Project Research

Computer-Aided Synthesis

An exploration of how  advances in deep learning and generative models can be used to help us synthesize our ideas.
Archived
Research
Responsive Environments

Augmenting and mediating human experience, interaction, and perception with sensor networks
Research
Opera of the Future

Extending expression, learning, and health through innovations in musical composition, performance, and participation
Research
Future Sketches

Exploring the essence of code as a creative medium
Research
Fluid Interfaces

Designing Systems for Cognitive Augmentation
Research
Conformable Decoders

Converting the patterns of nature and the human body into beneficial signals and energy
Research
Camera Culture

Making the invisible visible–inside our bodies, around us, and beyond–for health, work, and connection
Project Research

Future You: An Interactive Digital Twin System for Self-Reflection and Personal Growth

​Say hello to FutureYou!Imagine stepping into a time machine and having a conversation with your future self. What would you ask? What unex…
Research
Media Lab Research Theme: Life with AI

Life with AI | Designing the future of smart systems to improve the human experience
Research
Media Lab Research Theme: Future Worlds

Future Worlds | Design and action for the future we want to live in
Research
Media Lab Research Theme: Decentralized Society

Decentralized Society | Architecting the new internet for the good of the people
Research
Media Lab Research Theme: Cultivating Creativity

Cultivating Creativity | Catalyzing a global movement enabling everyone to unlock and unleash their individual and collective creativity
Research
Media Lab Research Theme: Connected Mind + Body

Connected Mind + Body | Revolutionizing the future of mental and physical wellbeing
Project Research

MemPal: Wearable Memory Assistant for Aging Population

We're living in an aging society with cognitive loss placing stress on caregivers to monitor older adults struggling with memory decline.&n…
Project Research

Theme | CityScope

City Science researchers are developing a slew of tangible and digital platforms dedicated to solving spatial design and urban planning cha…
Select 2024-08-08T13:14:28-04:00 xmp.iid:655b2e4a-a9f7-4035-9e3e-4fe730491061 xmp.did:655b2e4a-a9f7-4035-9e3e-4fe730491061 xmp.did:655b2e4a-a9f7-4035-9e3e-4fe730491061 saved xmp.iid:655b2e4a-a9f7-4035-9e3e-4fe730491061 2024-08-08T13:14:28-04:00 Adobe Bridge 2024 /metadata
Research
Space Exploration Initiative

Designing, prototyping, and building the artifacts of our sci-fi space future
Archived
Project Research

Deep Reinforcement Learning for Autonomous UAVs (AUAVs)

Many tasks are not easily defined and/or too complex for supervised machine learning approaches. For these reasons, a technique known as&nb…
Archived
Archived
Project Research

Fiducial Marker-Based Navigation for Autonomous UAVs (AUAVs)

Depending on the operational environment of an autonomous system, a great deal of perceptual uncertainty may be introduced to an object det…
Archived
Archived
Project Research

Domain Randomization & Synthetic Data Generation for AUAVs - Reducing Perceptual Uncertainty of Sim2Real Navigation

Navigation for autonomous UAVS (unmanned aerial vehicles) is a complex problem and physical field testing of associated tasks introduces a …
Archived
Project Research

Light Sculptures

This project transforms light into glass sculptures.  I developed a software systems to capture photographs of sunlight moving th…
Article Research

AI researchers build ‘future self’ chatbot to inspire wise life choices

Future You, developed by Dr. ​​Pat Pataranutaporn, allows users to explore possible futures by chatting with an older version of themselves.
Publication Research

Handheld Mapping of Specular Surfaces using Consumer-grade Flash Lidar.

Tsung-Han Lin, Connor Henley, Siddharth Somasundaram, Akshat Dave, Moshe Laifenfeld, and Ramesh Raskar. Handheld mapping of specular surfaces using consumer-grade flash lidar. In IEEE International Conference on Computational Photography (ICCP), 2024.
Post Research

Dexter Callender III awarded 2024 Harold and Arlene Schnitzer Prize in the Visual Arts

Callender was awarded this prize for his body of work, Light Sculptures, Matters of Impermanence.
Project Research

FuseBot: RF-Visual Mechanical Search

FuseBot is a robotic system that can efficiently find and retrieve both RFID tagged and untagged target objects in line-of-sight, non-line-…
Archived
Project Research

PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar

3D reconstruction from a single-view is challenging because of the ambiguity from monocular cues and lack of information about occluded reg…
Archived
Publication Research

PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar

Klinghoffer, Tzofi, et al. "PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar." IEEE Conference on Computer Vision and Pattern Recognition (2024).
Article Research

Researchers leverage shadows to model 3D scenes, including objects blocked from view

This technique could lead to safer autonomous vehicles, more efficient AR/VR headsets, or faster warehouse robots.
Project Research

City Science Lab @ Hamburg

MIT City Science is working with HafenCity University to develop digital tools to enable more livable communities. In one project, the team…
Post Research

Camera Culture students selected for National Science Foundation Graduate Research Fellowship Program (NSF-GRFP)

They've been selected as Fellows in the fields of Machine Learning and Computer Vision.
Post Research

Illuminate nominated for 2024 SXSW Innovation Award

Illuminate has been nominated for a 2024 SXSW Innovation Award in the Student Innovation category. Illuminate  is an in…
Project Research

Illuminate

What would it be like if we could see our movement? Illuminate (2023, Chelsi Alise Cocking) is an interactive art installation in whic…
Project Research

Andorra | Dynamic Urban Planning

Research in dynamic tools, mix users (citizens, workers) amenities, services, and land use, with the goal of promoting sustainable developm…
Archived
Project Research

Type experiments

​36 Days Of Type is an initiative that invites creatives to create their version of the letters and numbers of the Latin alphabet, one…
Archived
Article Research

How x-ray vision is becoming a reality

Tara Boroushaki, a PhD student in the Signal Kinetics group, explains how she's combined AR and wireless signals to find hidden objects.
Post Research

StoryLine: Exploring the intersection of visual storytelling and machine learning

McKinsey & Co. and LSM ask: Can we understand, and even predict, the relationship between video story content and audience consumption?
Project Research

Photorythms

Photorythms: a computational art-based inquiry of portrait photographyPhotorythms investigates whether computational methods such as facial…
Project Research

Detecting and Mapping Transparent or Mirror-like Surfaces with Lidar

Although lidar is widely used for mapping the 3D geometry of surfaces, the technology has historically been challenged by specular, or mirr…
Archived
Project Research

Bounce-Flash Lidar

In photography, illuminating a subject directly using an on-camera flash can result in unflattering photos. To avoid this, photographers o…
Archived
Project Research

Liquid Learning

Continuing the work of Liquid Movies, we introduce Liquid Learning, an extension for not simply recommending videos but encouraging people …
Project Research

Augmented Reality with X-Ray Vision

X-AR is an augmented reality (AR) system that gives humans "X-Ray Vision" X-AR is a new AR headset that enables users to see things th…
Project Research

What can we learn from predicting shadows?

By predicting sparse shadow cues, our physics-inspired machine learning algorithm can reconstruct the underlying 3D scene. Abstract. W…
Project Research

Modeling Contingent Behaviors in Multiparty Conversations

Recognizing and interpreting group behaviors is much more challenging than that of individual behaviors. Firstly, the system must perform w…
Project Research

Objects as Cameras

Press: - MIT News:  Using reflections to see the world from new points of view- TechXplore, EuropaPress, La Nacion …
Article Research

New research from the Signal Kinetics research group is featured on "Science Without the Gobbledygook"

Physicist Sabine Hossenfelder discusses X-AR, the new research from the Media Lab’s Signal Kinetics group.
Article Research

MIT researchers develop augmented reality headset to help users see hidden objects

Using augmented reality, the X-AR system developed by the Signal Kinetics research group can guide users to find hidden objects.
Archived
Research
Social Machines

Promoting deeper learning and understanding in human networks
Archived
Project Research

Liquid Movies

Video has evolved from an esoteric production to the default means of online and broadcast communication. We accept a wrong or lengthy vide…
Archived