Research
Responsive Environments

Augmenting and mediating human experience, interaction, and perception with sensor networks
Select 2024-08-08T13:14:28-04:00 xmp.iid:80dc1423-df79-4be1-b8b1-a2d80250bb95 xmp.did:80dc1423-df79-4be1-b8b1-a2d80250bb95 xmp.did:80dc1423-df79-4be1-b8b1-a2d80250bb95 saved xmp.iid:80dc1423-df79-4be1-b8b1-a2d80250bb95 2024-08-08T13:14:28-04:00 Adobe Bridge 2024 /metadata
Research
MIT Center for Constructive Communication

Designing tools, methods and systems that connect rather than divide us to create a healthier society
Select 2024-08-08T13:14:28-04:00 xmp.iid:655b2e4a-a9f7-4035-9e3e-4fe730491061 xmp.did:655b2e4a-a9f7-4035-9e3e-4fe730491061 xmp.did:655b2e4a-a9f7-4035-9e3e-4fe730491061 saved xmp.iid:655b2e4a-a9f7-4035-9e3e-4fe730491061 2024-08-08T13:14:28-04:00 Adobe Bridge 2024 /metadata
Research
Space Exploration Initiative

Designing, prototyping, and building the artifacts of our sci-fi space future
Post Research

Paul Liang joins MIT Media Lab Media Arts + Science Program + EECS/Schwarzman College of Computing as Asst. Professor, AI + Human Experience

Paul Liang joins the MIT Media Lab's Program in Media Arts and Sciences (MAS) and MIT Schwarzman College of Computing with a shar…
Research
Fluid Interfaces

Designing Systems for Cognitive Support
Research
Viral Communications

People and intelligent machines in a creative, symbiotic loop
Research
Poetic Justice

Exploring new forms of social justice through art
Project Research

Earth Mission Control (EMC)

Advanced Data Visualizations for Climate IntelligenceMarked by heightened awareness and global concern over the climate crisis, the MI…
Research
City Science

Looking beyond smart cities
Research
Personal Robots

Building intelligent personified technologies that collaborate with people to help them learn, thrive, and flourish.
Archived
Project Research

PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar

3D reconstruction from a single-view is challenging because of the ambiguity from monocular cues and lack of information about occluded reg…
Archived
Publication Research

PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar

Klinghoffer, Tzofi, et al. "PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar." IEEE Conference on Computer Vision and Pattern Recognition (2024).
Research
Media Lab Research Theme: Decentralized Society

Decentralized Society | Architecting the new internet for the good of the people
Research
Media Lab Research Theme: Life with AI

Life with AI | Designing the future of smart systems to improve the human experience
Project Research

City Science Lab @ Hamburg

MIT City Science is working with HafenCity University to develop digital tools to enable more livable communities. In one project, the team…
Research
Beyond the Cradle

Beyond the Cradle
Research
Media Lab Research Theme: Connected Mind + Body

Connected Mind + Body | Revolutionizing the future of mental and physical wellbeing
Research
Future Sketches

Exploring the essence of code as a creative medium
Project Research

Theme | Attention, Memory & Learning

Projects related to the theme of how digital systems may support attention, memory, and learning.
Project Research

Augmenting Communication & Fostering Social Connection

As computing blends into everyday environments, powerful opportunities open up for social connection. How can we leverage technology to enh…
Project Research

Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality

This project was produced as part of the   2021 Snap Creative Challenge, focused on "The Future of Co-located Social AR."Wem…
Publication Research

Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity

Leong, Joanne, et al. "Exploring the Use of Real-Time Camera Filters on Embodiment and Creativity." Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 2021.
Project Research

Synthetic Self-Perception

Perceptual illusions have the power to change our abilities and behaviours. Prior research in virtual reality (VR) has shown that transport…
Publication Research

Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality

Joanne Leong, Olivia Seow, Cathy Mengying Fang, Benny J. Tang, Rajan Vaish, and Pattie Maes. 2022. Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality. In The Adjunct Publication of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22 Adjunct), October 29-November 2, 2022, Bend, OR, USA. ACM, New York, NY, USA, 3 pages.
Project Research

"Picture the Audience" Exploring Private AR Face Filters for Online Public Speaking

This work was presented  at  the ACM CHI 2023 conference. By Joanne Leong, Florian Perteneder, Muhender Raj Rajvee, and…
Thesis Research

Investigating the Use of Synthetic Media and Real-Time Virtual Camera Filters for Supporting Communication and Creativity

Leong, Joanne. Investigating the Use of Synthetic Media and Real-Time Virtual Camera Filters for Supporting Communication and Creativity. 2021. Massachusetts Institute of Technology, MS Thesis.
Publication Research

"Picture the Audience...": Exploring Private AR Face Filters for Online Public Speaking

Joanne Leong, Florian Perteneder, Muhender Raj Rajvee, and Pattie Maes. 2023. “Picture the Audience...”: Exploring Private AR Face Filters for Online Public Speaking. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 13 pages. https://doi.org/10.1145/3544548.3581039
Project Research

Theme | Attention, Memory & Learning (OLD)

Several of our projects aim to support learning and creativity. While some systems focus on a specific skill to be strengthened, e.g.,…
Research
Media Lab Research Theme: Future Worlds

Future Worlds | Design and action for the future we want to live in
Project Research

Theme | CityScope

City Science researchers are developing a slew of tangible and digital platforms dedicated to solving spatial design and urban planning cha…
Research
Tangible Media

Invent new tangible and embodied interactions that inspire and engage people
Archived
Project Research

Essence Wearables: Biometric Olfactory Interfaces for Day and Night

Human-computer interaction (HCI) has traditionally focused on designing and investigating interfaces that provide explicit visual, auditory…
Archived
Project Research

Dormio: Interfacing with Dreams

InspirationSleep is a forgotten country of the mind. A vast majority of our technologies are built for our waking state, even though a thir…
Research
Opera of the Future

Extending expression, learning, and health through innovations in musical composition, performance, and participation
Archived
Project Research

Taking a line on a walk

Bauhaus artist Paul Klee considered a line to be  one of the atomic elements of art and architecture. He famously described a line dra…
Archived
Project Research

Augmented Reality Livecoding

Char Stiles debuted "Fastest Integer Multiplier" at Amant Gallery's "For Your Reference." This performance used a custom tool CARL&nbs…
Project Research

Andorra | Dynamic Urban Planning

Research in dynamic tools, mix users (citizens, workers) amenities, services, and land use, with the goal of promoting sustainable developm…
Research
Media Lab Research Theme: Cultivating Creativity

Cultivating Creativity | Catalyzing a global movement enabling everyone to unlock and unleash their individual and collective creativity
Post Research

Live-Coding, Performance, And Computational Art With Char Stiles

Arts in Tech Podcast based in Heinz College at Carnegie Mellon University Interviews Char Stiles from Future Sketches
Project Research

AttentivU

There are currently  UROP openings for this project. AttentivU is  a  device, in the  form factor of a pair of gla…
Research
Camera Culture

Making the invisible visible–inside our bodies, around us, and beyond–for health, work, and connection
Research
Signal Kinetics

Inventing, building, and deploying wireless sensor technologies to address complex problems in society, industry, and ecology
Article Research

Curiosity Unbounded Episode 4: Build your own superpower, then share it with the world

On Curiosity Unbounded, Professor Fadel Adib, head of the Signal Kinetics group, talks to MIT President Sally Kornbluth about his work.
Article Research

How x-ray vision is becoming a reality

Tara Boroushaki, a PhD student in the Signal Kinetics group, explains how she's combined AR and wireless signals to find hidden objects.
Project Research

Detecting and Mapping Transparent or Mirror-like Surfaces with Lidar

Although lidar is widely used for mapping the 3D geometry of surfaces, the technology has historically been challenged by specular, or mirr…
Archived
Project Research

Bounce-Flash Lidar

In photography, illuminating a subject directly using an on-camera flash can result in unflattering photos. To avoid this, photographers o…
Archived
Project Research

Battery-free wireless underwater camera

More than 95% of the ocean has never been observed by humans, even though the ocean plays the largest role in the world's climate system, h…
Project Research

Augmented Reality with X-Ray Vision

X-AR is an augmented reality (AR) system that gives humans "X-Ray Vision" X-AR is a new AR headset that enables users to see things th…
Project Research

Deep Reinforcement Learning for Autonomous UAVs (AUAVs)

Many tasks are not easily defined and/or too complex for supervised machine learning approaches. For these reasons, a technique known as&nb…
Project Research

Domain Randomization & Synthetic Data Generation for AUAVs - Reducing Perceptual Uncertainty of Sim2Real Navigation

Navigation for autonomous UAVS (unmanned aerial vehicles) is a complex problem and physical field testing of associated tasks introduces a …
Project Research

Unmanned Aerial Vehicle (UAV) Pilot Simulator

With the advent of real-time photorealism (RTPR), virtual environments are now able to achieve higher degrees of engagement than ever befor…
Project Research

Oceans Internet of Things

Our Oceans IoT technologies enable new applications in climate and ecological monitoring, aquaculture, energy, and robotic navigation. …
Article Research

Virtual reality system lets you stop and smell the roses

Media Lab alum Judith Amores talks to Scientific American about a lightweight, wireless interface to deliver scents to VR users.
Article Research

New research from the Signal Kinetics research group is featured on "Science Without the Gobbledygook"

Physicist Sabine Hossenfelder discusses X-AR, the new research from the Media Lab’s Signal Kinetics group.
Article Research

MIT researchers develop augmented reality headset to help users see hidden objects

Using augmented reality, the X-AR system developed by the Signal Kinetics research group can guide users to find hidden objects.
Post Research

Hope Schroeder and collaborators receive CHI 2023 Best Case Study award

Congratulations to Hope Schroeder and collaborators on receiving the single Best Case Study award at CHI'23.
Article Research

Augmented reality headset enables users to see hidden objects

The device could help workers locate objects for fulfilling e-commerce orders or identify parts for assembling products.
Article Research

Assistive tech gains at CES in Las Vegas

Spinoff Xander, founded by alum Alex Westner, provides real-time captions to help users with hearing loss follow in-person conversations.
Post Research

Spinoff Xander raises $1.4 million in pre-seed funding

Xander plans to launch its first product, XanderGlasses, designed for people with hearing loss or auditory processing challenges.
Article Research

The One Earth Model: Geographic interoperability in the real-world metaverse

Michael Naimark considers the potential of the "real-world metaverse," which combines virtual experiences with specific physical places.
Post Research

Media Lab spinoff Xander honored at CES 2023

Co-founded by Media Lab alum Alex Westner, Xander will introduce its first product, XanderGlasses, at CES 2023.
Archived
Project Research

Using Shadows to See Behind Objects

The full text of our paper is available here.Sometimes the thing that we want to see is hidden behind something else. A neighboring vehicl…
Archived
Archived
Project Research

TangiBel Soundscapes

Words are fleeting. Moments come and go, and what we vocalize “disappears into thin air."In this project, TangiBel Soundscapes, we propose …
Archived
Archived
Project Research

PsychicVR: Increasing mindfulness by using Virtual Reality and Brain Computer Interfaces

We present PsychicVR, a proof-of-concept system that integrates a brain-computer interface device and virtual reality headset to improve mi…
Archived
Archived
Project Research

ZoomADay - AI Synthesized Characters

#ZoomADay was a year long project exploring the creation and use of synthetic characters and deep fakes for use in online telepresence and …
Archived
Archived
Research
Open Ocean

Open Ocean
Archived
Research
Object-Based Media

Changing storytelling, communication, and everyday life through sensing, understanding, and new interface technologies
Archived
Project Research

ARTextiles: Promoting Social Interactions Around Personal Interests

Abstract data visualizations for enhancing social interactions through clothing and augmented reality.
Archived
Archived
Project Research

Inertia

Inertia is a platform for exploring physical interactions between real active agents and virtual elements in an augmented reality environme…
Archived