Contributors

External Contributors

Seunghee Jeong, Wyss Institute for Biologically Inspired Engineering, Harvard
Martin Eric William Nisser, CSAIL, MIT

External Advisors 

Prof. Kristina Hook, KTH Royal Institute of Technology
Prof. Klas Hjort, Uppsala University

Vision

Our concept is inspired by two models in HCI;  intimate correspondence (Ingold) and co-adaptativity (Mackay). These models suggest an immediate and synchronized feedback loop in the interaction between the user and technology, where control is shared and dynamically shifting between the two agents.

What would it be like to have a dress that keeps on dancing when we take it off? 

To realize our vision, we foresee an intuitive paradigm for programming robotic materials; one that is closer to a form of craft, like a chef kneading his dough or a sculptor sculpting his clay. 

We propose an embodied programming of our everyday objects and environment through directly interacting with them via our bodily movements.

Integrated Patch Design + Fabrication

As a first step to realizing our concept, we started building a flexible and stretchable robotic patch that can attach and adhere to arbitrary soft bodies due to its compliant form.

We leverage spray deposition of custom localized resistive sensor nodes for each fiber muscle that constitutes the patch. For the fabrication of the sensor, we prepared a carbon black solution and applied layers of 30μm thickness with air-brush on the surface of the elastomer tubing. 

The main parameter that we tune in the actuator design is the variable stiffness of the ultra-thin shell encapsulating the fiber muscle. "Stiffness patterning" on the shell  caters for fabricating pre-programmed movements such as single-curve bending, multiple-curve bending and curling. 

Stiffness patterning can be done by coating or embedding a non-elastic layer of material in the desired part of the soft shell. In our case, we inlayed a non-elastic thread along the axis of choice. 

By using a combination of different stiffness-patterned fibers, one may program complex dynamic behaviors in a hybrid patch assembly, by performing the action with the robotic material.

Design Space

We are building patchbot’s mechanism so that it affords to record physical motion and dynamically respond to it. The reconfigurable design of the patch enables manifold morphing behavior and locomotion, while the ultra-thin sheet form makes the robot adherent to different parts of the human body. 

Concept: An On-body Locomoting Fabric Patch Assembly

As a first implementation, we wanted to make a soft robot that can navigate on the human body by sequential grip and extend motion which allows it to freely locomote on human limbs. 

The climbing patchbot consists of three modules; an extensible body and two pairs of semi-patterned limbs. We successfully fabricated the separate modules and their modular assembly with 3D printed connector parts. 

Current status: We are doing an analytical study on the required gripping force for different parts of the human body. When larger gripping forces are required the number of limbs can be multiplied and the assembly type of the fibers can be varied (e.g. braided fiber muscles).

Possible Applications + Future work

We envision our programmable patches working collectively to record and reconstruct movement data, add dynamic capability to passive objects, and enhance co-located and remote haptic communication for collaborative work and play. 

Our larger vision of robotic patches is that they become part of our everyday clothing seamlessly, like a soft exoskeleton with the kinetic memory of our ever-changing bodies in motion. Here we illustrate potential application scenarios to discuss how our interface opens up possibilities for the future of distributed robotic material for full-body interactions. 

Kinesthetic learning activity

During our previous studies with opera singers, we have found that articulating embodied and tacit knowledge of singing activity is challenging with only symbolic language. 

What would it be like to have a corset that dynamically fits the unique ways our breathing muscles move when we sing? 

We envision a kinesthetic teaching-learning scenario for vocal training; by capturing the movement of the instructor's breathing muscles and physically replaying on the learner's body via distributed robotic patches. 

Co-located / remote haptic communication

Patchbots can be utilized in co-located and remote haptic interactions such as augmenting inanimate objects with dynamic function or altering their already existing autonomous motion. Our example application is wearable robotic patches for drone tele-operation scenario; where the drone operator physically experiences the flight condition (e.g. wind, obstacles) of the drone directly on her body via kinesthetic feedback from the patches for a more intuitive control of the drone.

Another potential use case is haptic communication for body in extreme environments where proprioceptive feedback can be crucial for safety; such as a haptic interface embedded in a deep-diving suit for proprioceptive coordination in scientific ocean exploration and a non-verbal communication channel for co-located groups of recreational divers.

Dynamic physical assistants

Our larger vision for robotic fibers and patches that constitute patchbots, is that they seamlessly integrate to our everyday wearables and surfaces. To demonstrate this vision, we will fabricate a collective of patchbots functioning as a swarm UI assisting their user in finding balance and posture for daily bodily activities like yoga, movement tracking during sleep,  micro facial movement tracking e.g. jaw-clenching as a marker of stress.