Evolving Cultural Heritage through Collaborative Choreography with Generative Virtual Characters

This project aims to develop new methods for preserving and extending intangible cultural heritage through AI and computational modeling, specifically by translating the embodied knowledge of traditional dance into interactive systems that enable novel forms of human-AI collaboration in performance.

This initiative represents a collaboration between an interdisciplinary team led by Pichet Klunchun, the internationally acclaimed Thai choreographer and founder of Pichet Klunchun Dance Company, and Pat Pataranutaporn, who leads the Cyborg Psychology research group at the MIT Media Lab. By bringing together expertise in traditional Thai dance, contemporary choreography, human-computer interaction, and artificial intelligence, this collaboration bridges cultural traditions with cutting-edge technology.

Rather than merely documenting dance, this research seeks to encode the underlying principles and logic of traditional movement systems in ways that remain dynamic, responsive, and generative. The project introduces an approach for translating traditional dance knowledge into interactive computational models, extending far beyond static dance performance recordings or simple motion capture archives.  Specifically, this research presents the concept of "Human-AI co-dancing", a framework that integrates human dancers with virtual avatars powered by models derived from foundational dance principles. Unlike conventional animation or pre-programmed sequences, these virtual avatars embody the structural rules and aesthetic sensibilities of traditional forms, enabling authentic improvisational exchange between human performers and computational systems.

To demonstrate this concept, the project focuses on choreographic principles deconstructed from the deep knowledge systems of traditional Thai dance, a form with centuries of history and highly codified movement vocabularies. These principles, which encompass elements such as body positioning, gestural vocabulary, spatial orientation, rhythmic patterning, and the subtle qualities of energy and intention, have been carefully analyzed and translated into computational procedures. These procedures dynamically manipulate the movements of a virtual character by altering animation keyframes and the motions of individual joints in real-time, allowing the virtual dancer to respond, adapt, and co-create within the logic of traditional Thai dance aesthetics.

The team developed an interactive system that enables dancers to improvise alongside the virtual agent in a shared performative space. The system incorporates voice control functionality, allowing not only the dancer but also the choreographer and even the audience to participate in shaping the choreography of the virtual avatars. By adjusting parameters that represent core traditional Thai dance elements, multiple participants can influence the unfolding performance, democratizing choreographic authorship and creating new possibilities for audience engagement.

Through extensive Human-AI rehearsals, the team observed intriguing artistic results. Hybrid movement aesthetics emerged from both the synergy and friction between humans and machines—moments where the virtual and human dancers moved in harmonious dialogue, as well as productive tensions where their differing logics created unexpected movement inventions. These rehearsals revealed that the computational "misunderstandings" or reinterpretations of traditional principles could themselves become sources of creative discovery.

The resulting dance production, "Cyber Subin," demonstrates the profound potential of combining intangible cultural heritage, intelligent technology, and posthuman choreography. The work expands the possibilities of artistic expression while simultaneously preserving and reactivating traditional wisdom within a contemporary context. Rather than treating heritage as a frozen artifact, this approach positions traditional knowledge as a living, evolving system capable of generating new forms and meanings through technological mediation.

This collaboration ultimately poses critical questions about the future of cultural preservation, the nature of embodied knowledge, and the creative possibilities that emerge when human artistry and artificial intelligence meet on the shared ground of the stage.