Digital Puppetry

Digital Puppetry

Meet the Puppeteers!

While a graduate student at MIT’s Media Lab, I worked with a team of colleagues, community members, and urban youth. Our intention was to help the youth learn in a playful environment, find personal self-expression, and have their voices heard by communities in Boston. To do this, we adapted commercially available technology to provide a unique medium: digital puppetry.

Foot Controllers could remap glove motions on the fly
Foot Controllers could remap glove motions on the fly

Working with members of the Computer Clubhouse, I led the hardware team. We adapted P5 gloves to send MIDI signals, which in turn triggered flash animations using Arkaos VJ. Our design used Microchip’s PIC 18F252 Microcontroller running a Logo virtual machine aka The Logochip. We also developed foot controllers based on The Logochip which interfaced with the gloves to remap the glove’s controls on the fly.

Otis, a puppeteer, shows the glove off
Otis, a puppeteer, shows the glove off

The youth wrote a story capturing a typical day in their urban lives. They then drew the animations, wrote the music, and gave three performances as digital puppeteers. Our last performance was May 8, 2004 at the Puppet Showplace Theatre in a digital puppet slam.

Similar Posts

  • Still Life

    In 2011, as part of Hack.Art.Lab, I collaborated with composer Mary Ellen Childs and percussionist Michael Holland to create live animation triggered by live performance of Mary Ellen Childs’ composition “Still Life.” We analyzed the piece into 11 sections and created algorithmic video triggered by sound and motion to match each of the 11 sections. The video was projected…

  • Touch #2

    Touch #2 is a playful virtual environment and an interactive, musical instrument. Viewers become participants through play. The work transforms any flat wall into a touch-sensitive surface. A projector and infrared camera mount on the ceiling and infrared emitters mount on top of the wall, allowing the work to detect as many as 10 touches…

  • Touch #1

    In 2012 I created my first interactive touch wall: Touch #1. The work built on my experience creating the visuals for Still Life and was largely inspired by seeing autistic children experiencing pure joy while interacting in an immersive environment. Touch #1 received a great response and was later installed at Exploration Place and at…

  • SoundScratch

    SoundScratch is a set of extensions I wrote to manipulate audio in a children’s programming language called Scratch. The environment emphasizes the expressive capabilities of sound through the act of creation and design.

  • Have a Seat!

    Have a Seat! is a playful interactive installation in which a video of a traveler of both time and space urges viewers to sit on a couch. When three people sit close together on the couch a special broadcast or snippet of The Muppet Show plays. Strangers coming to view the work find themselves uncomfortably…