Digital Puppetry

Digital Puppetry

Meet the Puppeteers!

While a graduate student at MIT’s Media Lab, I worked with a team of colleagues, community members, and urban youth. Our intention was to help the youth learn in a playful environment, find personal self-expression, and have their voices heard by communities in Boston. To do this, we adapted commercially available technology to provide a unique medium: digital puppetry.

Foot Controllers could remap glove motions on the fly
Foot Controllers could remap glove motions on the fly

Working with members of the Computer Clubhouse, I led the hardware team. We adapted P5 gloves to send MIDI signals, which in turn triggered flash animations using Arkaos VJ. Our design used Microchip’s PIC 18F252 Microcontroller running a Logo virtual machine aka The Logochip. We also developed foot controllers based on The Logochip which interfaced with the gloves to remap the glove’s controls on the fly.

Otis, a puppeteer, shows the glove off
Otis, a puppeteer, shows the glove off

The youth wrote a story capturing a typical day in their urban lives. They then drew the animations, wrote the music, and gave three performances as digital puppeteers. Our last performance was May 8, 2004 at the Puppet Showplace Theatre in a digital puppet slam.

Similar Posts

  • Build Day

    As founding Director of WSU’s Center for Research in Arts, Technology, Education and Learning (CRATEL) I hosted Build Day every Friday. On Build Day, CRATEL was open to visitors, volunteers, or anybody who wanted to come by, chat, or build something.

  • Ballet Wichita: Innovations

    As part of the Ballet Wichita’s Innovations performance April 2024 I teamed up with Wichita State University’s Shocker Studios to track a dancer live, reinterpreting their motions on a stage-sized display behind them. Wichita State University’s Fairmount String Trio accompanied the dance, performing Dohnányi’s Serenade. To track the dancer we used 3 Vive 3.0 trackers…

  • Touch #2

    Touch #2 is a playful virtual environment and an interactive, musical instrument. Viewers become participants through play. The piece installs on any flat wall with a high ceiling. Sensors mount on top of the wall to detect multitouch. A virtual environment of suns, stars and planets projects onto the wall. Gravity, inertia, friction, and wind…

  • Still Life

    In 2011, as part of Hack.Art.Lab, I collaborated with composer Mary Ellen Childs and percussionist Michael Holland to create live animation triggered by live performance of Mary Ellen Childs’ composition “Still Life.” We analyzed the piece into 11 sections and created algorithmic video triggered by sound and motion to match each of the 11 sections. The video was projected…

  • Microphone with proximity detection

    Around 2004 I developed a few protoype microphones enhanced to also offer proximity detection. The microphone could adjust it’s amplitude and bass response based on the proximity of the person using it. This would lessen the variable results users experience when holding a microphone too close or too far. Moreover, with proximity or its derivative mapped to a combination…

  • String Improvation

    In 2001 I founded Wichita State University’s String Improvisation Department and established WSU’s yearly String Improvisation Day each year, an introduction to string improvisation for string players who had little or no experience with improvisation. I then expanded our String Improvisation program with a new grant-funded initiative: Sharing Music Sharing Culture (SMSC) which connected The Irish World Music Center students and faculty with WSU.