Digital Puppetry

Digital Puppetry

Meet the Puppeteers!

While a graduate student at MIT’s Media Lab, I worked with a team of colleagues, community members, and urban youth. Our intention was to help the youth learn in a playful environment, find personal self-expression, and have their voices heard by communities in Boston. To do this, we adapted commercially available technology to provide a unique medium: digital puppetry.

Foot Controllers could remap glove motions on the fly
Foot Controllers could remap glove motions on the fly

Working with members of the Computer Clubhouse, I led the hardware team. We adapted P5 gloves to send MIDI signals, which in turn triggered flash animations using Arkaos VJ. Our design used Microchip’s PIC 18F252 Microcontroller running a Logo virtual machine aka The Logochip. We also developed foot controllers based on The Logochip which interfaced with the gloves to remap the glove’s controls on the fly.

Otis, a puppeteer, shows the glove off
Otis, a puppeteer, shows the glove off

The youth wrote a story capturing a typical day in their urban lives. They then drew the animations, wrote the music, and gave three performances as digital puppeteers. Our last performance was May 8, 2004 at the Puppet Showplace Theatre in a digital puppet slam.

Similar Posts

  • SoundScratch

    SoundScratch is a set of extensions I wrote to manipulate audio in a children’s programming language called Scratch. The environment emphasizes the expressive capabilities of sound through the act of creation and design.

  • Microphone with proximity detection

    Around 2004 I developed a few protoype microphones enhanced to also offer proximity detection. The microphone could adjust it’s amplitude and bass response based on the proximity of the person using it. This would lessen the variable results users experience when holding a microphone too close or too far. Moreover, with proximity or its derivative mapped to a combination…

  • TechArtICT: Whispering Woodlands

    Whispering Woodlands was an outdoor installation created by TechArtICT. It was installed at Exploration Place in Wichita, Kansas from November 2023 through January 2024. The work featured 24 independently controlled sets of speakers and LEDs, all synchronized to create an immersive sound and lightscape. Using eclectic audio ranging from thunder and rain to spaceships and…

  • SoundBlocks

    SoundBlocks is a tangible environment where youth connect blocks to describe network dataflow. The environment explores digital sound manipulation as a personal, meaningful and fun artistic endeavor, rather than as a venture into mathematical, electronic or networking relationships.