Chord Recognition in Beatles Songs

Chord Recognition in Beatles Songs

While a graduate student at MIT’s Media Lab, I collaborated with office-mate Vi­ctor Adán to explore how if we might train a machine to recognize chord changes in music. We tried multiple models to solve the problem, including Support Vector Machines, Neural Networks, Hidden Markov Models, and a few variations of Maximum Likelihood systems.

We chose Beatles tunes as a subset of the larger problem and trained our systems with 16 songs from three of their albums. Our systems processed 2700 training samples, 150 validation samples, and 246 testing samples. Our most successful system, a Support Vector Machine, achieved 68% accuracy in testing.

Our intention was to further the research which will lead to applications such as automatic transcription, live tracking for improvisation, and computer-assisted (synthetic) performers. Our models were an extension of the research provided by the following papers:

  • Musical Key Extraction from Audio, Steffen Pauws
  • Chord Segmentation and Recognition using EM-Trained Hidden Markov Models, Alexander Sheh and Daniel P.W. Ellis
  • SmartMusicKIOSK: Music Listening Station with Chorus-Search Function, Masataka Goto
  • A Chorus-Section Detecting Method for Musical Audio Signals, Masataka Goto

Main Website

Similar Posts

  • Ghost in the Machine

    Originally conceived in 2008, Ghost in the Machine (GITM) consists of a webcam and display which mixes and crossfades events in realtime with motion-activated video it has recorded previously. It continually shifts between 3 states: individual, community, and the world. GITM has been shown in many venues and contexts.

  • SoundBlocks

    SoundBlocks is a tangible environment where youth connect blocks to describe network dataflow. The environment explores digital sound manipulation as a personal, meaningful and fun artistic endeavor, rather than as a venture into mathematical, electronic or networking relationships.

  • Have a Seat!

    Have a Seat! is a playful interactive installation in which a video of a traveler of both time and space urges viewers to sit on a couch. When three people sit close together on the couch a special broadcast or snippet of The Muppet Show plays. Strangers coming to view the work find themselves uncomfortably…

  • Avian Migration

    In 2018 I collaborated with Artist Lisa Rundstrom and artist/engineer Tom McGuire to create the public art sculpture, Avian Migration at Wichita’s new Advanced Learning Library. Avian Migration consists of more than 1,300 LEDs controlled by 8 motion-activated sensors spread throughout the library. I was primarily responsible for the development and implementation of the software…

  • DoubleTalk

    Doubletalk, a two player audio-manipulation game was my first serious endeaver with the Gameboy. The game used the Pocketvoice, a Gameboy cartridge with a built-in amplified speaker and microphone. In Doubletalk, players record themselves, reverse their recordings, then try to guess what each other is saying.