The new medium of live performance graphics, a.k.a. visualization, is bridging the fields of music, art and computer science. In other words, the live, interactive visualization of music presents the classic challenge of combing technology and art.
What's so new about this medium?
In a nutshell, the visuals respond to the music in real time. The previous requirement to have someone behind the screen playing "Wizard of Oz" in order to synchronize the visuals and to cue the next affectation is no longer necessary. In other words, the performer is in control the imagery.
Unlike rock, hip-hop and theatrical music, where there is a persistent, steady beat established to serve as a timing mechanism, the live performance of classical and jazz music is full of fluctuating rhythms and tempos. To make the visuals synchronize to the music, someone behind the stage had to be physically in control to provide that timing and to cue the affectations. It is only in recent years that the technology has evolved so that the musician is finally in control of "when" and "what." At last, classical music can actively participate in the medium of visualization.
In order to emphasize this point of control, I deliberately informed the audience at the ITG 2007 concert that once the music and visualization started, I was going to walk away from the equipment and join them in the audience so they could be assured no one was behind the screen playing "Wizard." And I did. The musicians on stage applied all the fermatas, ritardanos, accelerandos and rubati they wanted, and the visuals stayed in sync. In fact, the piece I wrote for this concert (Round House) was intentionally loaded with these wild fluctuations in rhythm and tempo just to demonstrate this point.
That's what's new.
It’s time for the computer science and the art department to join the music department.
Assistance in presenting a visualization program to your organization can be obtained by contacting Sam Stalos at bnh@bnh.net or (214) 403-0005. The composer is offering to visit any organization or teaching institution that is interested in establishing a visualization course as part of its curriculum.
A handout giving the costs of establishing a visualization program and some indication of the background and training necessary to initiate such a program can be downloaded here.
Visualization & Live Performance Graphics
Are Available for the Following Scores and Orchestrations
Round House (Trains)
1. Brass Trio: Trumpet, French Horn, and Trombone
2. Chamber Orchestra: Double String Quartet, 3 Brass (Trumpet, French Horn, Trombone), 2 Woodwinds (Flute and Clarinet), and 3 Percussionists
If Round
Ballet for Flute
Flute Quartet: 2 C Flute, 1 Alto, 1 Bass
Nobody Move
Chorus (SATB), with Solo Instrument (Trumpet or Violin), 2 Synthesizers and 2 Percussionists
Hopscotch
Brass Quintet with Percussion
Although not an example of visualization techniques currently in use, this animation was produced with a font-based software program. The program and an explanation of the techniques can be seen here.
Copyright © 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007, 2008 ChariotPublishing.com/bnh.net/Sam Stalos. All rights reserved. Use of text, pictures, music or graphics in any form is prohibited.
