Kids Making Music: Interactive Music Box Draws Experience from Games

Ten minutes. Four or five kids (or adults). Make a song. Go.

That’s the idea behind the Youth Music Box, developed by Silent Studios and Chris O’Shea. (Our friend Chris you may recall from various interactive projects and the blog pixelsumo; he sends this project our way.) The software is build in openFrameworks, the C++-based creative coding environment for artists.

With keys, drums, and yes, even a scratching DJ-style interface, the music box brings together kids for quick music making, inspired by the phenomenon of musical games. The experience is guided by genre, with some effort to make sure whatever they do sounds good, but it’s extraordinary how effective it is at conveying the experience of the successful jam. It’s a bit of a confidence builder, in other words, for a group musical experience, perhaps more so than those ear-splitting, cheap plastic recorder consorts I recall from my youth.

And oh yeah, those kids look super cute once they get rocking out. (See video below.)

Youth Music Box Experience from Silent Studios | Resonate on Vimeo.

All of this raises some fascinating questions, and not always with the answers you might expect. In a normal musical ensemble, you begin sounding like crap, amp up difficulty, and eventually sound something like this – at least as far as coherence goes, assuming you’re not aiming for experimental free jazz. But with the addition of technology, whether musical games or the presets on our favorite synths or the quantization and beat-synced loops of our sequencers, it goes something in reverse. You start out sounding like this, pull apart the mechanisms that make you sound a certain way, and eventually find your way to your own personal approach. (And at some point, you get some of the readers on this site, writing code to produce their own sounds and musical structures line by line.) In fact, one could imagine scaling difficulty of even this particular setup, gradually adding greater musical freedom and taking away the “training wheels” of all the rules-based restrictions that make the results sound a particular way.

read more

Game Music Inspiration: Amon Tobin and Sony on Infamous

Wired has a great mini-documentary on the score for the videogame Infamous. It’s chock full of sound design ear candy, not only served by the chops of composer Amon Tobin but the team at Sony Music and Sony’s entertainment division, as well. Curiously, Jonathan Mayer, Music Manager at SCEA, says explicitly that he doesn’t want composers writing interactive music. He’d prefer to have them write a conventional score and then adapt it to the interactive engine. Now, of course, around these parts we like the idea of composers finding ways to write genuinely generative and interactive scores. But in this case, Mayer is acting as a kind of remix artist for the game realm, sampling Tobin’s compositions and reconceiving them in the game world. That kind of collaboration could be powerful.

Chuck Doug, SCEA music director, overstates things a bit by claiming this game has a unique aesthetic. The visuals are a burnt-out, post apocalyptic city – yeah, been there quite a few times. The music involves lots of ethnic percussion-y instruments and bowed metal and deep booming sounds. (Let me get this straight: we’ll hear a plucky stringy thing, then a bowedy metally thing, then there will be a big boom!) So, generally, not some radical new departure from game and motion soundtracks. But regardless of its novelty, I’d be an utter killjoy to complain: it sounds utterly gorgeous.

Previously:

I got to listen in on a lot of gems regarding sound design from composer Troels Folmann. He doesn’t just bow metal instruments – he boils them.

GDC: Boiling Waterphones and Other Sonic Inspirations from Composer Troels Folmann

And on the subject of getting composers to write interactively, Matt Ganucheau has been teaching that way:

Teaching Adaptive Music with Games: Unity + Max/MSP, Meet Space Invaders!

Monolake Interactive Music for Jet Lag: Installed Max/MSP Audio, Free MP3 Download

yetlag

Eno had Music for Airports. It’s fitting that Monolake would do Music for Jet Lag. Robert Henke writes about this month’s free download:

Since I also have been flying a lot recently, I named it after one of the most annoying side effects of modern transportation and mixed it in a way that reflects that dizzy feeling of being hyper active and totally asleep at the same time. ( "Last call for mister Robert Henke, flying to Berlin, please come to gate B 154 IMMEDIATELY or we will unload your luggage !!!!!!!!!" )

I am myself recovering from jetlag on the way to Portugal, so the timing is perfect. In a way, I have to say I sometimes oddly enjoy the disorienting feeling. I don’t think it’d be terribly addictive, but it’s a physical, profound reminder of traveling a great distance, something you could otherwise ignore in the age of absurdly-fast jet travel.

Grab the download here:

Free Downloads of the Month [yetlag, May 2009 – should be archived if you’re catching this late]

Installation details:

http://monolake.de/installations/lufthansa.html

The installation is fascinating in itself: a Max/MSP-powered, interactive sound score for a giant flight simulator, a model of the presence of jets, travel, and air traffic control. Robert did the sound; Christopher Bauder of white void was the concept and very elegant visual design. (See also Aaron Koblin’s striking Processing-based visual piece Flight Patterns, which seems to have embedded itself on a certain airborne digital zeitgeist. The United States becomes a feathery web of connections and flying traffic. You can imagine how this might continue to be mined in sound.)

As we work to keep our creative process flowing, I especially love the idea of focusing on a feeling to get a production started, as Monolake did here. So often, it’s too easy to get caught up in something technical or some very particular idea, then lose that in the process. By focusing on a feeling or deeper sentiment, it’s possible to remain connected to the ethos of what the track really means to us.

Of course, travel too much, and that may just wind up being … well, jet lag.

Meanwhile, as I listen to more music piped through airport terminals and even Metro stations, I wish Eno’s original idea had caught on.

GDC: Music, Games, Interactivity Pt. II, Plus Embarrassing Dance Footage

In the thrilling conclusion of our chat with Boing Boing’s Xeni Jardin, Matt Ganucheau and I explore deep thoughts about the roles of interactivity and adaptivity in music and game design — then attempt to dance in giants Katamari Damacy hats. (Note the use of the word attempt — those things were more than a bit tricky to move in. Hilarity ensues.)

Prior to leading a dance dance Revolución, we talk a bit about the ways in which game design relate to gesture in musical interface and how musical scores could become non-linear. The gesture issue really goes well beyond games to the fundamental question of how to relate to music physically — and, in a way, awkwardly-dancing musicians may be a fitting metaphor. Or parable. Or something or other.

We do it all for you.

I really did find this a fascinating way to promote discussion, so if you’ve got suggestions for future broadcasts, I’d love to hear them. You can even think of new silly things for us / guests to do.

See also, related:
Troels Folmann on the boiled waterphone-style instrument, sound design inspiration
Troels on “micro-scoring” adaptive music

For part the first:
GDC: Music, Video Games, and Interactivity – Chat with Boing Boing Video

Teaching Adaptive Music with Games: Unity + Max/MSP, Meet Space Invaders!

Game Audio: Selected Student Works from Matt Ganucheau on Vimeo.

In the early days of game sound, musical soundtracks were all largely adaptive and interactive, fused with the sound effects of the game and the logic of gameplay. Scores were less Alfred Newman or John Williams, more Spike Jones. Today, game music has the potential to reinvent composition itself, to help us reimagine what makes a musical score as on-screen user action drives musical ideas. But with a few, notable exceptions, most modern titles have opted for big, Hollywood-style soundtracks – and the linear composition that goes with them, as though someone just took a film score CD and hit play.

It’s one thing to talk about that in theory. Better yet: give it a shot yourself. So why not teach game music as its own discipline?

Matt Ganucheau, a composer, sound designer, and interactive developer/artist, is teaching just that, working with students at Expression College in Emeryville, California. The accelerated course works with the elegant Unity game engine and a clone of the legendary Space Invaders arcade game, adding music built in Max/MSP. If Max seems an unlikely choice, its open source cousin Pure Data (Pd) is actually integrated with the game engine for Electronic Arts’ Spore, with music by Brian Eno working with EA’s Kent Jolly and contributor Aaron McLeran. So, this could be the wave of the future. The first problem: figuring out how to actually compose.

The results are astonishing, given that the students were just learning Max and had extremely limited amounts of time. I asked Matt to write up for CDM how the coursework evolved; he shares his process and what he learned as a teacher. We’re also working on open sourcing the coursework content and the patches, which we’ll soon provide both for Pd and Max/MSP. I’m doing some work on the game side so that you can play with game mechanics in Processing. Stay tuned for more on that.

We spoke a bit about this process – and interactive music in general – with Xeni Jardin and Boing Boing in their Game Developer Conference livecast a week ago Friday. Edited video of that coming soon.

Here’s Matt on the coursework itself:

read more