For many, mobile technology and developing for the iPhone and the iPod touch is a fad and a Gold Rush. Good designers, though, take a longer view of how interaction can be expressive. And there are few people with a better sense of the big picture of small devices than Dr. Ge Wang. The co-founder, CTO, and Chief Creative Officer of Smule has a background that goes well beyond the latest Apple platform. Along with Perry Cook at Princeton, Ge Wang is the co-originator of ChucK, a real-time programming language for synthesis so efficient some people use it live onstage. (ChucK, as an open source project, now has a terrific team of people behind it.) ChucK is the sonic engine that powers Smule’s projects. Ge Wang also teaches at Stanford, working with students and fellow researchers to explore new ways of interacting with music technology.

Ge Wang joined me for a lengthy phone conversation recently. He really contextualized why the iPhone is important in the grand scheme of things, but also how the people at Smule and Stanford (and Princeton) can approach technology for musical interaction, focusing on what devices are rather than what they’re not.

(The audio here, believe it or not, is extensively edited – Ge Wang is that easy to talk to. I hope the next time it’s over beers rather than Skype.)

The full interview can be played below, or downloaded directly.

Play this track:

Download MP3 of the interview

Thanks to KORG and the Nano Series for their support of programming on createdigitalmusic.com.

Lastly: a video of the Smule team headquarters and playing around with Leaf Trombone for a Zelda duet!

More information:
The Mule Chronicles [Smule Blog]
http://smule.com/
Center for Computer Research in Music and Acoustics (CCRMA), Stanford University

Previously, for more on Ge Wang and CCRMA:
Make:TV Meets Stanford Musical Inventors, Feedback Piano

Video + Audio Subscriptions, iTunes Podcast

CDM is now launching regular audio content on the artists and inventors we cover as part of our series CDM Sounds. You can subscribe (and review the podcast) via iTunes, where you’ll also find our new video series:

cdm Sounds Podcast [audio]
cdm TV [video]

Or using your software of choice, subscribe directly to RSS. (I like to follow podcasts with Banshee and Winamp this way.)

We’ve fixed some transcoding issues for iPod touch/iPhone on the video podcast. Please do test this and let us know if you have any issues on your software/hardware.

Speaking of games, you can expect game production to start to attract the attention of musicians and web publishers. Whereas a few short years ago, targeting musicians might mean dangling rock club gigs or album sales, now a lot of those same music makers want to break into gaming, too.

Kongregate is a bit like public access, only on steroids and for games. The idea is this: get indie game makers in one place contributing games, then get lots of people playing those games, then support the system with ad revenue shared with the game makers. The model has grown rapidly, with millions of users and over 15,000 original games.

The newest project from Kongregate looks to connect artistic talent on projects, including musicians, composers, and sound designers wanting to work on game projects. The Collabs section will see artists and sound and music creators uploading their work to find collaborators. Initially, there’s a contest on, with competition for attention, cash, and studio prizes.

http://www.kongregate.com/collabs

The competition aside, this could be the beginning of a successful community for collaboration in the indie Flash gaming world. Assets are often uploaded under a Creative Commons license, and I see one of the top sounds draws on samples from Freesound.org. While career success is an obvious goal, the contributors so far appear to see sharing as a way to get there – in stark contrast to the model in the mainstream, big-business game industry. Quality is, of course, variable, but ask anyone in the game industry how to become successful and the answer is always make as much as you can. Getting work out there, even primitive, can be part of a learning process. So I’m eager to see what transpires as these kinds of communities grow.

There is an invariable comparison to Deviant Art – and you’ll see they’ve already begun to invade.

Oh yeah, and I quite like these glassy tendrils, rendered in Cinema 4D. Image (CC) Chaodeath. Now, make that run real-time. Or, erm, imagine those are virtual renderings of artists … collaborating.

Wired has a great mini-documentary on the score for the videogame Infamous. It’s chock full of sound design ear candy, not only served by the chops of composer Amon Tobin but the team at Sony Music and Sony’s entertainment division, as well. Curiously, Jonathan Mayer, Music Manager at SCEA, says explicitly that he doesn’t want composers writing interactive music. He’d prefer to have them write a conventional score and then adapt it to the interactive engine. Now, of course, around these parts we like the idea of composers finding ways to write genuinely generative and interactive scores. But in this case, Mayer is acting as a kind of remix artist for the game realm, sampling Tobin’s compositions and reconceiving them in the game world. That kind of collaboration could be powerful.

Chuck Doug, SCEA music director, overstates things a bit by claiming this game has a unique aesthetic. The visuals are a burnt-out, post apocalyptic city – yeah, been there quite a few times. The music involves lots of ethnic percussion-y instruments and bowed metal and deep booming sounds. (Let me get this straight: we’ll hear a plucky stringy thing, then a bowedy metally thing, then there will be a big boom!) So, generally, not some radical new departure from game and motion soundtracks. But regardless of its novelty, I’d be an utter killjoy to complain: it sounds utterly gorgeous.

Previously:

I got to listen in on a lot of gems regarding sound design from composer Troels Folmann. He doesn’t just bow metal instruments – he boils them.

GDC: Boiling Waterphones and Other Sonic Inspirations from Composer Troels Folmann

And on the subject of getting composers to write interactively, Matt Ganucheau has been teaching that way:

Teaching Adaptive Music with Games: Unity + Max/MSP, Meet Space Invaders!

Play this track:

Play this track:

Play this track:

Play this track:

Play this track:

Award-winning composer Troels Folmann has made a name as a video game composer on the likes of the Tomb Raider series, as well as espousing new ideas about adaptive music for games like his “micro-scoring” methodology. But speaking to a roomful of composers and sound designers at the recent Game Developer Conference, he turned to the topic of reinvention. Even having perfected signature sounds that keep him in demand on jobs like blockbuster feature trailer soundtracks, Troels challenged attendees to get out of their usual habits and comfort zones.

And that means torturing some instruments. No, really torturing them: breaking sticks, destroying drums, warping instruments, and boiling waterphones (putting the whole instrument on a stove).

Human beings, of course, shouldn’t be tortured – to get the best sound of them, you want to get them drunk. (I want the Drunken Eastern European Choir sample library, Troels!)

Speaking excitedly in run-on sentences that clipped one another – a bit like sample in and out points were set wrong – Troels revealed some of his latest sampling explorations and sonic secrets. It was, truly, one of the best talks I saw at GDC – and unquestionably the highest idea and inspiration – to – time ratio, even if you weren’t into sound. Here are some of the gems from that conversation, along with some of the lists of bizarrely-combined sampled instruments in recent compositions.

I was looking over my notes and wondering if I should polish them. But then, I realized that I had transcribed all the things Troels said that interested me. If I put them all in a jar, I could take any one idea out on a day when my musical reserves were dry and be inspired. So I’ll share them with you in exactly that form.

Game Audio: Selected Student Works from Matt Ganucheau on Vimeo.

In the early days of game sound, musical soundtracks were all largely adaptive and interactive, fused with the sound effects of the game and the logic of gameplay. Scores were less Alfred Newman or John Williams, more Spike Jones. Today, game music has the potential to reinvent composition itself, to help us reimagine what makes a musical score as on-screen user action drives musical ideas. But with a few, notable exceptions, most modern titles have opted for big, Hollywood-style soundtracks – and the linear composition that goes with them, as though someone just took a film score CD and hit play.

It’s one thing to talk about that in theory. Better yet: give it a shot yourself. So why not teach game music as its own discipline?

Matt Ganucheau, a composer, sound designer, and interactive developer/artist, is teaching just that, working with students at Expression College in Emeryville, California. The accelerated course works with the elegant Unity game engine and a clone of the legendary Space Invaders arcade game, adding music built in Max/MSP. If Max seems an unlikely choice, its open source cousin Pure Data (Pd) is actually integrated with the game engine for Electronic Arts’ Spore, with music by Brian Eno working with EA’s Kent Jolly and contributor Aaron McLeran. So, this could be the wave of the future. The first problem: figuring out how to actually compose.

The results are astonishing, given that the students were just learning Max and had extremely limited amounts of time. I asked Matt to write up for CDM how the coursework evolved; he shares his process and what he learned as a teacher. We’re also working on open sourcing the coursework content and the patches, which we’ll soon provide both for Pd and Max/MSP. I’m doing some work on the game side so that you can play with game mechanics in Processing. Stay tuned for more on that.

We spoke a bit about this process – and interactive music in general – with Xeni Jardin and Boing Boing in their Game Developer Conference livecast a week ago Friday. Edited video of that coming soon.

Here’s Matt on the coursework itself: