Interview: Smule’s Ge Wang on iPhone Apps, Ocarinas, and Democratizing Music Tech

For many, mobile technology and developing for the iPhone and the iPod touch is a fad and a Gold Rush. Good designers, though, take a longer view of how interaction can be expressive. And there are few people with a better sense of the big picture of small devices than Dr. Ge Wang. The co-founder, CTO, and Chief Creative Officer of Smule has a background that goes well beyond the latest Apple platform. Along with Perry Cook at Princeton, Ge Wang is the co-originator of ChucK, a real-time programming language for synthesis so efficient some people use it live onstage. (ChucK, as an open source project, now has a terrific team of people behind it.) ChucK is the sonic engine that powers Smule’s projects. Ge Wang also teaches at Stanford, working with students and fellow researchers to explore new ways of interacting with music technology.

Ge Wang joined me for a lengthy phone conversation recently. He really contextualized why the iPhone is important in the grand scheme of things, but also how the people at Smule and Stanford (and Princeton) can approach technology for musical interaction, focusing on what devices are rather than what they’re not.

(The audio here, believe it or not, is extensively edited – Ge Wang is that easy to talk to. I hope the next time it’s over beers rather than Skype.)

The full interview can be played below, or downloaded directly.

Play this track:

 

Download MP3 of the interview

Thanks to KORG and the Nano Series for their support of programming on createdigitalmusic.com.

Lastly: a video of the Smule team headquarters and playing around with Leaf Trombone for a Zelda duet!

More information:
The Mule Chronicles [Smule Blog]
http://smule.com/
Center for Computer Research in Music and Acoustics (CCRMA), Stanford University

Previously, for more on Ge Wang and CCRMA:
Make:TV Meets Stanford Musical Inventors, Feedback Piano

Video + Audio Subscriptions, iTunes Podcast

cdmsoundsCDM is now launching regular audio content on the artists and inventors we cover as part of our series CDM Sounds. You can subscribe (and review the podcast) via iTunes, where you’ll also find our new video series:

cdm Sounds Podcast [audio]
cdm TV [video]

Or using your software of choice, subscribe directly to RSS. (I like to follow podcasts with Banshee and Winamp this way.)

We’ve fixed some transcoding issues for iPod touch/iPhone on the video podcast. Please do test this and let us know if you have any issues on your software/hardware.

Ocarina of Meme: iPhone Plays Zelda by Blowing

Sick of hearing about music apps for the iPhone?

This is going to make you feel much worse. In fact, you might just want to go somewhere else right now.

Okay, before you start throwing your cell phones at me, they are experimenting with some nice ideas:

  • Tilt
  • “Wind input” using the mic
  • Finger placement over multi-touch holes on the device

Breath controllers haven’t gotten the play recently they once did. What this demonstrates is that you can use a mic input to fake it – though they don’t make that input variable; that is, you can’t blow harder or lighter to get different results. (In fairness, that doesn’t work quite as well with a mic, at least not without some effort.) So there’s plenty here to experiment with – and nothing stopping you from, say, using the internal mic on your laptop to play around.

Whether or not it’s a serious musical instrument, as a toy it’s a bit like a 21st Century kazoo. There’s even online sharing of songs. So I can’t knock it as a toy. I’d just like to see someone make a DIY breath controller – any ideas? (Musical breathalyzer?)

The software is $0.99. I’ll be they sell a whole bunch of them. But if you do a Zelda cover, dress up in the green suit – it helps the effect. [iTunes link]

Also on Synthtopia, who grabbed this first.