The iPhone’s glass touchscreen may be a thing of beauty, but despite its multi-touch capabilities, it would seem this device is incapable of responding to how hard you tap it. But the developers at Wave Machines Labs apparently didn’t want to take no for an answer.

The iGOG drum suite for iPhone provides drum pads and sample triggering in unique ways, most notably in its velocity-sensitive VelAUcity. How do you get velocity response from a device that’s supposedly not pressure-sensitive? Presumably there’s additional data in the touch events that makes this possible, but for now Wave Labs aren’t saying:

iGOG’s proprietary VelAUcity technology does the unthinkable and turns the iPhone’s screen into touch sensitive drum pads. Play loud, play soft, or play a full-blown crescendo on a crash cymbal, iGOG will capture every nuance of your performance. Just plug in your headphones and start playing.

Here’s the interesting twist: generally, when any of us say “iPhone,” what we really mean is “iPhone or iPod touch.” That’s not true in this case: “NOTE: VelAUcity is only available on iPhone devices. if you’re using an iPod Touch, VelAUcity is disabled.” That seems to suggest that the trick is the built-in mic, or at the very least some private API that’s iPhone-specific. (Audio triggering is most likely, as this app comes from a developer with drum replacement experience.) That would also suggest to me that you might be able to pull this off with non-Apple mobile devices and controllers in the future.

As a result, though, I can’t test it – I have only the iPod touch.

Unconvinced or uninterested? iGOG has some other approaches to how the small Apple handheld can be made more useful as a set of pads:

multi-touch the storm – interactive sound visuals – subcycle labs from christian bannister on Vimeo.

What if you could mash, mangle, mush, and morph sounds with your fingers on a screen, watching the waveforms dance in response in three dimensions? That “what if” is expressed beautifully in a project by musician-developer Christian Bannister of Portland, Oregon, who works as Subcycle Labs.

The result is like being able to touch sound directly.

Three-dimensional forms morph and vibrate using visuals programmed in Processing, making architectural-organic shapes and spaces that really begin to “look” like sound. These forms can represent synthesis and effects parameters (Christian has done some work with the Massive synth from Native Instruments), or can allow navigation through loops using touch. Gestures remap offsets and duration for audio, scrub and slice, and apply granular resynthesis.

Austrian Composer Peter Ablinger has transformed a child speaking so that it can be played as MIDI events on a mechanically-controlled piano, making the piano a kind of speech speaker. Via Matrixsynth, the readers at Hack a Day get fairly involved with how this may be working.

It seems not quite accurate to describe this as vocoding in the strictest sense, so much as a simple transformation to a (much) lower frequency resolution – that is, the 88 keys of the piano. Ablinger, for his part, describes the events as “pixels.” It’s pretty extraordinary that without a bandpass filter, you get something approximating the noisy sibilance of the speech, but this seems to be the result of having lots of events (that is, lots of resolution in terms of time). Edit: Listening again, the short answer to how you can hear so much of the voice through the piano seems to be, you can’t; the original is almost certainly mixed in. It’s nonetheless an interesting effect, and I’d like to hear the piano on its own. In other words, the basic process is, 1) convert the sound spectrum of the recorded voice to a series of MIDI events, and 2) play back the translated MIDI file. You can see that the MIDI playback is accomplished with Pd (Pure Data) running on a Windows Linux/KDE netbook, though it’s not clear what was used to do the original conversion. (The screen shot with side-by-side audio and MIDI appears as though it may be for demonstration purposes, only.)

Correction: The work is absolutely done in custom software developed by the composer in Pd (Pure Data). It’s an ideal tool for the job, and free and open source. I wouldn’t dare try to replicate the results here, but this is fantastic inspiration for playing with sound in Pd.

One Windows tool that’s capable of the job is TS Audiotomidi, as observed by Hack a Day spacecoyote. Whether or not that’s what’s at work here – and it may well be – that utility is itself interesting. Edit: Yeah, far more likely the whole thing was done in Pd. And Pd should be up to the task.

TS-AudioToMIDI

Of course, this is to say nothing of the lovely work done on the mechanical piano. It’s a beautiful piece. Here’s hoping some government bureaucrats got the message of the declaration. Now, we just need a chorus of something really loud – say a thousand trumpets – shouting out the Universal Declaration of Human Rights.

SONAR 8.5, I’m sure at some point, was to be SONAR 9. There’s an enormous amount of functionality in this release. But I think the surprise is some of the stuff that won’t necessarily appeal to the widest audio production audience. Here’s a DAW that’s adding unusual new features for arranging tracks, putting an integrated arpeggiator on every track, beefing up its step sequencer (really), and dumping a bunch of class LinnDrum samples into the package. Those are the kind of treats we like in these parts.

SONAR is really a “DAW” in the traditional sense. It does everything. It doesn’t hide features. Given a choice between taking something out and putting something in, it puts the thing in. It has a lot of knobs and buttons. There are positives and negatives to the approach – it’s the reason some readers of this site return to software on game machines that has more in common with early Amiga software. But if you like the feeling of a packed studio, a tool like SONAR can be terrific. As much as I love Ableton Live for sound design and live performance, I find myself returning to something like SONAR for arrangement.

Even with its competitors packing in features, SONAR 8.5 is a tool that really loves MIDI, just as other software focuses on audio. And it’s one of the best-performing tools around. Because it’s so well-tuned for Windows, that means you can drop it onto a wide variety of PC hardware without spending a lot of cash. Most importantly, it could be the first software on any platform that convinces you to try a 64-bit OS – just at about the time you may be doing a fresh install of Windows 7.

Here’s a first run-down of what’s new in 8.5 that I’m personally most interested in:

For many, mobile technology and developing for the iPhone and the iPod touch is a fad and a Gold Rush. Good designers, though, take a longer view of how interaction can be expressive. And there are few people with a better sense of the big picture of small devices than Dr. Ge Wang. The co-founder, CTO, and Chief Creative Officer of Smule has a background that goes well beyond the latest Apple platform. Along with Perry Cook at Princeton, Ge Wang is the co-originator of ChucK, a real-time programming language for synthesis so efficient some people use it live onstage. (ChucK, as an open source project, now has a terrific team of people behind it.) ChucK is the sonic engine that powers Smule’s projects. Ge Wang also teaches at Stanford, working with students and fellow researchers to explore new ways of interacting with music technology.

Ge Wang joined me for a lengthy phone conversation recently. He really contextualized why the iPhone is important in the grand scheme of things, but also how the people at Smule and Stanford (and Princeton) can approach technology for musical interaction, focusing on what devices are rather than what they’re not.

(The audio here, believe it or not, is extensively edited – Ge Wang is that easy to talk to. I hope the next time it’s over beers rather than Skype.)

The full interview can be played below, or downloaded directly.

Play this track:

Download MP3 of the interview

Thanks to KORG and the Nano Series for their support of programming on createdigitalmusic.com.

Lastly: a video of the Smule team headquarters and playing around with Leaf Trombone for a Zelda duet!

More information:
The Mule Chronicles [Smule Blog]
http://smule.com/
Center for Computer Research in Music and Acoustics (CCRMA), Stanford University

Previously, for more on Ge Wang and CCRMA:
Make:TV Meets Stanford Musical Inventors, Feedback Piano

Video + Audio Subscriptions, iTunes Podcast

CDM is now launching regular audio content on the artists and inventors we cover as part of our series CDM Sounds. You can subscribe (and review the podcast) via iTunes, where you’ll also find our new video series:

cdm Sounds Podcast [audio]
cdm TV [video]

Or using your software of choice, subscribe directly to RSS. (I like to follow podcasts with Banshee and Winamp this way.)

We’ve fixed some transcoding issues for iPod touch/iPhone on the video podcast. Please do test this and let us know if you have any issues on your software/hardware.