Austrian Composer Peter Ablinger has transformed a child speaking so that it can be played as MIDI events on a mechanically-controlled piano, making the piano a kind of speech speaker. Via Matrixsynth, the readers at Hack a Day get fairly involved with how this may be working.

It seems not quite accurate to describe this as vocoding in the strictest sense, so much as a simple transformation to a (much) lower frequency resolution – that is, the 88 keys of the piano. Ablinger, for his part, describes the events as “pixels.” It’s pretty extraordinary that without a bandpass filter, you get something approximating the noisy sibilance of the speech, but this seems to be the result of having lots of events (that is, lots of resolution in terms of time). Edit: Listening again, the short answer to how you can hear so much of the voice through the piano seems to be, you can’t; the original is almost certainly mixed in. It’s nonetheless an interesting effect, and I’d like to hear the piano on its own. In other words, the basic process is, 1) convert the sound spectrum of the recorded voice to a series of MIDI events, and 2) play back the translated MIDI file. You can see that the MIDI playback is accomplished with Pd (Pure Data) running on a Windows Linux/KDE netbook, though it’s not clear what was used to do the original conversion. (The screen shot with side-by-side audio and MIDI appears as though it may be for demonstration purposes, only.)

Correction: The work is absolutely done in custom software developed by the composer in Pd (Pure Data). It’s an ideal tool for the job, and free and open source. I wouldn’t dare try to replicate the results here, but this is fantastic inspiration for playing with sound in Pd.

One Windows tool that’s capable of the job is TS Audiotomidi, as observed by Hack a Day spacecoyote. Whether or not that’s what’s at work here – and it may well be – that utility is itself interesting. Edit: Yeah, far more likely the whole thing was done in Pd. And Pd should be up to the task.

TS-AudioToMIDI

Of course, this is to say nothing of the lovely work done on the mechanical piano. It’s a beautiful piece. Here’s hoping some government bureaucrats got the message of the declaration. Now, we just need a chorus of something really loud – say a thousand trumpets – shouting out the Universal Declaration of Human Rights.

Alongside our Renoise + Indamixx netbook-optimized production competition, I’m kicking off this week a series of CDM and guest tutorials on working with Linux audio tools, Renoise, and more. First up, here’s a basic look at how to route the free-as-in-beer linuxDSP effects toolkit into the powerful, modern, open-source DAW Ardour. Correction: I implied that linuxDSP had an open source license, which is not correct. It should be considered “freeware” but not free software. Ardour, of course, is fully open source, and this is as much a tutorial on how to use JACK to route effects as it is linuxDSP per se.

http://www.linuxdsp.co.uk/

The mda-vst collection of effects has been a long-time favorite for me. It’s a set of no-nonsense, unique, simple effects, just useful stuff that doesn’t have any unnecessary bells and whistles. Oh, yeah – and it’s free, making an easy way to fill out your effect arsenal. But until recently, the collection was proprietary freeware. Now, it’s GPL-licensed open source for Mac and Windows.

Included: multi-band distortion, drum replacement, amp and speaker simulators, de-essing, degrading, delay, detune, dither, dub delay, compressor/limiter/gate, envelope following stereo imaging and simulation, a Leslie simulator, multi-band compression, an overdrive, a really insane pitch changer, a 3D panner, a sub-bass synth, a couple of vocoders with different numbers of bands, test tone creator, flanger, pitch tracker, and more.

I imagine the access to code for these things could help people launch their own effects projects. And as Windows VSTs, it can run easily in Linux hosts that support that format, too.

http://mda.smartelectronix.com/

http://sourceforge.net/projects/mda-vst/

Thanks to Marc Resibois for the tip. And you budding C coders out there, if you dig into the code, let us know.

What do you really want from a recording tool on a computer? The Digital Audio Workstation answer to that question has for years been on giving you a generalized set of tools that try to anticipate every possible need. The “workstation” approach puts a whole bunch of functionality in one place, in particular adding features like plug-in hosting for supporting third-party effects and instruments, video editing and scoring, and music notation.

Record is a different animal: it’s a specialized tool focused on making music with audio, instead of a generalized tool. Reason has focused on synths, with a distinctive set of hardware-styled modules in a virtual rack. Record focuses on sound, with a distinctive set of hardware-styled modules in a virtual rack. Get it?

What’s left out is important. There’s no plug-in support, but by limiting use to the internal sound modules, Record is entirely agnostic about things like sample rate and can be far more flexible with modular audio routing and fluid tempo changes. (There’s also no MIDI out support, but if you’re looking to sequence external hardware, I might look elsewhere, anyway – especially with gems like Numerology out there.) Record also supports ReWire and has various export features, so the assumption is that – as with Reason – when you really want plug-ins, you can use your existing environment of choice.

Maybe you can call the results a DAW, if you really want to. But the one thing that isn’t debatable: Record is Reason for sound.

CDM was first with the official story from Propellerhead over the weekend, talking about the philosophy behind Record. Now we can talk about the specifics inside – and I have a test version here I’ve been working with while on the road.

Basically, Record combines comp-based recording with Reason-style racks and a whole load of goodies for processing and mixing your sound, including Line 6 guitar effects and an emulated SSL mixing desk. Why am I excited to begin working with it? Basically, it’s what happens when you flip the Record interface around. The most important screenshot (see any of these shots bigger by clicking on them):

Here’s what you get:

For all the emphasis on learning how to use creative tools the proper way, it’s often when you misuse a feature that it really becomes a powerful tool. So, in the spirit of some of the “mistutorials” from Ableton’s own Dennis DeSantis, here’s our friend Michael Hatsis of New York’s Track Team Audio / Warper Party / Dubspot with a really unusual way to achieve scratching effects.

You know the Ping Pong effect for its clichéd, stereo-panning echo effects. But here, it goes an entirely different direction: now that Live 8 has added new delay modes, you can create some special effects that don’t sound like the typical effect. Mike manages to warp and bend Ping Pong into something that sounds a lot like scratching. He warns that “this is not meant to replace vinyl nor will it produce a totally authentic sounding scratch sound.” On the other hand, you start to get some sounds that are reminiscent of scratching but sound unique, which I think is a Very Good Thing.

Live 8 users, download the template:

http://www.trackteamaudio.com/videos/scratchtemplatelive8.zip

There’s also some nice discussion happening over on the Ableton blog. (Main request: automation / dummy clips for more sound-warping power.)

Video: Total misuse of a ping pong delay – scratch effects

(And those of you Pd/Max/SuperCollider/Chuck/Reaktor users out there, maybe this will inspire some DIY effects along similar lines.)

Previously:

Ableton Live 8 Creative Tutorial Videos: Using and Misusing Groove Extraction

Ableton Live 8 Creative Tutorial Videos: Misusing Frequency Shifter

(and, yes, much as I love Live 8, I welcome other tools, too – anyone interested in tutorials to request / tutorials you want to make?)