Austrian Composer Peter Ablinger has transformed a child speaking so that it can be played as MIDI events on a mechanically-controlled piano, making the piano a kind of speech speaker. Via Matrixsynth, the readers at Hack a Day get fairly involved with how this may be working.

It seems not quite accurate to describe this as vocoding in the strictest sense, so much as a simple transformation to a (much) lower frequency resolution – that is, the 88 keys of the piano. Ablinger, for his part, describes the events as “pixels.” It’s pretty extraordinary that without a bandpass filter, you get something approximating the noisy sibilance of the speech, but this seems to be the result of having lots of events (that is, lots of resolution in terms of time). Edit: Listening again, the short answer to how you can hear so much of the voice through the piano seems to be, you can’t; the original is almost certainly mixed in. It’s nonetheless an interesting effect, and I’d like to hear the piano on its own. In other words, the basic process is, 1) convert the sound spectrum of the recorded voice to a series of MIDI events, and 2) play back the translated MIDI file. You can see that the MIDI playback is accomplished with Pd (Pure Data) running on a Windows Linux/KDE netbook, though it’s not clear what was used to do the original conversion. (The screen shot with side-by-side audio and MIDI appears as though it may be for demonstration purposes, only.)

Correction: The work is absolutely done in custom software developed by the composer in Pd (Pure Data). It’s an ideal tool for the job, and free and open source. I wouldn’t dare try to replicate the results here, but this is fantastic inspiration for playing with sound in Pd.

One Windows tool that’s capable of the job is TS Audiotomidi, as observed by Hack a Day spacecoyote. Whether or not that’s what’s at work here – and it may well be – that utility is itself interesting. Edit: Yeah, far more likely the whole thing was done in Pd. And Pd should be up to the task.

TS-AudioToMIDI

Of course, this is to say nothing of the lovely work done on the mechanical piano. It’s a beautiful piece. Here’s hoping some government bureaucrats got the message of the declaration. Now, we just need a chorus of something really loud – say a thousand trumpets – shouting out the Universal Declaration of Human Rights.

In the Pocket (Rhodes and Moog Light Paint) from Ethan Goldhammer on Vimeo.

Fantastic, hip, soulful keys couple with brilliant stop-motion editing, as a Moog and Rhodes keyboard are splashed with light painting, in this new music video from Ethan Goldhammer. (See his blog for more.) It’s the perfect example of how a much-seen technique can retain its novelty when used creatively, especially as the sound itself seems to dance in light-up oscilloscope patterns.

Background:

Original music by Ethan Goldhammer and S. Burke.
Time Lapse footage shot in August 2008 on Block Island, RI.
Stop motion and light paint September 2008 in Cambridge, MA.

The lesson here: gear pr0n and special effects work perfectly when they visualize the way we feel about our musical objects and sounds.

Okay, so how did he do it? Ethan responds:

Ableton all the way. Recorded as loops with an [Akai] apc, then arranged later. The secret is also, making the animations, rendering them in [Final Cut Pro] but then WARPING them in ableton to the proper timing and bouncing them back to FCP.

Nicely done. Of course, this is why some audiovisualists have turned to Sony Vegas for Windows – formerly developed by Sonic Foundry, Vegas is actually half audio, half visual software. On the other hand, Live is a comfortable and flexible tool that does many things Vegas can’t.

Ethan also has a beautiful rendering of “Air on a G String,” the second cut from the legendary Switched on Bach. Wendy Carlos, if you’re out there, please don’t stop Ethan; I’d love to see more collaboration instead.

Air on a G String (Oscilliscoped) from Ethan Goldhammer on Vimeo.

There’s a curious distinction in hardware keyboards. You’ll find plenty of keyboards geared for performance with software at the low-end to mid-range. But if you want a keyboard with uncompromising durability and action – and you’re willing to pay more and lift more weight – those choices suddenly disappear. Suddenly, you have to buy a workstation keyboard or something with built-in sounds or even built-in speakers. What if you want a really uncompromising keyboard to use with software and nothing else?

It’s almost as though manufacturers assume “serious” musicians want to gig with built-in sounds on a standalone keyboard. That’s a pretty stunning assumption in the year 2009, given the versatility, reliability, and unmatched sound quality and diversity of software instruments. If you’re looking for a controller alone, your options are limited. M-Audio, Novation, and others have some great affordable options, but nothing really high-end. Roland, Yamaha, and Casio have some nice controllers, but the higher-end models aren’t dedicated to the task, and therefore there’s no way to dedicate all your dollars to the controller itself. (Dig deeper, and there’s still more sacrifices to make – yes, you can have x, but then we take away y…) My short list would probably be Doepfer’s lovely keyboard in a road case and Studiologic – and that’s about it.

Studiologic’s new Numa Nero, therefore, looks like the serious controller a lot of us have been waiting for. It’s a full, 88-note keyboard made for serious musicians. Yes, part of it is plastic, but plastic doesn’t necessarily mean “cheap” – good-quality plastic can be more durable than other materials. And the design itself finally focuses on getting you the best-possible keybed and action, assuming your software will take care of the sound generation.

Having full control of a complete mix and session from your MIDI keyboard – without having to move your hands to the mouse or shift your focus to your computer screen – can be an addictive, if elusive feeling. Here’s a look at one way to accomplish that objective using the new Axiom Pro keyboards from M-Audio and CDM reader favorite Ableton Live, thanks to a first-look video provided to CDM first.

In a Hollywood overrun with remakes, a new Tron has quite a daunting challenge. The original film may be a cult hit for its 80s arcade cool, but it also was a seminal moment in the evolution of computer animation, at the nexus of obsessive-compulsive optical effects that came before and digital effects that came after. (Google Perlin Noise, if you must.) But where the bits of the effects look uneven or dated alongside the brilliant, it’s nearly impossible to top the genius of Wendy Carlos’ score. Her deft blend of choirs, orchestras, organs, and rich electronics wasn’t just forward looking: it’s fresh today, an alternative to some of the signature sameness in today’s games and films.

Perhaps Tron Legacy will do what other belated sequels have not: express love for the original. With Daft Punk helming the score and a reverent, inspired crew ready to make Tron live again, the trailer last week was the real sleeper hit of Comic-Con.

If that’s not enough layers of fandom, though, head to GearSlutz for a lesson in film scoring and a recreation of the trailer in Reason, custom Reaktor patches, and Ableton Live. This is not much of an infomercial for Live: because Ableton’s arrange view doesn’t quite understand frames, scoring with Live is a bit of a beast. (Live 9, anyone?) But it’s a great example of love for the movie and its original score. And hey, everyone need a source of joy, even a film.

Ableton Live for Sound Design :Tron Legacy [GearSlutz forum]

Stripped the original audio and redid all of the sound from scratch using Reason/NI Reaktor/Ableton Live 8. An M-Audio Axiom 49 was used to perform the Lightcycle Engine Oscillations

Wendy Carlos, if you’re out there, we get it. You revolutionized film scoring and electronic orchestration, and we’re all in your debt. It’s not so much that you switched on Bach or switched on Moog or even switched on Kubrick and guys in glowing skin-tight outfits. You switched on sound, and nothing has been quite the same since.

Now, we just have to hope 2010 can show us a good time, too.