Austrian Composer Peter Ablinger has transformed a child speaking so that it can be played as MIDI events on a mechanically-controlled piano, making the piano a kind of speech speaker. Via Matrixsynth, the readers at Hack a Day get fairly involved with how this may be working.

It seems not quite accurate to describe this as vocoding in the strictest sense, so much as a simple transformation to a (much) lower frequency resolution – that is, the 88 keys of the piano. Ablinger, for his part, describes the events as “pixels.” It’s pretty extraordinary that without a bandpass filter, you get something approximating the noisy sibilance of the speech, but this seems to be the result of having lots of events (that is, lots of resolution in terms of time). Edit: Listening again, the short answer to how you can hear so much of the voice through the piano seems to be, you can’t; the original is almost certainly mixed in. It’s nonetheless an interesting effect, and I’d like to hear the piano on its own. In other words, the basic process is, 1) convert the sound spectrum of the recorded voice to a series of MIDI events, and 2) play back the translated MIDI file. You can see that the MIDI playback is accomplished with Pd (Pure Data) running on a Windows Linux/KDE netbook, though it’s not clear what was used to do the original conversion. (The screen shot with side-by-side audio and MIDI appears as though it may be for demonstration purposes, only.)

Correction: The work is absolutely done in custom software developed by the composer in Pd (Pure Data). It’s an ideal tool for the job, and free and open source. I wouldn’t dare try to replicate the results here, but this is fantastic inspiration for playing with sound in Pd.

One Windows tool that’s capable of the job is TS Audiotomidi, as observed by Hack a Day spacecoyote. Whether or not that’s what’s at work here – and it may well be – that utility is itself interesting. Edit: Yeah, far more likely the whole thing was done in Pd. And Pd should be up to the task.

TS-AudioToMIDI

Of course, this is to say nothing of the lovely work done on the mechanical piano. It’s a beautiful piece. Here’s hoping some government bureaucrats got the message of the declaration. Now, we just need a chorus of something really loud – say a thousand trumpets – shouting out the Universal Declaration of Human Rights.

KORG has other new product announcements, and I think both are going to be big hits for them.

The SV-1 stage piano falls well into the category of “why didn’t anyone else do this first?” First, it looks beautiful – finally, a keyboard designed for the stage that actually looks good onstage. (I don’t know, maybe manufacturers assume us keyboardists are ugly?) Second, it combines all the sounds many gigging keyboardists need, instead of an odd assortment that covers some bases but not all, or overkill workstation keyboards that do too much and get too complex. Third, it’s finally a hardware keyboard that learns some recent lessons from software – you need to model the characteristics of the real thing, and people expect good amp models, and the like. Fourth, it’s… okay, it’s just really, really pretty, which I expect will change how everyone feels about the whole package.

Updated: Yes, in fairness, Nord has potent competition waiting for the KORG, and available first. I think either the Nord Stage or Nord Combo win handily if organ sounds are important, and both are designed to double as external controllers if you do like software. The Nord also has more bells and whistles for editing and sound control. On the other hand, the KORG will clearly appeal to people who are in it mainly for the electric piano side of the coin. And pretty as the Nord is – as much as they’re both shades of red – I think the KORG is still pretty darned sexy-looking.

In addition to all the specs and such, KORG has the manual online, so you can get into the details.

SV1 Support

Oh, yeah, just one gripe – I always think it’s silly when you put a window in front of the tube. But I won’t knock it; I expect it helps on the sales floor. At least the side that faces the audience looks like a racecar.