Austrian Composer Peter Ablinger has transformed a child speaking so that it can be played as MIDI events on a mechanically-controlled piano, making the piano a kind of speech speaker. Via Matrixsynth, the readers at Hack a Day get fairly involved with how this may be working.

It seems not quite accurate to describe this as vocoding in the strictest sense, so much as a simple transformation to a (much) lower frequency resolution – that is, the 88 keys of the piano. Ablinger, for his part, describes the events as “pixels.” It’s pretty extraordinary that without a bandpass filter, you get something approximating the noisy sibilance of the speech, but this seems to be the result of having lots of events (that is, lots of resolution in terms of time). Edit: Listening again, the short answer to how you can hear so much of the voice through the piano seems to be, you can’t; the original is almost certainly mixed in. It’s nonetheless an interesting effect, and I’d like to hear the piano on its own. In other words, the basic process is, 1) convert the sound spectrum of the recorded voice to a series of MIDI events, and 2) play back the translated MIDI file. You can see that the MIDI playback is accomplished with Pd (Pure Data) running on a Windows Linux/KDE netbook, though it’s not clear what was used to do the original conversion. (The screen shot with side-by-side audio and MIDI appears as though it may be for demonstration purposes, only.)

Correction: The work is absolutely done in custom software developed by the composer in Pd (Pure Data). It’s an ideal tool for the job, and free and open source. I wouldn’t dare try to replicate the results here, but this is fantastic inspiration for playing with sound in Pd.

One Windows tool that’s capable of the job is TS Audiotomidi, as observed by Hack a Day spacecoyote. Whether or not that’s what’s at work here – and it may well be – that utility is itself interesting. Edit: Yeah, far more likely the whole thing was done in Pd. And Pd should be up to the task.

TS-AudioToMIDI

Of course, this is to say nothing of the lovely work done on the mechanical piano. It’s a beautiful piece. Here’s hoping some government bureaucrats got the message of the declaration. Now, we just need a chorus of something really loud – say a thousand trumpets – shouting out the Universal Declaration of Human Rights.

Inside a computer, digital music is entirely unseen. But translate it into the tangible world, and it can be anything you imagine – not limited by acoustic reality or practicality, music can become three-dimensional sculpture.

For artist Christopher Bauder and composer Robert Henke, ATOM’s light and sound sculpture found a three-dimensional matrix of balloons as its medium. Flashing in hypnotic patterns and moving into different configurations, accompanied by live laptop music from Henke (aka Monolake), music and visuals become an inseparable fusion.

ATOM received its North American premiere at Montreal’s MUTEK in May. That turned out to be perfect programming, as it placed ATOM in a week that featured complementary work from artists Artificiel. Henke says some of his matrix manipulations – and even the specific Max/MSP patches from ATOM – came from collaboration with Artificiel and their light bulbs. For their part, at MUTEK they unveiled a new audiovisual etude called POWEr Play involving a live-sampled Tesla Coil. The science fair ethos of ATOM and POWEr Play could have been gimmicky or overly fixated on spectacle, but in these pieces, it was anything but. Both works contemplated their subject matter so thoughtfully that balloons and electrical coils seemed perfectly natural media for the audiovisual imagination, and audiences were left marveling at phenomena in a way too rare in 2009.

Video episode at Blip.tv [includes mobile/desktop video downloads]
YouTube Part 1 and Part 2 (if you prefer YouTube for viewing)

It’s worth downloading the video above and really getting to soak up some of this piece when you have time. I also have an audio interview of a conversation with Robert and Christopher immediately following one of the performances.

You’ll hear Christopher’s voice first, followed by the unmistakable percussive enthusiasm of Robert. For me, the best part of the interview was hearing them discuss whether you should notice some of the unintentional randomness of drifting balloons or technical hiccups, and how they structured the work formally with a palette of possible balloon patterns.

Download the audio interview

For more on POWEr Play, see my Montreal flat mate Greg Smith writing for Rhizome – and stay tuned for the CDM audio interview, coming next week:
power play – artificiel at mutek [Serial Consign Blog]
Variable Frame Rate: Multimedia Performance at MUTEK 2009 [Rhizome]

More information:
Atom project Information at monolake.de
Text interview by Bertram Niessen for Digimag magazine, October 2007, also at monolake.de

Artists Gijs Gieskes’ sequencers are almost like physical, mechanical software, an expression of musical structure in object form. As such, even as they make strange sounds, they become musical sculpture. His latest Servo Sequencer combines optical and mechanical process, as frequency circles spin on a turntable and tone arms float above them.

The Servo Sequencer is built for exhibition use – meaning, yes, he’s brave enough to let you play with this contraption. Sequence the arms using buttons, then adjust the volume mix and placement of each arm using the joystick.

Serv Seq from Gijs on Vimeo.

This project is unusually well-documented. Gijs provides complete specs, the script that controls the arms, and even a little web app that generates those lovely patterns.

http://gieskes.nl/instruments/?file=serv-seq

But for those of you near the Netherlands, you should go check this out in person. Updated: The piece will be part of an exhibition in Breda through August 23, with multiple opening events featuring local artists from Eindhoven and Breda, plus live performances and concerts including Gijs and his talented brethren and neighbors.

Here & There Exhibition, mu.nl [Info in English]

The events:
Opening Part 1:
KOP, Breda
Thursday 25/06 08.00 pm

MU, Eindhoven
Friday 26/06 08.00 pm

(It’s a bit confusing as the events swap between Breda and Eindhoven — there’s a second opening Saturday July 25. Gijs explains “the first [opening] is in breda (thursday), then a day later (friday) in eindhoven, where my machine will be. and then a month later its the other way around.”)

You know, Breda. Like, right … here. We’ve got a number of readers in the area (whom I suspect know more or less exactly where this is); let us know if you make it!

Moldover at the Maker Faire from The Amazing Rolo on Vimeo.

Yann Seznec aka The Amazing Rolo brings CDM his coverage of music tech at the Maker Faire in three episodes today.

Our friend Matt Moldover is a mad scientist of controllers. Stock Novation and M-Audio keyboards enter, and wind up coming out as live musical control monsters. You know that kid who mashes up toys in the first Toy Story movie? It’s like that, only musically productive.

Moldover has been steadily perfecting what was originally the Octamasher, a set of M-Audio keyboards connected to a central Ableton Live brain. The basic concept is a powerful one: instead of one person, one set of secret mappings even the performer (cough) sometimes forgets (yeah, that’s me), and one computer behind which he can hide, get a bunch of people jamming and remixing live – even if they’re new to computer music.

The Syncomasher is the latest iteration, and it’s looking utterly beautiful. It can be an installation toy or a serious performer instrument – or both at once. Check out the new custom body – which still retains that whimsical Moldoverism.

Check out this controller modification how-to, as well, from last year:

Eno had Music for Airports. It’s fitting that Monolake would do Music for Jet Lag. Robert Henke writes about this month’s free download:

Since I also have been flying a lot recently, I named it after one of the most annoying side effects of modern transportation and mixed it in a way that reflects that dizzy feeling of being hyper active and totally asleep at the same time. ( "Last call for mister Robert Henke, flying to Berlin, please come to gate B 154 IMMEDIATELY or we will unload your luggage !!!!!!!!!" )

I am myself recovering from jetlag on the way to Portugal, so the timing is perfect. In a way, I have to say I sometimes oddly enjoy the disorienting feeling. I don’t think it’d be terribly addictive, but it’s a physical, profound reminder of traveling a great distance, something you could otherwise ignore in the age of absurdly-fast jet travel.

Grab the download here:

Free Downloads of the Month [yetlag, May 2009 – should be archived if you’re catching this late]

Installation details:

http://monolake.de/installations/lufthansa.html

The installation is fascinating in itself: a Max/MSP-powered, interactive sound score for a giant flight simulator, a model of the presence of jets, travel, and air traffic control. Robert did the sound; Christopher Bauder of white void was the concept and very elegant visual design. (See also Aaron Koblin’s striking Processing-based visual piece Flight Patterns, which seems to have embedded itself on a certain airborne digital zeitgeist. The United States becomes a feathery web of connections and flying traffic. You can imagine how this might continue to be mined in sound.)

As we work to keep our creative process flowing, I especially love the idea of focusing on a feeling to get a production started, as Monolake did here. So often, it’s too easy to get caught up in something technical or some very particular idea, then lose that in the process. By focusing on a feeling or deeper sentiment, it’s possible to remain connected to the ethos of what the track really means to us.

Of course, travel too much, and that may just wind up being … well, jet lag.

Meanwhile, as I listen to more music piped through airport terminals and even Metro stations, I wish Eno’s original idea had caught on.

Despite the name, the Bent Festival this year promises to be about not only circuit bending, but DIY sound in general. (Circuit shaping? Circuit straightening? General circuitration?) Our friend and CDM regular Mike Una has put together fantastic art installations for Minneapolis. Workshops in NYC and LA dig into the mysteries of sensors and tubes, the potential of video bending, and giant, battery-powered noise to drown out the rest of the world. And there are gobs and gobs of performers.

Like the North American air currents, Bent begins in the West, moves across the Heartland, and into New York City. (Okay, actually, when I first reported on this year’s Bent, the dates were different, so pay attention!)

LA – April 17 – 19

New York – April 24 – 26

Minneapolis – May 1 – 3

And lest you think Bent isn’t as Bent this year, there’s still a Furby Orchestra to cap it all off.

Bent Festival site has the whole scoop, plus Flickr, Facebook, MySpace, and whatever else you crazy kids use today. (Hey! Where’s the AOL keyword?)

If you make it to any of the festivals and document — or if you’re playing/presenting — do share.

If you want new ideas about design and interaction, ask a musician. Before the Wii remote, the iPhone, Microsoft’s Surface, and Minority Report, musicians were trying oddball ideas for music performance. That hasn’t slowed down, either, from the futuristic and space-y to down-and-dirty acoustic techniques. We’ve got quite a gamut coming up for our madcap, sound and noise-packed hour of competition happening this Saturday at NASA’s Ames Research center during Yuri’s Night, and we’d love to share them with everyone online.

For starters, here’s the rundown of the projects with links to project sites and artists, and all the judges:

Futuristic Music Design Challenge: Meet the Competitors, Judges

Join the event on Facebook

The projects: the Bubblegum Sequencer (previously on CDM), The Box custom hardware with colored lights + Reaktor ensemble, the surface-temperature tangible interface table Weather Report (previously on CDM), the strange polygonal Kromatron wireless instrumental interface, the Thimbletron gloves-as-samplers with lab coated performers project (previously on CDM), the bicycle wheel and analog tape Looping Pedal (previously on CDM), the computer-powered musical saw WaveSaw, the 28-string just-intoned microtonal casmolyra, the turntablist custom software ammoBox and the GrooveStep DS pattern maker (previously on CDM).

I’m also pleased to announce…

The judges:

• Roger Linn, father of the modern drum machine (in my opinion, anyway) and creator of the MPC60 for Akai, plus recent creations — and he plays the mandolin
• Liz Enthusiasm, lead singer of Freezepop (check out their albums or just play a Harmonix game) and evidently an expert on Dr. Pepper
• (Matt) Ganucheau, a mastermind of Yuri’s Night’s music and art, a composer and sound designer (and teacher of sound design for games), an electronic musician, and creator of the NSFW "foreplay robot" Moaning Lisa
• … and yours truly as emcee

Speaking of Roger Linn, Tom at Music Thing just posted an auction on the pre-Akai prototype.

Hopefully we’ll get to do some quick interviews with the judges, as well, for Planet CDM. Stay tuned on yuricdm.com.

For an increasing number of artists, data is becoming the raw material for creative work. Most of this has focused on visual media, but in the digital space, you can just as easily use sound. Sometimes the results are aesthetic only; sometimes they tell you something about the numbers being sonified. But either way, sound is a powerful medium.

“Weather Report” is a multi-touch instrument that makes music out of surface temperature data. The results feel a bit like US weather agency NOAA gone IDM. Fire up the multi-touch table, and you can “read” temperature data as sound. Co-creator Jordan Hochenbaum writes us:

I just wanted to turn you guys onto a multi touch interface I have been developing with a friend of mine here at California Institute of the Arts (his name is Owen Vallis). We had out first installation a couple weeks ago at Sea and Space Explorations gallery in Los Angeles and will be bringing it to Yuris Night Bay Area in April. The table is called “Brick,” and our first piece of software for it is called “Weather Report.” Were trying to use the table as a playable and meaningful musical instrument, so Weather Report uses Brick to sonify real-time U.S. surface temperature information into ambient and melodic mini-compositions. You can check out the website (we just put it up so it will constantly be updated shortly) for more information and photos, or check out our first youtube video @ http://www.youtube.com/watch?v=45p_TPtQjR0

Are current plans for the table is making it more stable, and getting multi-touch finger tracking working nicely.

It was custom built and uses custom software written in Max/MSP/Jitter and Reaktor, as well as Reactivision (like the ReacTable).

Hope you like it so far! We are finding out new ways people like to interact with the table in order to refine how it is used, so the more people see and use it, the more usable and interesting we will be able to make it as a musical instrument.

brick: A Multi-Touch Sonification Instrument [Project blog]

CDM will be at Yuri’s Night, the global space party, in a very big way, so expect more!

On display in Chi-town: giant pods to fill rooms with sound, and a man in a sound-induced, hypnotic blizzard of milk. (Yes, they have winter in northern Illinois.)

Snowy Day at MGFest 2008 from Michael Una on Vimeo.

Octophonopod at MGFest 2008 from Michael Una on Vimeo.

Behind-the-scenes commentary is available on Mike’s site, not to be confused with the domain-squatting personals site that you get if you leave out the hyphen. (Will, someday, an entire romantic community be devoted to Una Love? I wouldn’t rule it out.)

One lesson learned: milk can be incompatible with electronics.