Austrian Composer Peter Ablinger has transformed a child speaking so that it can be played as MIDI events on a mechanically-controlled piano, making the piano a kind of speech speaker. Via Matrixsynth, the readers at Hack a Day get fairly involved with how this may be working.

It seems not quite accurate to describe this as vocoding in the strictest sense, so much as a simple transformation to a (much) lower frequency resolution – that is, the 88 keys of the piano. Ablinger, for his part, describes the events as “pixels.” It’s pretty extraordinary that without a bandpass filter, you get something approximating the noisy sibilance of the speech, but this seems to be the result of having lots of events (that is, lots of resolution in terms of time). Edit: Listening again, the short answer to how you can hear so much of the voice through the piano seems to be, you can’t; the original is almost certainly mixed in. It’s nonetheless an interesting effect, and I’d like to hear the piano on its own. In other words, the basic process is, 1) convert the sound spectrum of the recorded voice to a series of MIDI events, and 2) play back the translated MIDI file. You can see that the MIDI playback is accomplished with Pd (Pure Data) running on a Windows Linux/KDE netbook, though it’s not clear what was used to do the original conversion. (The screen shot with side-by-side audio and MIDI appears as though it may be for demonstration purposes, only.)

Correction: The work is absolutely done in custom software developed by the composer in Pd (Pure Data). It’s an ideal tool for the job, and free and open source. I wouldn’t dare try to replicate the results here, but this is fantastic inspiration for playing with sound in Pd.

One Windows tool that’s capable of the job is TS Audiotomidi, as observed by Hack a Day spacecoyote. Whether or not that’s what’s at work here – and it may well be – that utility is itself interesting. Edit: Yeah, far more likely the whole thing was done in Pd. And Pd should be up to the task.

TS-AudioToMIDI

Of course, this is to say nothing of the lovely work done on the mechanical piano. It’s a beautiful piece. Here’s hoping some government bureaucrats got the message of the declaration. Now, we just need a chorus of something really loud – say a thousand trumpets – shouting out the Universal Declaration of Human Rights.

In the Pocket (Rhodes and Moog Light Paint) from Ethan Goldhammer on Vimeo.

Fantastic, hip, soulful keys couple with brilliant stop-motion editing, as a Moog and Rhodes keyboard are splashed with light painting, in this new music video from Ethan Goldhammer. (See his blog for more.) It’s the perfect example of how a much-seen technique can retain its novelty when used creatively, especially as the sound itself seems to dance in light-up oscilloscope patterns.

Background:

Original music by Ethan Goldhammer and S. Burke.
Time Lapse footage shot in August 2008 on Block Island, RI.
Stop motion and light paint September 2008 in Cambridge, MA.

The lesson here: gear pr0n and special effects work perfectly when they visualize the way we feel about our musical objects and sounds.

Okay, so how did he do it? Ethan responds:

Ableton all the way. Recorded as loops with an [Akai] apc, then arranged later. The secret is also, making the animations, rendering them in [Final Cut Pro] but then WARPING them in ableton to the proper timing and bouncing them back to FCP.

Nicely done. Of course, this is why some audiovisualists have turned to Sony Vegas for Windows – formerly developed by Sonic Foundry, Vegas is actually half audio, half visual software. On the other hand, Live is a comfortable and flexible tool that does many things Vegas can’t.

Ethan also has a beautiful rendering of “Air on a G String,” the second cut from the legendary Switched on Bach. Wendy Carlos, if you’re out there, please don’t stop Ethan; I’d love to see more collaboration instead.

Air on a G String (Oscilliscoped) from Ethan Goldhammer on Vimeo.

There’s a curious distinction in hardware keyboards. You’ll find plenty of keyboards geared for performance with software at the low-end to mid-range. But if you want a keyboard with uncompromising durability and action – and you’re willing to pay more and lift more weight – those choices suddenly disappear. Suddenly, you have to buy a workstation keyboard or something with built-in sounds or even built-in speakers. What if you want a really uncompromising keyboard to use with software and nothing else?

It’s almost as though manufacturers assume “serious” musicians want to gig with built-in sounds on a standalone keyboard. That’s a pretty stunning assumption in the year 2009, given the versatility, reliability, and unmatched sound quality and diversity of software instruments. If you’re looking for a controller alone, your options are limited. M-Audio, Novation, and others have some great affordable options, but nothing really high-end. Roland, Yamaha, and Casio have some nice controllers, but the higher-end models aren’t dedicated to the task, and therefore there’s no way to dedicate all your dollars to the controller itself. (Dig deeper, and there’s still more sacrifices to make – yes, you can have x, but then we take away y…) My short list would probably be Doepfer’s lovely keyboard in a road case and Studiologic – and that’s about it.

Studiologic’s new Numa Nero, therefore, looks like the serious controller a lot of us have been waiting for. It’s a full, 88-note keyboard made for serious musicians. Yes, part of it is plastic, but plastic doesn’t necessarily mean “cheap” – good-quality plastic can be more durable than other materials. And the design itself finally focuses on getting you the best-possible keybed and action, assuming your software will take care of the sound generation.

• Graded hammer action (essential for piano players, as it makes the lower end heavier than the higher end)
• The last key mechanism design by late Fatar founder/designer Lino Ragni
• Double-dipped, “full-body” solid black keys – not hollow black keys. (The press release points out that most digital pianos have hollow keys, which is something I can verify. Unless you play in C major all the time, this is a major problem.)
• 20 dynamic curve settings which “sense” playing in real-time and respond accordingly. It sounds like the piano action equivalent of anti-lock brakes; I have to try it to understand what they mean!
• 4 zones with independent velocity curves, MIDI, program, pedal, and control settings
• Two pedal inputs, plus an illuminated side wheel controller. (The side is an unusual place for a wheel, but I could still see being able to reach it live.)

Now, what’s missing from all of this is a control surface, which bothered me initially – you don’t, for instance, get faders to use as drawbars. Upon reflection, though, I actually think having all that empty space is a huge advantage. If you’re an organ player, you can add a drawbar controller. If you’re controlling unusual instruments, you could add a touchscreen-equipped laptop. Or add a monome. You get the idea.

And the best feature of all may be this: “An aluminum back piece slides out to support another keyboard, sound module, or laptop, without the need for another stand.”

No, my only remaining gripe is that, while the keyboard supports aftertouch, it’s monophonic aftertouch, not polyphonic. Poly aftertouch seems to be a dying breed, but it would certainly have qualified this keyboard as “ultimate.” I’m nonetheless dying to play the Numa Nero. I’ve been waiting a long time for a worthy controller that doesn’t try to make sounds or arrange beats for you or do anything other than talk to your software setup, and this could be it.

US$1274, which goes to prove my point – focus entirely on the controller, and you can keep the cost low without compromise. Weight: 57.3 ponds.

There’s also a 22-pound Numa Nano coming at winter NAMM; keep your eyes out for that one – if it could be just as brilliantly-designed but more liftable, it could be the perfect companion, a nano on the road and a Nero back in the studio (or when you’ve got transport).

Numa Nero Product Page

And yes, it’s worth considering the entire Studiologic range. Ironically, the line they call “vintage” is the one with lots of added controls. They’re absurdly cheap for the quality, have action that can beat most of the pricier options out there, and immensely logical designs that pack maximum playability into the weight and form factor. The designs are, charitably, “workmanlike,” but if it’s more playable, who cares? I also understand they’re easy to service. Now, the only remaining question is why the Italian-based Studiologic seems to be so alone in getting this area right.

Having full control of a complete mix and session from your MIDI keyboard – without having to move your hands to the mouse or shift your focus to your computer screen – can be an addictive, if elusive feeling. Here’s a look at one way to accomplish that objective using the new Axiom Pro keyboards from M-Audio and CDM reader favorite Ableton Live, thanks to a first-look video provided to CDM first.

We’ve seen efforts to make this happen before, notably including the Korg Kontrol keyboard series working together with Propellerhead Reason and Novation’s Automap with software like Ableton Live. M-Audio’s Axiom Pro line has a new twist on the idea with what Avid calls “HyperControl.” Several details make HyperControl unique. For one, it doesn’t require any intervening software or drivers; the keyboard is USB class-compliant and plug-and-play, and you don’t have an additional software layer as with Automap. Also, the Axiom Pro is natively capable of sending keyboard commands, and even has a numeric keypad on the front panel of the unit. But most importantly, the Axiom Pro has its own workflow for different editing and performance functions. My suspicion is whether you love or hate HyperControl will probably hinge on how you adapt this feature.

Avid has been kind enough to give CDM an exclusive scoop on an extensive video they produced walking you through the process of setting up HyperControl with Ableton Live, step by step. Now, normally many of the videos from hardware makers make me cringe. John here has done a really terrific job, however. It’s really a tutorial and not a sales pitch, and while I’m a fan of writing and reading, this would be really confusing without the video.

Much of the working method focuses here on controlling the whole session rather than performance parameters. If that doesn’t appeal to you, skip to about seven minutes in for a discussion of “Device Mode,” which is when you finally map those eight encoders to the eight macro parameters for Device Racks so you can tweak your live synth sound. What’s nice here, though, is that you could couple that technique with the tips on recording clips, so you can play, record those clips, play back lips, and tweak all at once, one-man-band/one-woman-band style.

Have a look at the video, and let me know what else you might like to know. What isn’t covered? What other ways might you want to use a keyboard-and-software rig like this?

And don’t worry, while this week is becoming Controller Week (like shark week for MIDI nuts?), it doesn’t have to be The Ableton Live 24 Hour News Network. HyperControl also supports other software, including Avid’s own Pro Tools. Apple just released support in Logic Studio 9 and MainStage which I’m researching now. And while HyperControl is a slick moniker, I’m also researching more conventional control methods, which can even support Linux thanks to the fact that the hardware (unlike Novation’s) is class-compliant. So let us know your priorities in comments, and I’ll see if we can make them happen.

Axiom Family at M-Audio (now Avid

I Want My CDM TV

We’ll be putting more videos onto CDM TV very soon, and now you can subscribe to videos easily via iTunes, Miro, and RSS. Transcoding is fixed, too, so you can load up this video on your iPhone / iPod touch and balance it on the end of the Axiom Pro while you practice these techniques, if you like!

Subscribe to CDM TV with iTunes
Subscribe to CDM TV with RSS
Subscribe to CDM TV with Miro

Still a little thinner than we’d like, but expect this channel to heat up for the …um, fall season.

In a Hollywood overrun with remakes, a new Tron has quite a daunting challenge. The original film may be a cult hit for its 80s arcade cool, but it also was a seminal moment in the evolution of computer animation, at the nexus of obsessive-compulsive optical effects that came before and digital effects that came after. (Google Perlin Noise, if you must.) But where the bits of the effects look uneven or dated alongside the brilliant, it’s nearly impossible to top the genius of Wendy Carlos’ score. Her deft blend of choirs, orchestras, organs, and rich electronics wasn’t just forward looking: it’s fresh today, an alternative to some of the signature sameness in today’s games and films.

Perhaps Tron Legacy will do what other belated sequels have not: express love for the original. With Daft Punk helming the score and a reverent, inspired crew ready to make Tron live again, the trailer last week was the real sleeper hit of Comic-Con.

If that’s not enough layers of fandom, though, head to GearSlutz for a lesson in film scoring and a recreation of the trailer in Reason, custom Reaktor patches, and Ableton Live. This is not much of an infomercial for Live: because Ableton’s arrange view doesn’t quite understand frames, scoring with Live is a bit of a beast. (Live 9, anyone?) But it’s a great example of love for the movie and its original score. And hey, everyone need a source of joy, even a film.

Ableton Live for Sound Design :Tron Legacy [GearSlutz forum]

Stripped the original audio and redid all of the sound from scratch using Reason/NI Reaktor/Ableton Live 8. An M-Audio Axiom 49 was used to perform the Lightcycle Engine Oscillations

Wendy Carlos, if you’re out there, we get it. You revolutionized film scoring and electronic orchestration, and we’re all in your debt. It’s not so much that you switched on Bach or switched on Moog or even switched on Kubrick and guys in glowing skin-tight outfits. You switched on sound, and nothing has been quite the same since.

Now, we just have to hope 2010 can show us a good time, too.

Getting DIY ads out of YouTube is all the rage these days, but when it comes to certain time-tested synth names, let’s just say the audience is a little different. You love the gear, you make music with the gear, you praise everything that’s brilliant and you’re unafraid of criticizing what’s not. We covered the Roland “How Do You JUNO” contest launch back in April with a look back at the JUNO line through the years. Check out comments for some frank, nostalgia-immune commentary from synth geeks about the high points and low points of the various models. And so, we wind up, oddly enough, with high-production-value ads for even vintage Rolands like this Alpha Juno 2. (Hmmmm… maybe Roland should have set up an eBay affiliate account).

If anyone doubted it, there’s no question: even in the age of computer soft synths, keyboards are beloved items. The video at top is — well, pretty crazy, as you can see for yourself. Check out the crew they put together to make it after the jump.

You still have time to submit your own video to the contest, JUNO owners, if you haven’t already. The entries end tonight, Tuesday, at midnight.

Roland How Do You JUNO Contest Page
YouTube video group with the competition

Voting starts tomorrow (Wednesday) on that same contest page.

If any CDM readers have submitted videos you want to point our way, we can help you rig the contest because we love you um, get the word out.

Disclosure: Roland has generously sponsored CDM for this contest. That allows us to keep the servers humming and to have the unique pleasure of shamelessly pimping discontinued Roland keyboards from the 1980s. (I still want to see what some of you are doing with the V-Synth, which is my favorite current Roland model, but that’ll have to be a separate contest.)

This is my entry to the “This is How I Juno” contest where I explain the many unique features of my Roland Alpha Juno-2.

Producer, Editor, Sound Designer/Editor, Co-Writer, Lead Actor: Henry Borchers
Director, VFX Supervisor, Co-Writer, Actor, Associate Fight Coordinator, Stunt Double: Erik Kjonaas

Extra Special thanks to Alex Champion and the rest of the crew.

Alex Champion: Boom Operator, Voice Actor, Grip

Alex Rott: Fight Coordinator, Stunt Double, Voice Actor, Grip, Sound FX Assistant:

Ben Mayer: Key Grip

Brett Schilke: Sound FX Assistant

Thanks for the helpful participation of Jonathan Fung

For more music by Henry Borchers, please check out www.myspace.com/henryborchers

Previously:
Roland Wants Videos of Junos New and Old; A Look Back at the Juno Line
Keyboard Geeking Day: Roland Answers JUNO Questions, plus 2.0 Sampling on JUNO-G

Moldover at the Maker Faire from The Amazing Rolo on Vimeo.

Yann Seznec aka The Amazing Rolo brings CDM his coverage of music tech at the Maker Faire in three episodes today.

Our friend Matt Moldover is a mad scientist of controllers. Stock Novation and M-Audio keyboards enter, and wind up coming out as live musical control monsters. You know that kid who mashes up toys in the first Toy Story movie? It’s like that, only musically productive.

Moldover has been steadily perfecting what was originally the Octamasher, a set of M-Audio keyboards connected to a central Ableton Live brain. The basic concept is a powerful one: instead of one person, one set of secret mappings even the performer (cough) sometimes forgets (yeah, that’s me), and one computer behind which he can hide, get a bunch of people jamming and remixing live – even if they’re new to computer music.

The Syncomasher is the latest iteration, and it’s looking utterly beautiful. It can be an installation toy or a serious performer instrument – or both at once. Check out the new custom body – which still retains that whimsical Moldoverism.

Check out this controller modification how-to, as well, from last year:

You know that viral, deeply inspirational Britain’s Got Talent clip in which a lone singer bursts the preconceptions and expectations of the whole world, dazzling audiences and bringing people to tears with her talent?

Yeah, okay, so this is pretty much nothing like that.

This is more in the category of self-deprecating artists who aren’t afraid to laugh at themselves, being exactly what you’d expect them to be – and then some. Let’s call it “dorkpop,” intentionally geeky musicians willing to be just the people they are. Three keyboards, and one man with a keytar. (Note that he basically demonstrates in the video why these should be called shoulder-mounted keyboards or something, since the only thing they have in common with a guitar is a strap.)

Artists able to laugh at themselves: always a good thing.

But the really funny thing about this clip is that Simon Cowell apparently can’t laugh. He seems somehow offended by the fact that they don’t take themselves seriously. Mr. Cowell, unable to handle irony?

Well, if Susan Boyle was so heartwarming you needed a dose of irony, here it is.

Via our friends in the UK who themsleves have quite a lot of British talent, MusicRadar (of Computer Music and Future Music):

Simon Cowell bemused by keytar trio

“This is not serious, right?” Evidently Mr. Cowell has quite a bit in common with certain grumpy readers of this site in comments. (You know who you are. We forgive you.)

Boys and girls alike can feel free to crush musically on Au Revoir Simone. In a gloomy world of sound-alike synthpop, the Brooklyn trio has forged their own, unique sound, a peerless breed of sensitive synthy goodness. The songs are relentlessly intimate and honest, genuine rock writing instead of overburdened pastiche. I think a lot of us growing up wanted to be able to sound like this, when we picked up that first electronic keyboard.

And yes, for keyboard lovers, there’s something really special about seeing three keyboards, with no guitars, no drums, and no boys in sight. Love the Beatles as I do, there was apparently some point in the 60s in which everyone decided we’d be stuck with one instrumentation and any females present would be vocalists only, but Au Revoir Simone is a sign of hope.

On my first listen, the new album “Still Night, Still Light” has more and more clearly polished ideas than any of their outings so far. I have to spend some more time with it, but I find it’s impossible not to just feel good listening to their work, and that’s a nice thing for music to do.

On to how you can grab the album: physical CD pre-orders and vinyl are available from the band’s website, but Amie Street has an absurdly good deals on the music, available right now:

Au Revoir Simone: Still Night, Still Light [Amie Street]

(and yes, apologies for those outside the US – if you spot deals in your neighborhood, let us know)

Update: Note that all four albums, including the new one, are also on emusic. (Thanks, zenzen in comments!) Emusic albums may not be available everywhere, but that could help you out in at least some parts of the world.

Amie Street uses flexible pricing based on popularity. When I picked up the album, it was at US$5.90, but that price will creep upwards as more people grab it. Here’s why it’s cheap, though: for 24 hours, you can subtract 25% off the price, and for some unspecified period of time, when you buy this album, you get the first three albums from the band free. In other words, you’re talking around six bucks for all four albums, as 320 kbps MP3s. I have no affiliate relationship with Amie Street and there’s no one from ARS’ PR and publicity calling me to bug me to say this. I just expect you’ll get a couple of bucks in value from each album. If you’re not sure, Amie Street has full streams of each album.

Now, keyboard spotting anyone? The Nord Electro 2 is always front and center, there’s a Novation BassStation, I think, the KORG microKORG, lots of drum machines… carry on.

The Roland JUNO-G has attracted some interest from CDM readers since I mentioned Roland’s YouTube contest and talked a bit about the JUNO line’s history. (See previous story.)

One of you by the name of “made” even asked comments addressed “Dear Roland.” I had to admit I was curious about those answers, so Roland responded.

The JUNO-G feature a lot of readers wondered about was the onboard sampling functionality. That feature was beefed up in the OS 2.0. Personally, I’m still looking to keep my samples on the software side, but I can see this having some appeal for live performance. With 2.0, you can sample onboard, which could make the JUNO-G an interesting “live-PA”-style synth, a hardware unit with some sample savvy, and/or a way to supplement your laptop in gigs.

New 2.0 features as described by Roland:

• Sample audio from external sources or import audio phrases from the removable flash memory.
• Samples can be assigned to trigger from the JUNO-G’s function buttons or the JUNO-G’s keyboard.
• Velocity and note number can be assigned individually for each sample.
• Adjust Start, End and Loop points using the JUNO-G’s front panel control knobs.
• Advanced sampling editing such as Truncate, Normalize, Emphases, Sample Chop and Combine are included.
• Samples can automatically match BPM in real-time to changes made to the tempo of your song.

To download JUNO-G Version 2.0 software upgrade, please visit:
http://www.rolandus.com/products/productdetails.aspx?dsection=d_downloads&ObjectId=756

Now, onto the tips, which come from Roland’s Eric Klein.

Maintaining Sustain:

The Juno-G can maintain its sustain when changing patches, as long as Patch Remain is turned on (it’s off by default).
1. Press MENU, select System, and press ENTER.
2. Press F1 (GENERL).
3. Press F1 (Common).
4. Turn Patch Remain on and press F6 (WRITE).

Note that only the raw patch itself will transition smoothly; the effects engine will change to best compliment the new patch, and there will be a short glitch when this happens. The Fantom-G is the only keyboard on the planet with perfectly seamless patch–and–effects changes (and then only in Live mode). If you want perfectly seamless patch changes in the Juno-G, you must turn the effects off.

If the sustain is working backwards; that is, it sustains when not depressed but stops when pressed, this means its polarity is opposite that of the Juno-G. No worries–you can change that:

1. Press MENU, select System, and press ENTER.
2. Press F2 (KBD/CTRL).
3. Press F2 (PEDAL).
4. Turn Hold Pedal Polarity to Reverse and press F6 (WRITE). If the sustain isn’t working *at all*, it’s most likely an incompatible sustain pedal. We use the Roland DP-2, DP-8, and DP-10 here.

Ed.: I have both Roland and Yamaha pedals at home, and tried the Yamaha damper without any incident, just FYI. –PK

JUNO-G as Sampler:

The Juno’s G’s audio tracks have always utilized a powerful RAM-based sampling engine, and clever users noted that any audio file recorded into the keyboard could be manually assigned to a patch or rhythm set’s key(s) from the Pro Edit screen. Basically, it was hidden. With the new Juno-G OS 2.0, the sampling engine is right at your fingertips and any samples can easily be assigned to keys or to the buttons below the Juno-G’s screen. A fully-loaded Juno-G can store and play back up to 51 stereo or 102 mono minutes of samples and audio tracks. Samples can be manipulated with the Juno-G’s myriad synth parameters–filters, effects, envelopes, LFOs… There’s even realtime timestretch, so any sampled loops will automatically follow the song’s tempo, without changing pitch. It’s certainly a proper studio sampler.

"Can you trigger sequenced patterns from one part of a keyboard split while playing synth sounds on another?”

The Juno-G’s rhythm patterns can be triggered from the six buttons below the screen, and they can be either heavily modified or created from scratch via step sequencing. Layered/split performances can be played from the keyboard simultaneously.

If one really wants to trigger sequenced patterns from the keys, an entire song can be resampled as an audio file and be assigned to a key within a rhythm set. That rhythm set can be confined to, say, the bottom octave of the keyboard. The flexibility of the Juno-G is really remarkable.

Thanks for the answers, Eric.

If you think today’s “talk to the manufacturers” is in any way inspired by the fact that I’m busy at the OFFF conference in Portugal, you’re right. But it’s wound up leading to some interesting discussions, so I’m open to doing it again, with any makes or models you wish. (And we’ll be doing some open source/DIY Q&A soon, too, so this isn’t just limited to vendors. These are all tools we rely on, so I know they’re important.)