The Melodyne editor, which promises to make working with audio as fluid as working with MIDI, has long had some impressive technology under the hood. But it’s as the tool gradually matures in terms of workflow and usability that I think it could win some additional converts.

Melodyne 2.0 is a major update to the editor all around, with additional timing and tuning options and better usability, and the addition of ReWire (atop plug-in compatibility) is a big plus for some. It’s easiest to just see the videos, but the overview of what’s new in this release:

• Attack Speed tool for editing transients. (That could make this a lot more interesting creatively.) New Time Handles for changing time in the notes. These tools have special applicability to percussion and vocal phrasing, respectively, but may have some other interesting alternative applications.
• Edit notes in other scales, temperaments, and tunings. (Re-tuning to alternative tuning systems, anyone?)
• Keyboard shortcuts work in plug-in mode, display and highlight is improved.
• Work via ReWire with hosts that lack plug-ins. Read: Reason. And that could make this an interesting companion to Reason’s record workflows.

Now, sure, all of this is often understood to be for people who just want to obsessively correct pitch and rhythm of recorded audio. But I remain interested in creative applications, just because the upshot of this is having audio you can modify after it’s been recorded.

There’s just one bottom line: will this stuff be compelling enough that you add an additional tool to your DAW just to get it? I still have yet to hear from die-hard Melodyne users, so if you’re out there reading, I’d love to learn how you use the tool, particularly if you go a bit beyond the way it was intended to be used. (That’s always interesting.)

US$/€399, $99/€99 upgrade, or free if you registered after October 1. More vids:

Integrated Melodyne pitch correction in PreSonus’ Studio One is made more interesting by the technology behind it. Celemony this week describes a new technology they call ARA, or “Audio Random Access.” The notion is this: rather than just receiving or generating audio signal, the plug-in gets access to audio data. That means you can actually write a plug-in that rewrites the audio content in a recorded DAW track, as Melodyne does in Studio One.

As developer Celemony describes it, “ARA opens an additional channel of communication through which the DAW and plug-in can exchange information about the audio file, tempo, pitch, rhythm and much more, which allows them to work together considerably more closely.”

It’s the ability to exchange audio data information that seems the most compelling. Previously, audio processing plug-ins simply took buffers of audio signal from the DAW. You could “look ahead” further into that signal by increasing the buffer (and thus latency with it), but generally speaking, you’re doing the processing in something that approximates real-time. ARA in the example of Melodyne gives you access to an entire recorded track without having to transfer the audio file to and from the plug-in.

Celemony says this is “an extension of the existing plug-in interfaces,” not a new plug-in format. (If it were the latter, I’d have to point to this xkcd cartoon.) I’m still obligated to express some skepticism about how widely this will be adopted, or if it can be considered a “standard” extension, though they do promise additional vendors soon. (Implementation would seem to be by necessity on a host by host basis – and then once you have the host, a plug-in creator might add support.) It’s a proprietary technology, but then, so are the plug-in formats currently in wide use (AU controlled by Apple for Mac OS, VST by Steinberg, and RTAS by Digidesign, unless we see more of LV2). For now, though, we’ll have to see if the idea itself can extend what a plug-in can do. Check out the videos for more.

celemony.com/ara (no documentation for developers, but there is an email address to use if you’re interested)

If you want to be promptly ignored, the best way to do it is to try to release a new DAW. Aside from the fact that even most musicians don’t know what the word “DAW” is (hint: it’s a big program that puts all your computer production, mixing, and recording stuff in one place), you’re up against the likes of Cubase, Ableton Live, Pro Tools, DP, SONA… sorry, I get tired even just doing the list.

Here’s how to get some attention: be the first DAW to add Celemony’s crowd-awe-ing direct pitch modification, which lets you change the pitch of polyphonic recorded audio, right in the software.

That’s what PreSonus’ Studio One version 2 does. It’s something we’ve been waiting for ever sense we first saw Melodyne. You can now, without the restrictions of a plug-in, edit recorded audio and change pitch without having to leave your DAW, all in “one click” according to PreSonus.

PreSonus isn’t the first to add transient detection, editing, groove “extraction,” and groove quantization – features that let you make rhythmic modifications to recorded audio. Indeed, these features, once exotic selling points, have almost become prerequisites as DAWs leap-frog one another. But as PreSonus adds these features, they promise more seamless editing: to quantize, just group some drum tracks, and quantize; to do groove extraction, just drag and drop. Some tools require more steps; others promise this kind of seamless operation but don’t always work perfectly. This sounds like one to test – made, again, more interesting by the pitch editing changes.

Now, I have only one concern: Melodyne “Essential” is included, and only with the full-blown “Professional” edition; I hope we see the same degree of integration for people who buy Melodyne DNA, the all-stops-pulled “direct note access” editing. WIthout it, the integration is nice, but with it, I might even use the phrase I hate – “game changer.” Updated: Yep, DNA works. That’s a pretty big deal. Other DAWs have “pitch correction” – but I already see many readers share my comparative disinterest in just correcting pitch. Being able to directly edit recorded sounds gets really interesting, by comparison. And whatever other tools may claim, I haven’t seen anything that works quite like DNA, yet. What you need is just a copy of Studio One “Professional,” and a purchased copy of DNA.

Also in this release:

• Comping (making finished tracks out of the best bits of different takes) without switching tools – something I’ve found annoying elsewhere.
• Studio Browser for organizing assets and instruments and effects with search. (Yeah, we’ve seen that in tools like Ableton, Logic, and SONAR; now it’s here, too.)
• Folder Tracks – organize tracks, group and bus in one click. (PreSonus claims this is “exclusive,” though I’m fairly certain you get something like that group+bus function elsewhere. Anyway, it is nice.)
• Edit more than one MIDI track at once.
• New amp models, convolution-based cabinet models, convolution reverb, and an IR Maker for adding your own impulses.

So, the pieces are very similar to what you see elsewhere; PreSonus’ potential here may be how they put it together. I’m certainly ready to have another rival.

I’m always suspicious that fancy pitch and rhythm correction are just there to help you try to perfect imperfect performances. That’s something that can erase the human feel of good musicians, and make for soul-crushingly long editing sessions with bad musicians. (I’ve heard some horror stories on the latter.) But they can also be powerful remix and creative tools, especially if the workflow is improved, and that’s where they can be exciting.

I’ll be watching.

Not So Fast, Copywriter

We’re going to have to have a PR Shame Scoreboard every time a press release says something outrageous. Here’s PreSonus: “Only one DAW on Planet Earth lets you record, edit, mix, master, and distribute your music in an integrated and truly professional environment.”

Uh… no. If you send Studio One to planet Mars, then you can make this sort of claim.

(Maybe because they have SoundCloud export? I don’t know. Maybe “professional” means something that I don’t understand.)

This week:
Moog – I
PreSonus – I
Put a quarter in the jar, please. (I can forgive PreSonus, only because this has the feeling of the sentence you write when you’re exhausted and at the end of the press release: And that’s why we’re just ridiculously awesomely better than anything you’ve ever seen before and now I’m going out for a beer. ###)

So, the hyperbole beast rears its ugly head. But I’ll say this: PreSonus, who entered a category in which it’s nearly impossible to get anyone’s attention, you’ve got everybody’s attention now. And if you pulled it off, Studio One 2 could be the sleeper hit of this week’s AES show.

Because since numerous DAWs let you record, edit, mix, master, and distribute your music in an integrated and truly professional environment, on this crowded planet Earth, you do have to do something to stand out.

Update: PreSonus’ spokesperson responds:

“Oh no? Name another one. The key word is “integrated.” You can master in other DAWs but not using a dedicated mastering suite that’s intelligently aware of and fully integrated with the song editor. You don’t get that with Logic, Pro Tools, Sonar, DP, Live, Cubase, Nuendo, Reaper, or Record. I don’t know what the Martians use, but here on Planet Earth, the statement is true. “

Now, here we’re getting to the point – behind the vague statement is something that gets interesting (i.e., how it’s integrated with the song editor). I still stand by what I said, though – Record, specifically, could claim a fair degree of integration of the mastering tools within their own (different) paradigm. Anyway, I suspect users don’t need to get planetary with this; they care about how it work specifically in their own workflow. So stay tuned as we test this.

The wait is over – and rumors that Melodyne’s bleeding-edge technologies to allow direct access to notes in polyphonic audio had failed to come to fruition turn out to be false. (I was skeptical about those rumors in April.) Melodyne DNA did take longer than expected to ship, but then, that isn’t exactly news in the software business. And now you can try this “note access” concept for yourself and see what you think (well, provided you’re an existing customer). Coupled with time-based manipulation of audio in the form of updated tools in Ableton Live 8, Cakewalk SONAR 8.5, Propellerhead Record, Logic Studio 9, and others, with Melodyne handling the pitch, audio today could be more fluid than ever.

Celemony Melodyne
(Note, since you are a bleeding-edge type — the software is also considered compatible with Snow Leopard, though host-by-host certification is still forthcoming.)

What Melodyne’s editor enables:

• Harmonies are accessible, note by note.
• Pitch, position, duration, and loudness and softness can be modified.
• Formant spectra, vibrato, and pitch drift are accessible.
• Pitch, amplitude, and formant transitions between notes can be edited.

Now, all of this is in a plug-in, but that plug-in is more capable than previous versions, with better multi-threading, an adjustable window size (sigh of relief), and the ability to audition and scrub as you edit. That’s not quite as good as having this functionality in your host, but it’s more than good enough to make this usable.

I’m especially interested in what unusual sound design possibilities can be harnessed using this technology – abusing it rather than using it as intended.

Here’s how to get it:
Registered Melodyne customers are able to participate in the beta.
Launch is planned for early November at US$349 / EUR349.

I’m testing a copy now, so if you’re not a Melodyne user, I will get to report back.

More videos:

(Part 3 of 3 appears to be temporarily missing; I’ll add it once it is re-posted!)

Ah, Internet rumors: so adorable, so not actually true. But this one does demonstrate that people eagerly await the ability to edit audio with more flexibility. Something about Melodyne fires up the imagination.

Celemony caused a big stir last year with a video demonstrating Melodyne DNA technology – Direct Note Access. The YouTube video itself went semi-viral, demonstrating a kind of holy grail in computer audio: the ability to seamlessly edit audio note-by-note, even in a polyphonic texture, as easily as you can MIDI patterns.

Then, this month, a rumor started spreading through the forums that Celmony was “in a panic.” An alleged copy of a magazine I’ve never heard of, “Real Music,” claimed the mad scientist behind the technology had failed. The copy:

Celemony in trouble over DNA promise
"The technology demoed in Celemony’s upcoming Melodyne Editor used prefabricated loops and edits to illustrate a ‘what if’ scenario.
An insider told us: Everyone’s panicing behind the scenes at Celemony. Peter used a mock-up of proposed technology for live demos. In reality, producing a fully working version is proving to be impossible. When he produces a mini demo for one sampled phrase the whole thing breaks for other phrases. He’s panicing because very soon he expects Celemony to retract the promise of the holy grail DNA feature and apologize to the userbase. Peter has taken a month off work after a row with Editor’s project manager over his persistent failure to make the feature a reality."

Now, I find this all strangely alluring: Peter Neubaecker, the mad genius behind Melodyne, locked in a basement cursing his audio algorithms, perhaps with a computer hooked up to a giant lightning rod. His elongated beard only helps him fit this role. Betrayed by his assistant, Melodyne DNA becomes an utter failure. (“Are you saying that I put an abnormal brain into a seven and a half foot long, fifty-four inch wide GORILLA?”) You know, something like this:

Strangely alluring – just not terribly plausible, and, according to Melodyne, entirely made up. A representative for Celemony points me to this quote from forum host and site webmaster Claudio d’Allere, who tries to dispel the speculation:

Nobody is panicking at Celemony. We know we are late, and that may have raised some speculations. However, DNA still works as intended, and we are happy to invite you to our public beta test that we expect to start in late May or early June. Feel free to try this beta with your own audio files and not just "prefabricated loops"."

So, yes, the story – sit down for this one – is that the software is late. Let me explain something: late is much, much, much better than early. Early means that someone has shipped software before it’s entirely baked. I know this comes as a shock, of course. Just as we know it’s utterly unheard of that software or other technology be delayed (the horror!), we certainly have a hard time imagining anyone shipping any music technology with some features missing or lingering bugs or anything like that. Jeez.

Anyway, all my sources say Melodyne DNA is very much on track, and still looks fantastic to me. I’m sure, as with any audio algorithm, you’ll find audio that doesn’t work perfectly, but that’s true even of simple things like a Compressor.

The good news is, if you don’t have enough to do or have extra time on your hands, you can use the affordable Melodyne Uno to have fun right now, by recreating the spooky voice of the GLaDOS computer from the video game Portal. Behold:

Lately, I’ve had a number of conversations with audio and music tech industry figures in which they complained about the untamed wilderness of the Internet. These chats didn’t necessarily start with “You crazy kids and your…,” though I suspect that may have been implied. I’m sure that odd twists like this rumor were what they had in mind.

The Web does indeed give the power to transmit inaccurate information quickly – but it’s equally quick at correcting it. And it does gives us things like this awesome GLaDOS tutorial, so to me, it all balances out.

I am a crazy kid, though. Guilty as charged.

Stay tuned for that beta.

Sonic scientist Peter Neubäcker of Melodyne has been wowing Internet audiences for some time with the automagical powers of the company’s Direct Note Access (DNA). The vision: manipulate individual pitches as easily as MIDI notes, even in polyphonic passages of a single instrument. At NAMM last month, the company showed the first product, Melodyne editor, due to ship in the spring for US/EUR 349.

There’s just one little catch: a solo developer has beaten them to the punch, at least prior to them shipping their DNA flagship editor tool. And if you want it right now, it’s yours for 25 Euros. (The final version will cost 99 Euros.)

Jonathan Schmid-Burgk, sole developer and a student at Harvard, announces:

The time has come to announce the release of the world’s first published polyphonic tone manipulation software. The dream of musicians to isolate single notes out of chords and so to manipulate most forms of recorded audio has come true on the 20th of January 2009.

Shell out EUR25, and you get a Mac VST plug-in that can manipulate audio easily. With monophonic audio, you can create polyphonic harmonizations. You can isolate and manipulate individual harmonics – meaning not only can you do pitch manipulations, but presumably sound design, as well. You can change individual notes or chords in recorded audio, to fix mistakes or (more interesting) actively recompose audio.

I feel about this the same way I do about Celemony: this gets really interesting when you use it for sound design. For some inspiration, skip this post and head straight for the sound samples on the site:

VisualVox polyphonic 0.9 [improvisator.de]

Via the awesome rekkerd.org

Also check out his Harmony Improvisator which creatively generates harmonies from MIDI input – an interesting thing to mess around with even for those of us who know / have taught (ahem) classical harmonic theory

Now, VisualVox Polyphonic isn’t without some catches, as you’d expect from the solo-student cheap alternative:

• It’s Mac-only and VST-only for now. (Just keep in mind, though, that means not only Cubase works but things like Ableton Live on the Mac, as well.)
• Jonathan warns that there are still some bugs, there are big temporary files, there are occasional glitches in the algorithm, and it doesn’t quite sync properly with hosts, requiring exports.
• The interface isn’t as slick or fancy as Celemony, and may be slightly less convenient for editing.
• Update – people are having some significant hosting issues with this. (Your mileage may vary, though the fact that this was tested in Cubase tells me those folks may have better luck.) So stay away if you don’t like bugs – this isn’t a final release. We’ll have more as this evolves, okay?

But here’s why I’m anxious to test it, nonetheless:

• It’s cheap – meaning it might be more open to people just curious to experiment. (I actually wonder if he shouldn’t keep the EUR25 price and make up for it on volume.)
• No iLok dongle, as required for Celemony. Correction: Celemony also allows challenge/response — so you have a choice.
• There are some interesting fine-tuning options for the algorithm and manipulation parameters. That could make this more interesting for sound design – and something even Celemony users might want to run alongside the more polished tool.

In other words, none of this is likely to dampen enthusiasm for Celemony, but that’s a good thing: more is more better. Could this mean the floodgates are about to open for creative sound design tools that mess with audio in new ways? Hey, I hope so.

If anyone tests this, we’d love your report – and sound examples.

Celemony is showing their new technology at Musikmesse, and they’ve got demos online you can check out:

Direct Note Access

Grab a note inside a chord, and you can manipulate that note directly. Retune it, change timing, adjust formants, change amplitude — timbre, time, and pitch are all accessible. Celemony is largely pushing this as a corrective tool, as that’s an obvious market, but needless to say, creative applications — even creative abuse — become interesting, too.

Melodyne Studio costs US$399 (349 EUR), with various discounts for upgraders, and the technology will be making more limited appearances elsewhere in Celemony’s product line. Now, it is a plug-in — clearly, someday this sort of thing will just be integrated directly in your host of choice, and I’m particularly excited about the day when it becomes a live performance tool. But for now, it could well be worth the cost of ownership.

You’ll have to wait a bit: the new version is scheduled to ship in the fall, though if you buy now, you’ll get the update free. Celemony, I’ll be seeing you at AES, I think.

Compatibility: Mac (Intel/PowerPC), Windows (XP/Vista)

Thanks to everyone who sent this in (Alex, Karsten, Eric, and others)! By popular demand, the demo video SonicState grabbed at Messe, because they’re organized enough to actually be in Frankfurt while I chill out here in NYC:

MESSE08:Melodyne Blows Our Minds