If we’ve learned one thing on this site, it’s this: if it’s a computer, big or small, someone’s going to find a way to make music. The iPod / iPhone, with their Mac OS-derived software guts and a multi-touch interface, are no exception — with or without Apple’s blessing. Here’s a look at what people are doing, including some apps you can download right now, and where this might go musically, whether it’s just a couple of fun toys or trying to make that pretty pocket device an instrument.

Background

There’s no question what makes the iPod Touch and iPhone significant: they are tiny, palm-sized Macs, running all the stuff that makes a Mac a Mac — Cocoa, of course, but even music-specific stuff like Core Audio and Audio Units. (For more details, have a look at the WWDC session highlights spotted by Palm Sounds, all of interest to audio specifically. It could easily be mistaken for desktop development. The Unity 3D game engine is on its way, too.) And even if you’re not planning on picking up mobile Apple hardware, this says something about the rapidly-advancing direction of mobile computing. There was a lot of talk about mobile convergence in the 90s and early years of this decade, but now it’s here.

Of course, there are strings attached. Apple was in no rush to get an official SDK and firmware out to developers, relenting only this year. And it strikes me as I see iPhones on the go that the coolest stuff is happening using "jailbreaked" phones — phones specifically hacked to get around Apple’s requirements. Even when Apple goes official, that’s likely to continue: Apple has placed some arguably onerous restrictions on development. Software has to be Apple-approved and sold via iTunes, and basic capabilities like multitasking are a no-no. Someone’s just called? Great. Your app just quit. (Bizarrely, even extremely low-end phones are willing to multitask, but not Apple’s far-superior hardware.) Whatever arguments you may make for Apple’s approach, my guess is the hard-core iPhone/Touch owner will remain outlaws to get the full capability out of their device.

Also, despite some common elements, the implementations of APIs on the mobile devices are not as complete as on desktop Mac OS. Chad from miniMusic tells PalmSounds that some features currently available in Core Audio on the desktop are missing on mobile — at least for now.

Then there’s the fact that the major Apple strength is Cocoa and Mac-based development — meaning I remain curious about what the Windows and Linux camps will do in this space, particularly Linux. Those folks do have a major, uphill battle to match Apple’s achievement here in terms of software. One would think, though, that Linux should have a bit of an edge because its comparative modularity, whereas Mac OS X was designed solely as a desktop OS — though mobile development is hard, either way.

For Mac-based development, though, iPhone and iPod Touch are here now (always a major advantage in technology). Its full-fledged Mac roots have led to the fanciful image at right and some heated discussion on CDM’s forums earlier this spring. But let’s have a look and what’s here now for the iThings, like MooCowMusic’s Band app (pictured, top).

Everything has an “API” these days, but what that means in practice is often not so exciting. You can make little widgets for Facebook, or post recent Twitter messages, or do other simple developer tricks. Echo Nest’s “Musical Brain” API is more far-reaching: it’s an API for music. All music online. The first of a series of developer tools, “Analyze” is designed to describe music the way you hear it, figuring out tempo, beats, time signature, song sections, timbre, key, and even musical patterns. More developer tools will follow.

Twelve years in development, the Musical Brain is a bit like a digital music blogger. It’s been crawling the Web while you sleep, reading blog posts, listening to music to extract musically-meaningful attributes, and even predicting music trends. It’s like almost like a robotic, algorithmic Pitchfork. (And I’m serious — it may be April Fools’ Day, but this is real. That’s what the “brain” claims to do, backed by research at UC Berkeley, Columbia, and MIT.)

What does all of this mean? The Musical Brain may not be replacing your friendly local music blog any time soon, but what it can do is infuse some musical intelligence into applications like music visualization. The Matmos album at top used the Analyze algorithm to map the timbral profiles of songs on an upcoming album; that graph was then rendered by an artist in watercolor, translating the digital into traditional paint media.

The Analyze API could also enable everything from Web music apps and mash-ups to live audiovisual performance tools, or even smarter music games. That’s the reason co-creators Brian Whitman and Tristan Jehan, both with PhDs from the MIT Media Lab, chose to open up development to a broad audience. I got to speak to Brian a bit about the project.

“Sure, the OLPC project is supposed to do wonderful things for children of the world, but what has it done for me, lately?” Well, if you fancy yourself one of the Earth’s children, the OLPC organization has assembled 8.5 gigabytes of sample content that’s free and Creative Commons-licensed — free to acquire, and free to use.

Jacob Joaquin, who runs the terrific thumbuki blog and the Csound Blog and is part ofthe team developing Csound for the OLPC’s XO laptop, shares the news via Dr. Richard Boulanger at Berklee. (See the press release as a zipped .doc.)

Plenty of people contributed top-notch sound: the Berklee College of Music, Csound developers around the world, electronica celebrity BT (himself a former Berklee and Boulanger student, among other alums), M-Audio and Digidesign, and the Open Path Music Group.

They’re donated under a Creative Commons Attribution license, so you can “freely create, compose, mix, remix, share, distribute and redistribute these samples and use them for any purpose as long as you clearly attribute the source.” That means anyone, anywhere can make use of this library — no OLPC required.

http://wiki.laptop.org/go/Sound_samples

http://wiki.laptop.org/go/Talk:Sound_samples

Csound, OLPC Style

Whether you like the OLPC laptop itself or not, there’s plenty going on with the project. There’s the immediate impact of the hardware and software, yes — and plenty of opportunity to praise or criticize its utility there (perhaps the mark of a good, ambitious project). But there’s also the secondary impact. The OLPC has captured imaginations in terms of what future computers might be, and what they might mean to more of the population of the planet. More importantly, perhaps, it’s building a family of open source, Linux-based (and cross platform technology-based) tools, which could ultimately outlive the hardware platform. I have my own doubts about the OLPC itself, but the ideas for open sound making are about more than just that hardware. (For instance, just testing Processing, Arduino and Java on this kind of mobile platform can improve that software.)

The sample library is only part of the story; software tools is another part. Powered by Csound, the OLPC team wants to put sound synthesis and music production in the hands of kids — we’re talking serious digital synthesis here, not just GarageBand-style looping. That goal could ultimately go well beyond just the OLPC.

Csound is a free and open source development tool for sound design, synthesis, and signal processing, with a lineage that goes back to original developer Barry Vercoe and in turn descended from the first digital synthesis tools created by Max Mathews. It is the audio/music development system for the OLPC project, with integration with Python (though I’ve heard we should also see additional Java development).

Those geeky details aside, you’ll see in many of the reviews of the OLPC writers mentioning unusual and fun music toys. Those journalists are stumbling upon some of the projects below, and the process is just getting started.

Jacob had shared some brief looks at what he’s working on on his OLPC, but here’s the full overview from Dr. Boulanger, because there’s quite a lot happening:

For an increasing number of artists, data is becoming the raw material for creative work. Most of this has focused on visual media, but in the digital space, you can just as easily use sound. Sometimes the results are aesthetic only; sometimes they tell you something about the numbers being sonified. But either way, sound is a powerful medium.

“Weather Report” is a multi-touch instrument that makes music out of surface temperature data. The results feel a bit like US weather agency NOAA gone IDM. Fire up the multi-touch table, and you can “read” temperature data as sound. Co-creator Jordan Hochenbaum writes us:

I just wanted to turn you guys onto a multi touch interface I have been developing with a friend of mine here at California Institute of the Arts (his name is Owen Vallis). We had out first installation a couple weeks ago at Sea and Space Explorations gallery in Los Angeles and will be bringing it to Yuris Night Bay Area in April. The table is called “Brick,” and our first piece of software for it is called “Weather Report.” Were trying to use the table as a playable and meaningful musical instrument, so Weather Report uses Brick to sonify real-time U.S. surface temperature information into ambient and melodic mini-compositions. You can check out the website (we just put it up so it will constantly be updated shortly) for more information and photos, or check out our first youtube video @ http://www.youtube.com/watch?v=45p_TPtQjR0

Are current plans for the table is making it more stable, and getting multi-touch finger tracking working nicely.

It was custom built and uses custom software written in Max/MSP/Jitter and Reaktor, as well as Reactivision (like the ReacTable).

Hope you like it so far! We are finding out new ways people like to interact with the table in order to refine how it is used, so the more people see and use it, the more usable and interesting we will be able to make it as a musical instrument.

brick: A Multi-Touch Sonification Instrument [Project blog]

CDM will be at Yuri’s Night, the global space party, in a very big way, so expect more!

They’ve gone about as fer as they can go …

Yes, just when you thought you’d seen every conceivable take on mods, customizations, clones, homages, robots, artistic reinterpretations, and other cultural artifacts inspired by Guitar Hero, there’s this — a Guitar Hero clone on Commodore 64.

There’s a lot of chatting at the beginning, but jump about five minutes in for the payoff: the Legend of Zelda Overworld theme with deliciously low-fi graphics. (All due respects to Harmonix and new Guitar Hero developers Activision, but I might point out the interface actually doesn’t need an Xbox 360.)

We’re mixing 8-bit systems here (Nintendo and Commodore), but clearly a full 8-bit collection is due. And there’s still further evidence that the Commodore 64 is the digital music platform that will outlive all the rest. Have to boot up my machine and do a C64 feature month or something one of these days.

Details, downloads at creator Toni Westbrook’s site. Toni’s no one-hit wonder, either — dig philosophical musings on adventure gaming and programming, SQL tricks (seriously), and a do-everything interface for PlayStation controllers that allows them to be used with a variety of classic hardware.

Thanks to Josh Randall (who works for some company called Harmonix — hey, when are you guys finally going to release a C64 version?) and Yarnivore for the tip.

Processing is an open-source coding tool, built in Java, designed specifically to be versatile for artists and friendly to non-coders. Code is elegant and simple, but can take advantage of all the potential power and performance (no, really) of Java. Java really can be fast enough to use in live performance situations, though its one Achilles’ heal is that automatic memory management — the very thing that makes coding easier, via something called a garbage collector — can make sound glitchy at lower latencies. (JavaSound seems worst on Mac OS X, as implementation of the sound API by Apple hasn’t kept pace with improvements in Java audio on other platforms. It is possible to build a real-time-ready Java implementation that performs as well as languages like C++ for audio, but right now there’s not yet a mainstream implementation of this type.)

That doesn’t mean Processing isn’t useful for musical applications. With experimentation, sound libraries like Minim can perform quite well, especially if extreme low-latency is unnecessary. (see Processing’s libraries page for more.) And you can always use Processing as a visual front end, while sound comes from elsewhere (Max, Pd, Reaktor, or even Ableton Live or a plug-in.)

There’s plenty of incentive to work with the environment as an artist. People who never coded before are able to build entire projects in Processing, not just uber-programmer-geeks. Even experienced coders can find it a fast way of experimenting with ideas — sometimes better-suited to tasks that are more difficult with patching environments. Despite all the hype around Flash/AIR/Flex and Silverlight, I find Processing easier to develop in, and you have far more robust development options, free and open source tools and libraries, and genuine OpenGL 3D capabilities.

I put out a call for people working with Processing for music, and we’ve already got a handful of interesting examples. Because of the open community around Processing, code is available for a couple of the ideas here, so you can have a peek and learn from fellow Processing coders.

nodeSeq from Jared Arave on Vimeo.

Handmade Music, the semi-regular evening of DIY musical oddities brought to you by CDM, Etsy, and Make Magazine, will mercilessly descend upon yet another peaceful Brooklyn evening. Expect an informal, free party + show and tell + science fair featuring self-made electronic musical projects.

Already confirmed for the lineup:

• The MIDI Pick, a pressure-sensitive DIY digital guitar pick by Roy Vanegas


• Mystery musical controllers from Eric Singer, the mind behind the world-infamous LEMUR, an educational outlet in Brooklyn and collective of musical robot/electronics-creating artists
• Theremin-playing robots and possibly other surprises from series favorite Ranjit Bhatnagar. (See the Theremin robots in action, covering Gnarls Barkley. If we’re really lucky, Ranjit will bring his students. Students, if you’re listening, we’d love to have you there!


• David Brynjar Franzson with a generative piece using custom software built in Max/MSP

And I’ll have a new iteration of my video/gesture-controlled musical creation, which allows users to virtually navigate musical structures via a webcam/DV cam. Going to keep working on that until it develops into something, then share how to do it, hopefully. I may have a surprise or two, as well, in addition.

But that’s just the beginning of the lineup, because part of the lineup can be … you.

Share Your Work in Person

As always, we welcome projects in progress to show off and share. Got something brilliant? Got something partly finished? Got something completely broken you can’t figure it out? Bring it out. I know we had at least one person from the circuit bending challenge in the greater NYC area, so of course we’d love to bring some of that into meatspace / the real world.

Share Your Work Virtually Around the World

I’ve felt bad that we can’t involve the global CDM community, much of whom, as it happens, don’t live in the NYC area. (A remarkable number of you are in Australia and Norway.) So, the circuit bending challenge video submissions worked so well, we’re going to open up the event to virtual projects on the Interwebs. Got an unusual music project — even one in progress — you’d like to share? Send us photos and/or embeddable video links by Thursday morning New York time or so, and we’ll feature it here on the site and hopefully (if wifi is cooperative) even have a “kiosk” going at the party. Best way: drop us a line on the CDM contact form.

Fair game: circuit bending, chiptune - vintage gear, DIY controllers, handmade software (code, Reaktor - Max - Pd patches, SuperColldier, whatever), hacked hardware, the works.

Drop by!

As always…

Where: Etsy Labs (blog)
325 Gold Street, 6th Fl.
Brooklyn, NY 11201
(the building has a big clock tower on it. Do NOT put too many people in the elevator! Read the sign!)

Subway: Take the A/C/F to Jay St. or B/M/Q/R to DeKalb.
Map

When: 8:00pm - whenever

Cost: FREE (light refreshments provided; feel free to bring some more)

Bring stuff if you like, or just come to hang.

Pd, Max/MSP/Jitter’s free and open-source cousin for Mac, Windows, and Linux, has long been a favorite of software DIYers. It powers the synthesis and processing capabilities of the ReacTable project, made famous recently by Bjork. And its open nature has earned some followers even among Max/MSP/Jitter users (nothing stopping you from using both).

One thing Pd hasn’t been — even assuming you know how to patch — is easy. That’s unfortunate, because there are would-be patchers who can’t afford Max, or who want a full patching environment on Linux, or want some unique features in Pd and its libraries.

Hans-Christoph Steiner has been working for a long time on “Pd-extended”, adding a lot of that polish and documentation, and making the whole thing easier to install. There’s a major new, finished release that came out last week. “Easy” might not be the appropriate word — but “easier”, combined with “powerful” and “free”, might get your attention.

Hans-Christoph himself checks in to explain what Pd is about, and this build, even if you have no previous experience with the environment. Take it away, HC:

Pd (aka Pure Data) is one of the Max family of patcher languages. It is a close cousin of Max/MSP. Pd and Max were both created by Miller Puckette. It is a visual, dataflow programming language for sound, video, 3D, etc. Basically, anything you can do with Max/MSP, you can do with Pd. Miller Puckette started Pd as his “version 3″ of Max, and therefore there are some essential differences, but if you know Max/MSP, then Pd will be easy to learn. The Pd-extended distro is the Miller’s Pd plus the work of over a hundred contributors. It includes a large array of libraries for working with all sorts of things.

There are many features hidden inside of Pd that are basically undocumented. Typical of free software developers, the Pd devs write a lot of interesting code, but are not very good at documenting it (me included). For this release, we tried to bring more of that code to the forefront. The first part is getting it easy to install, the next part is making the documentation.