If we’ve learned one thing on this site, it’s this: if it’s a computer, big or small, someone’s going to find a way to make music. The iPod / iPhone, with their Mac OS-derived software guts and a multi-touch interface, are no exception — with or without Apple’s blessing. Here’s a look at what people are doing, including some apps you can download right now, and where this might go musically, whether it’s just a couple of fun toys or trying to make that pretty pocket device an instrument.

Background

There’s no question what makes the iPod Touch and iPhone significant: they are tiny, palm-sized Macs, running all the stuff that makes a Mac a Mac — Cocoa, of course, but even music-specific stuff like Core Audio and Audio Units. (For more details, have a look at the WWDC session highlights spotted by Palm Sounds, all of interest to audio specifically. It could easily be mistaken for desktop development. The Unity 3D game engine is on its way, too.) And even if you’re not planning on picking up mobile Apple hardware, this says something about the rapidly-advancing direction of mobile computing. There was a lot of talk about mobile convergence in the 90s and early years of this decade, but now it’s here.

Of course, there are strings attached. Apple was in no rush to get an official SDK and firmware out to developers, relenting only this year. And it strikes me as I see iPhones on the go that the coolest stuff is happening using "jailbreaked" phones — phones specifically hacked to get around Apple’s requirements. Even when Apple goes official, that’s likely to continue: Apple has placed some arguably onerous restrictions on development. Software has to be Apple-approved and sold via iTunes, and basic capabilities like multitasking are a no-no. Someone’s just called? Great. Your app just quit. (Bizarrely, even extremely low-end phones are willing to multitask, but not Apple’s far-superior hardware.) Whatever arguments you may make for Apple’s approach, my guess is the hard-core iPhone/Touch owner will remain outlaws to get the full capability out of their device.

Also, despite some common elements, the implementations of APIs on the mobile devices are not as complete as on desktop Mac OS. Chad from miniMusic tells PalmSounds that some features currently available in Core Audio on the desktop are missing on mobile — at least for now.

Then there’s the fact that the major Apple strength is Cocoa and Mac-based development — meaning I remain curious about what the Windows and Linux camps will do in this space, particularly Linux. Those folks do have a major, uphill battle to match Apple’s achievement here in terms of software. One would think, though, that Linux should have a bit of an edge because its comparative modularity, whereas Mac OS X was designed solely as a desktop OS — though mobile development is hard, either way.

For Mac-based development, though, iPhone and iPod Touch are here now (always a major advantage in technology). Its full-fledged Mac roots have led to the fanciful image at right and some heated discussion on CDM’s forums earlier this spring. But let’s have a look and what’s here now for the iThings, like MooCowMusic’s Band app (pictured, top).

Multi-touch controller goodness is now as close as your nearest iPod Touch or iPhone; all that remains is to hook it up to some creative music, visuals, or others. (I would prefer the iPod Touch for this reason; then you don’t have to worry about using it as a phone — draining the battery in the process — or needing AT&T service.)

Olle Holmberg has a new solution for using the Touch/iPhone as a controller, by translating input to OpenSoundControl (OSC) and, if you prefer, MIDI messages. He writes:

I was searching everywhere for a way to get my new iPod Touch to work like a wireless touch controller to Pd (and hence to everything else), but couldn’t find one — so I made one. It’s really just an OSC mapping for routing the default Mrmr “Performance.mmr” interface, but if you’re interested it would save you heaps of time, even though it’s not really anything difficult to make.

Mrmr is an “open protocol for mobile devices” for dynamically creating interfaces; we’ve covered it on Create Digital Motion, where vade has interviewed the creator, and we’ve seen it in action coupled with upcoming visual app 3L. Those solutions used proprietary software like Max/MSP/Jitter, though, whereas this works with the free and open source Pd. (We love Max, but having an alternative is good, especially if you just want to hook up your iPod Touch to Ableton Live or Reaktor, etc.) As far as I know, this should also mean compatibility with Windows and Linux, but maybe someone can verify that.

The Pd patch is below — homely but functional, and you can extend it if it doesn’t do what you need.

For more information and download of the first release:

PdiPod - Mrmr to Pd on iPhone & iPod Touch [on pissypaws.tumblr, Olle's blog]
Pd Forum Announcement and Discussion
Files/download

We live in an age of disposable electronics. iPod battery wears out or new prettier iPod arrives, and old iPod gets tossed. Or, if you’re Norwegian sound artist and musician Espen Sommer Eide, your iPod could live a second life far more interesting than its first.

The Slåttberg is a custom musical instrument fashioned from an iPod running Linux, pdPod, the iPod-ready version of open-source multimedia patching software Pure Data, a 60s-era loudspeaker cabinet, an internal amp, and, most importantly, a big crank. Plugged into a Moogerfooger FreqBox, the resulting instrument feels like a reimagined analog Hurdy-Gurdy. Espen says he was inspired by deconstructing Norwegian fiddle music, and it comes out in the instrument not only in the sound but in the sense this creation is something Norwegian ethnomusicologists might collect, alongside ancient Scandinavian flutes.

Those of you in Norway, let us know how the premiere goes, and what else happens at the festival — sounds terrific. Espen writes:

Hi being a regular reader of your site, and since your article about the pdpod a while back inspired me to use my old ipod for this project - I thought you might be interested to check it out. A preview video of a custom built musical instrument by Espen Sommer Eide, artist and member of Alog and Phonophani. The Slåttberg will premiere at the Borealis Festival for contemporary music Bergen, Norway late february 2008.

alog.net

Alog, by the way, is the acclaimed duo of which Espen is one half. And anyone who makes use of Duck-Rabbits (the “famous gestalt psychological figure representing both a duck and a rabbit depending upon the point of view”) wins still more bonus points.

We first took a look at the Pacemaker DJ when it was announced in May. The idea is interesting: it’s a mobile 120GB hard drive with touch controls for internal mixing/cross-fading, effects, a separate cueing output, and pitch control, along with rich format support (even OGG, FLAC, AAC). That’s all well and good, but the device will apparently cost US$700.

Barb Dybwad at Engadget optimistically offers that “it’s a relatively low-cost convenient practice setup for DJs on the road or an attractive option for aspiring amateurs.” Hmmm … I normally agree with Barb, but in this case, let’s make that:

• relatively high-cost
• DJs would normally practice with real decks or software, not this
• aspiring amateurs have much more attractive options. (A laptop and Deckadance, for one. Assuming you’ve got the laptop, that’ll set you back US$99 - 179. And you could pick up a basic M-Audio controller for about US$100, and it’ll be easier to control than this.)

Not that you need me to tell you any of that. I’d still like to get my mitts on one to see what they’ve done; I just can’t imagine who this is for. If you know, write in.

Beatportal goes way over the top and asks if this is “a revolution for DJ and youth culture.” Let me answer that question: no. Youth culture? Dude, I grew up in a generation for which Garbage Pail Kids and slap bracelets revolutionized youth culture. Kids don’t really need that much for entertainment. The ones who really define culture tend not to blow a grand on mobile gadgets. And as far as something that is “set to revolutionize the way we think about DJing and mixing,” didn’t laptops do that already?

Still, since I was one of the people arguing for a “pro-level” iPod way back in 2001, I have to admire the idea. It just seems to lack some meat, like recording capabilities, or the ability to really integrate into a DJ setup. Of course, in 2001 I was much more innocent and immature. I’ve been working out, and now I can lift big boy hardware.

Speaking of things you probably don’t want: Dr. Dre-branded headphones manufactured by Monster Cable. I don’t know, maybe they’re great.

We’re just counting the hours until next week, when the NAMM show hits and we get really cool music stuff. Those gadget bloggers in Vegas at CES don’t know what they’re missing.

IVO Software, a Polish company that develops text-to-speech software, have announced they’re making a free PDF of A Christmas Carol available for download on their site. The idea is, you take this PDF, then unleash their Expressivo text-to-speech tool on it. Sure, every actor from Patrick Stewart to Jim Dale to … well, just about anybody who’s anybody with an English accent has read the story. But now you get it in the somewhat robotic monotone of “Jennifer”, an American, synthesized voice. Jennifer has won awards and rave review, but let’s just say computer-generated speech in general can’t help pass a Turing Test yet.

If you’ve been hankering for a little artificial speech in your holiday, though, don’t pass this up. In fact, if you want to hear Dickens’ words completely mangled, try Polish and Romanian voices on the English text. And you thought you would never hear A Christmas Carol in a new light. Dickens as you’ve never heard it before.

Free sample passage of the text
Expressivo Download Area
PDF repository, direct download of “A Christmas Carol”

For more holiday cheer:
Christmas Carol Mondegreens, which is what happens when you mis-hear lyrics. (Think: “See the blazing Yulbie Forest” and various things roasting on an open fire.)

If you didn’t see it last year, there’s always — through the magic of digital sampling — the Nutcracker Suite played entirely on bicycle parts.

And lastly, from the CDM forums, a very Happified Wintricated Holidation to all. Now let’s get celebratronic, at least until we make up our own holidays.

Alex le Lievre has built what looks like an insane custom controller for Pro Tools LE using an iPhone. He seems to have mimicked the look and feel of Pro Tools so successfully that some called the results a fake. There’s incredibly detailed feedback on track status, including live audio signal feeds and transport controls. It even uses iPhone’s tilt mechanism.

This is interesting for two reasons: one, those lusting after iPhone and iPod Touch have another reason to drool. But secondly, Digidesign has been pretty closed about their controller mechanism. If this is real, Alex did a pretty great job of cracking into it. (I only just heard from JazzMutant, by contrast, that their Dexter won’t support Pro Tools because it’s not possible.)

ProRemote 0.0.1 on YouTube (darned nice “0.0.1″ release!)

Alex’s video on his .Mac page

Thanks to Chris O’Malley for the tip.

Could Apple be working on a Control Pro? One commenter thinks so, and this patent evidence from last year at least suggests they’ve thought about it. (Keep in mind, though, sometimes experimental ideas don’t become products, and patents are hard to read.)

Updated: How Alex Did It

Alex wrote in. He’s in fact a very experienced programmer with background in Pro Tools plug-in development, software architecture, and Macromedia’s multimedia architecture (pre-Adobe), among other things, and he’s kind enough to share with us how the whole thing works.

Developer Harmonix has specialized in interactive musical game creations, most recently the hit games Guitar Hero and (forthcoming) Rock Band. But developing for console platforms is one thing. What about an iPod?

In a small miracle, a team at Harmonix has managed to successfully create a surprisingly rich game experience for iPod owners. Called Phase, the new game manages to recreate the signature “falling gems” music game design on Apple’s micro-platform. It manages to somehow cram slick visuals and gameplay onto the music player, and by working with your music, it could change how you listen to music — playing with it instead of just playing it.

And, hey, even if you’re not into that idea, it still looks insanely cool and costs only slightly more than a pumpkin latte.

You can buy Phase now for US$4.99 from the iTunes Music Store, with a playlist of music included. You need specific iPods to play it, since iPod generations tend to be incompatible with one another. 5th-generation iPods, the cute new Nano, and iPod Classic all work; earlier iPods and the touchscreen iPhone and iPod Touch don’t. But for those who love iPods with tactile control, you’re in luck.

Phase Game Product Page

Visual Tour

The game is the work of a team at Harmonix, under the creative direction of our friend Josh Randall. Strangely, every time I see noted Boston VJ RobotKid, the visualist companion of dj rndm, Josh mysteriously disappears, a la Clark Kent and Superman. I’ll let you figure that out.

Art is by Aaron Stewart, who has also created the cutest dog and cat pillows in the universe.

Here’s a look at the game’s lovely visual style:

The iPhone and iPod Touch have big, pretty screens, plenty of space for touch control, and fit in your pocket for lots of other useful things (like, you know, calls or music or whatever these things were invented for).

So, why not put them to use in performance? Just this week, Create Digital Motion has picked up two new solutions for doing just that, free:

MIDI Control with iPhone and iPod Touch: i3L MIDI Bridge

Mrmr : iPhone + 10.5 + Quartz Composer = Wireless VJ Nirvana

Mrmr’s support of OSC is geared for VJ apps, but something similar could be applied to OSC-supporting music tools like Max/MSP, Traktor, Reaktor, and others. And i3L’s support of MIDI, of course, will work with anything. I could see it cuing up scenes in Ableton Live or changing instrument patches, etc.

No iPhone? No problem. One quick note: if you don’t have the cash for a new iPod or iPhone, there are always alternatives. Jason Kramer’s Bluetooth MIDI solution works just fine with that free phone you got with your plan — maybe even one you recently retired. Much as we love all this flashy new stuff, there’s nothing quite like giving your toxic technological leftovers a new lease on life!

Control Music Software with a Bluetooth Cell Phone / PDA (Ableton Live, Pro Tools, Logic Pro)
LiveController [Jason R. Kramer]

Mobile music creation week continues! Happy Valentine’s Day, a few months early. This February, you’ll be able to light some candles, pour a bottle of wine, and start developing real applications for the iPod Touch and iPhone, fulfilling a dream a lot of us had when we first saw the iPhone last January. (And yes, this means that iPod Touch interface for MainStage you’ve been imagining can now be a reality.) Sayeth CEO Steve (on Apple Hot News; no direct link yet):

Let me just say it: We want native third party applications on the iPhone, and we plan to have an SDK in developers’ hands in February.

So what was the holdup? Building a secure platform:

Some claim that viruses and malware are not a problem on mobile phones—this is simply not true. There have been serious viruses on other mobile phones already, including some that silently spread from phone to phone over the cell network. As our phones become more powerful, these malicious programs will become more dangerous. And since the iPhone is the most advanced phone ever, it will be a highly visible target.

To some of Apple’s defenders who claimed this was the plan all along, this will be a “told you so” moment. They may be right, they may be wrong; it’s impossible to know what’s going on inside Apple. But either way, I think it’s safe to say that months of criticism from the developer communities and Mac community as a whole sent a clear message to Apple that open platforms and open development are important. Whether it influenced the decision to build the SDK, increased its priority, or simply prompted this announcement, it did have an effect.

And that’s a message not just to Apple, but other hardware makers. We’re living in an age of developers. JavaScript is great. But real apps are great, too. Developers want open platforms they can build upon. Savvy users are increasingly able to hack unusual creations to customize the hardware they buy. And non-programmer users very often want to choose how they use the gear they invest in. The iPhone and iPod Touch are already terrific devices, but they’re likely to be even better when users can use them the way they want.

Regardless, Apple: thank you.