If we’ve learned one thing on this site, it’s this: if it’s a computer, big or small, someone’s going to find a way to make music. The iPod / iPhone, with their Mac OS-derived software guts and a multi-touch interface, are no exception — with or without Apple’s blessing. Here’s a look at what people are doing, including some apps you can download right now, and where this might go musically, whether it’s just a couple of fun toys or trying to make that pretty pocket device an instrument.

Background

There’s no question what makes the iPod Touch and iPhone significant: they are tiny, palm-sized Macs, running all the stuff that makes a Mac a Mac — Cocoa, of course, but even music-specific stuff like Core Audio and Audio Units. (For more details, have a look at the WWDC session highlights spotted by Palm Sounds, all of interest to audio specifically. It could easily be mistaken for desktop development. The Unity 3D game engine is on its way, too.) And even if you’re not planning on picking up mobile Apple hardware, this says something about the rapidly-advancing direction of mobile computing. There was a lot of talk about mobile convergence in the 90s and early years of this decade, but now it’s here.

Of course, there are strings attached. Apple was in no rush to get an official SDK and firmware out to developers, relenting only this year. And it strikes me as I see iPhones on the go that the coolest stuff is happening using "jailbreaked" phones — phones specifically hacked to get around Apple’s requirements. Even when Apple goes official, that’s likely to continue: Apple has placed some arguably onerous restrictions on development. Software has to be Apple-approved and sold via iTunes, and basic capabilities like multitasking are a no-no. Someone’s just called? Great. Your app just quit. (Bizarrely, even extremely low-end phones are willing to multitask, but not Apple’s far-superior hardware.) Whatever arguments you may make for Apple’s approach, my guess is the hard-core iPhone/Touch owner will remain outlaws to get the full capability out of their device.

Also, despite some common elements, the implementations of APIs on the mobile devices are not as complete as on desktop Mac OS. Chad from miniMusic tells PalmSounds that some features currently available in Core Audio on the desktop are missing on mobile — at least for now.

Then there’s the fact that the major Apple strength is Cocoa and Mac-based development — meaning I remain curious about what the Windows and Linux camps will do in this space, particularly Linux. Those folks do have a major, uphill battle to match Apple’s achievement here in terms of software. One would think, though, that Linux should have a bit of an edge because its comparative modularity, whereas Mac OS X was designed solely as a desktop OS — though mobile development is hard, either way.

For Mac-based development, though, iPhone and iPod Touch are here now (always a major advantage in technology). Its full-fledged Mac roots have led to the fanciful image at right and some heated discussion on CDM’s forums earlier this spring. But let’s have a look and what’s here now for the iThings, like MooCowMusic’s Band app (pictured, top).

Multi-touch controller goodness is now as close as your nearest iPod Touch or iPhone; all that remains is to hook it up to some creative music, visuals, or others. (I would prefer the iPod Touch for this reason; then you don’t have to worry about using it as a phone — draining the battery in the process — or needing AT&T service.)

Olle Holmberg has a new solution for using the Touch/iPhone as a controller, by translating input to OpenSoundControl (OSC) and, if you prefer, MIDI messages. He writes:

I was searching everywhere for a way to get my new iPod Touch to work like a wireless touch controller to Pd (and hence to everything else), but couldn’t find one — so I made one. It’s really just an OSC mapping for routing the default Mrmr “Performance.mmr” interface, but if you’re interested it would save you heaps of time, even though it’s not really anything difficult to make.

Mrmr is an “open protocol for mobile devices” for dynamically creating interfaces; we’ve covered it on Create Digital Motion, where vade has interviewed the creator, and we’ve seen it in action coupled with upcoming visual app 3L. Those solutions used proprietary software like Max/MSP/Jitter, though, whereas this works with the free and open source Pd. (We love Max, but having an alternative is good, especially if you just want to hook up your iPod Touch to Ableton Live or Reaktor, etc.) As far as I know, this should also mean compatibility with Windows and Linux, but maybe someone can verify that.

The Pd patch is below — homely but functional, and you can extend it if it doesn’t do what you need.

For more information and download of the first release:

PdiPod - Mrmr to Pd on iPhone & iPod Touch [on pissypaws.tumblr, Olle's blog]
Pd Forum Announcement and Discussion
Files/download

Scratching with a mouse just doesn’t feel right. One solution, as in FinalScratch and other products, is to print timecode onto the vinyl. But then there’s the direct approach: strap that mouse right onto your turntable and hit the club!

That’s just what the DIY-oriented community of users of terminatorX have done. terminatorX is a fully open-source scratch synth on Linux, with support for files like OGG, MP3, and WAV, and even (recently) Linux’s open stereo plug-in format, LADSPA. terminatorX lacks fancy features like support for timecode-printed vinyl, so users take a more literal approach to melding mouse and turntable.

Practical? Well, not especially. But fun? Heck, yeah. (Added benefit: a couple of these are far lighter and smaller than a real turntable.)

Necessity is definitely the mother of invention:

• Some of the projects use a series of belts to connect rotation mechanically to the mouse apparatus
• Toqer worked with a DIY optical sensor apparatus; several of these use optical sensors on the mice to keep from touching the records (thus making these even kinder to records than an actual cartridge would be)
• A number of projects feature full-blown motors and entirely-concealed mice
• Adam King built an entire DIY turntable with a mouse connected inside the unit (pictured, top)
• My personal favorite, Fernando S. Fabreti took the brute-force approach and put a mouse directly on the tone arm. (below) Insane. Brilliant.

More projects, photos, and links to specs and how-to instructions (I imagine you could do damage with ideas like this using other software, or even applications other than turntables):

terminatorX Turntable Gallery

This should also leave you more than typically safe from stepping on any N2IT/FinalScratch patents. Thank Douglas Englebart for this one.

As the Monome, the sustainably-produced open controller hardware, spreads, it’s going from one-person gimmick (i.e., “look what I’ve got!”) to club and community (”let’s get together and monomate!”). Laptop circles like Share in New York have already introduced the digital drum circle, but Monome owners may soon be converging, as well. Last weekend, Monome users met up in Princeton, New Jersey. Kempton writes::

A quick recap, there was a little show and tell, a few instructional sessions showing what people do, and several jam sessions during which people walked around and were able to watch each other in action. MLR was the most used app, though many others were used, including some homemade apps. Everyone seemed to be coming from different genres, which created a wild mix. I think everyone walked away saying that we need to do it again, so hopefully you can make the next get together!

Monome users in other places, how about you? Perhaps a Monomefest in the device’s hometown of Philadelphia?

Here’s a time-lapse video of the NJ meetup. Granted, not any big win for, um, diversity (not visibly, anyway), but that, too, may change with time — and any time we get out of our bedroom studios and together with other folks is a welcome change:

East Coast Monome Jam (4/19/2008) from makingthenoise on Vimeo.
More Monome Meetup Videos From Around the US

Also on Vimeo:
See the Portland Monome meetup
and the Los Angeles Monome meetup — with none other than Monome celebrity Daedelus. (Daedelus, I like to think of you as Monome’s Keith Emerson.)

West Coast vs. East Coast Monome — fight!

Here’s the good news: the Tenori-On is really going on sale here in America. It’s about the same price as in the UK, as expected. (GBP600 = about US$1200.)

The bad news? If you want to buy one, good luck. Yamaha says initially only about 100 units a month will be available. (We also heard “1000 units” for the whole year, which would mean they stop doing 100 units each month after September, if that’s right.) To put this in perspective, the Monome 64, with zero press behind its launch, sold out a 100-unit run in 120 seconds. After getting hands-on with the Monome, I want to reemphasize that a square grid of buttons are the only things these two designs have in common — but you can bet ravenous demand will be one other common feature. (Another example: the permanently-backordered x0xb0x.)  Heck, even the Arduino board, a USB kit for electronics makers, has 500 units on-hand at one vendor alone, and they typically sell out when a new semester begins.

That means that Tenori-On is getting the same cautious launch it got in the UK, even though the UK is a much smaller market than the US. (We may not be as electronically-savvy, but there are five times as many of us Yankees.) And there’s the US press blow-out likely to happen (Gizmodo and Engadget were on-hand at the press event last night; Friday the launch hits San Francisco.) And there’s a full half year of buzz. We didn’t even hear word that Tenori-On would be available in record shops in the US as in the UK; word was distribution will be exclusively online, via Keyfax. (Updated: There’s nothing on the Keyfax site, so head to www.tenori-on-tour.com.)

It’s not for lack of manufacturing capability; the Tenori-On is expensive to produce, with its unusual, rounded magnesium frame, but Yamaha literally has robots for that. (They had pictures of what would look like mass production, but isn’t.)

It was curious to hear people muttering "too expensive" in association with the unit, because I don’t think that’ll be a problem. Anyone wanting one, plan to have a party by your mouse the night before 5/1.

Benny Goldman has an early review at Gizmodo. That’s actually my voice you hear in the video, talking to Yamaha about when the "experimental" limited run will end and the Tenori-On will become a mass-market product. I’ll have to see if I screwed up Engadget’s sound, too.

Of course, the best way to get a Tenori-On in the US is to build a sophisticated interactive table and win over a crowd of people, but that’s been done already, and there is the danger of winding up with just a hat. More on that later today.

Peter Dines, known for his work with Reaktor (don’t miss his fantastic Reaktor Tutorial Project blog) got a first-hand look at the Yamaha Tenori-On’s first North American stop on its launch tour. He brings us some impressions of the launch, and introduces the phrase "switchboard acrobatics" to the lexicon, which I think will have to find a home in these discussions from now on.

I’ll be at the Brooklyn event tonight, so if you’re there, do say hi! We’ll have coverage of the artists and event soon. (Yeah, I cheated — these are London launch event photos.)

Here’s Peter — and yes, it’s interesting to know that those buttons aren’t necessarily immediately intuitive when you’re under the gun!

Since I am an extremely lazy person I had only a cursory knowledge of the Yamaha Tenori-On when I arrived at SAT for its gala Montreal launch. A number of the little blinking beauties were set up at kiosks separated from the loud music of Pheek by the flimsiest of curtains. I waited in line for my turn to have a poke at it, and when I got it I was baffled.

Yes, there were instructions. Step four required the user to hold down a function key while pressing an LED in row nine. Now I don’t know about you but I don’t immediately recognize groups of nine out of an array of sixteen by sixteen identical, evenly spaced das blinkenlights, especially when there’s a queue of impatient people behind me. There was also no obvious way to turn up the volume to a level that would be audible in the venue. Disheartened, I passed the headphones to the guy breathing down my neck, got a beer and settled in to watch musicians who evidently knew the ins and outs of the thing as they worked it on stage.

Once the domain of the few, creating and customizing sophisticated DIY controllers is now more accessible than ever. That means, if you can’t find what you want, and you’re ambitious and knowledgeable enough, you go make your own. Josh Boughey was impressed by the Monome enough to buy one — but the Monome, a grid of on/off buttons, doesn’t provide any kind of variable control. So Josh built his own, combining a series of parallel touch strips with LED indicators. (The lights are the tricky part, requiring an obscene number of connections.)

The creation, dubbed “Stribe” by Josh, could have been a one-off. But instead, he’s working on making it into a tool for others, with completely open source hardware and software. The whole system is built on the popular Arduino platform, making it uncommonly easy to modify. It’s a work in progress, as you can see lacking an enclosure. But ten have made it out into the wild, people are already programming custom software, and more are coming.

I got to hang out with Josh while he was in town this weekend. Luckily, he’s a fan of early music, meaning we met at a concert of a viol consort that was playing my music — an unusual collision of 15th and 21st Century music technology.

Josh gave a demo of the Stribe, for myself plus Phil Torrone of Make and Limor Fried (aka lady ada), creator of the x0xb0x open-source 303 clone. It’s still a project in process– there’s more to be done in firmware and support software and documentation — but it already shows some real promise. I snapped some shots, studied the Max patches, and mostly listened to Limor and Josh talk about the challenges of starting a DIY hardware business. (I hope that DIY builders start to share experiences, even informally, as they work to make the business end work so they can keep building.)

Just what can happen when you let your baby go? Someone else can do stuff with it you didn’t expect. Here’s musician Stretta developing music ideas-in-progress with the Stribe (see blog post, Stribe forum thread):

A Brief Conversation Resulting in One Less Child from stretta on Vimeo.

Some tidbits from the hands-on session:

Squarely in the “not seen at NAMM” category, the Bubblegum Sequencer uses differently-colored bubble gum balls, arranged in a grid of holes, to create rhythmic patterns. It’s not exactly a leap forward for music — you wind up with a pretty simple drum step sequencer — but it does look like fun. Or it would be, except I’d wind up eating the tangible sequencer. Note to self: make interfaces out of something I won’t devour.

What’s rather interesting here is that the whole system uses computer vision analysis — a camera spots the gum balls by color. One thing that means is that you could skip the grid altogether and apply this to something very different.

The hyper-rational voiceover I find really amusing. Now, just add hard-disk recording next year, and the Bumblegum 5000 could  in fact be at NAMM.

Thanks, Johan!

Updated! Holy crap! Analog Industries has started a blog war:

Peter Kirn got all up in our grill with a bubblegum sequencer over on CDM. Well, Peter. I’ll see your bubblegum sequencer, and raise you one done with Skittles.

“I Eat Beats” Skittle Sequencer

I Eat Beats from Kyle McDonald on Vimeo.

But, come on, Chris. I enjoy my Skittles now and then, but bubble gum is more delicious, and you can’t blow a bubble with a Skittle.

I have heard that Moog Music is introducing a Candy Sequencer OS (Old School), using salt water taffy. And looking at comments, the International Conference on New Interfaces for Musical Expression this year may just turn into a massive rumble / turf war of tangible interfaces. Which is why my tangible interface will be Pop Rocks.

Updated, again! Still more. This time, Evan from thisisnotalabel sees our bubblegum sequencer and raises us a ball bearing sequencer. Careful, though, kids. Those are not edible. Choking hazard!

Still more: it’s a dining table as musical interface, in a sonically-augmented culinary artwork:

Eric Singer, creator of musical robots and maestro of LEMUR, the League of Electronic Musical Urban Robots, has unveiled a new wireless sensor-to-MIDI interface. It’s quite a bit pricier than the non-wireless MIDI models at US$495, but the payoff is a complete kit for wireless performance that promises to be resistant to both latency and interference. The receiver can be connected via either USB or MIDI, and the sensor unit has 20 inputs which you can mix and match as up to 10 analog ins and 20 digital ins. Put the sensor/transmitter unit wherever you like, then transmit data wirelessly to the receiver — so the sensors could be strapped to a dancer while a computer or synth receives the data elsewhere.

I hope to have a hands-on demo soon, but in the meantime, here are the specs — just in case that wireless project can’t wait any longer.