The Cupertino-Mushroom Kingdom gap has been closed: you can now mix and match DS and iPhone/iPod touch for wireless control of music and visuals. DSMI, the homebrew library that has enabled wireless and serial MIDI connections from the Nintendo DS, has come to iPod touch and iPhone. That means anyone building instruments and controllers on the iThing can now add wireless MIDI controllers that talk to computers – or other mobile devices, including the DS. It also means that DSMI’s acronym standing for “Nintendo DS Music Interface” has only one word that describes all the things it does.

If you’re a developer, you can grab the open source (LGPL-licensed) code. If you’re a user, apps are already supporting the new wireless features. There’s MIDI Motion Machine, which provides tilt and 16 triggers, and iXY, a 99-cent app for KAOSS Pad-style X/Y touch control. The MIDI Motion Machine author, TheRain, takes an interesting approach: there’s both a free and pay version, and the free version has source code.

Tobias Weyand, DSMI’s original co-creator along with TheRain, writes:

My friend TheRain has ported DSMI to the iPhone! This enables iPhone deveopers to easily integrate wireless MIDI in their applications, making it possible to control any MIDI application on the PC with the iPhone. The Wifi-to-MIDI bridge is the same DSMI server application that is also used for the DS, thus it works with Windows, OSX and Linux.
Also, like on the DS, both OSC and MIDI are supported!

DSMI for iPhone is available from our Google Code site (http://code.google.com/p/dsmi/) together with an open source example application called MIDI Motion Machine that is a tilt-based xy-controller.

The cool thing is that this library takes away all the hassle of communicating MIDI messages to the PC and makes development of MIDI controllers very very simple. So, we hope that people will use the DSMI to create a lot of innovative iPhone MIDI controller apps.

Pretty cool, isn’t it? :-)

When I first saw the iPhone at Apple’s keynote in 2007, my first thought was, this could be an interesting controller: big, pretty display, accelerometer sensors, and multi-touch input. It’s not without some problems (namely, small amounts of latency, the lack of tactile feedback inherent to touchscreens, and the size of your fingers reducing accuracy). But with refurb iPod Touch devices going for US$200 and the flexibility of having an interactive, handheld display, it remains an intriguing possibility.

Nonnus’s new iTM MidiLab (released by Silicon Studios) is a suite of MIDI controller apps. It’s free, with a planned future commercial version. It only works with networked Mac OS X 10.5 computers, so Windows and Tiger users are left out for now (because of the client app required).

Unfortunately, the app itself is held up by contract and distribution issues which seem to be plaguing many iPhone/iPod Touch developers; see a separate article on things mobile Apple developers are unhappy about. But in the meantime, Nonnus sends some details. Updated: Nonnus also notes that latency reports from users have been very positive.

See also the project site:

iTouchMidi (the original project name, rejected by Apple)

And discussion on the Ableton forum:

http://www.ableton.com/forum/viewtopic.php?t=95117

Nonnus sends along some additional details in a rough/informal email, with images, to CDM:

Intua is the first to get a full-fledged music creation app on the iTunes App Store, with an MPC-style sampler and step sequencer, plus effects, for the iPhone and iPod Touch. This isn’t just a toy for triggering sounds or a useful utility like a guitar tuner; it’s an actual music app on which you can produce whole songs. As with any mobile app, there are tradeoffs versus a desktop tool – but its simplicity is likely to be part of its appeal. US$19.99.

Most importantly, it’s available now.

The basic features:

• 16-pad sample triggering. Drum kits and other samples, with “auto chop,” pitch, tuning, reverse, mute, and even a nice wave editor for touch-selecting where you want sample start and end points.
• Step and song sequencer: Create patterns with a touchable step sequencer, then arrange them into bigger songs using a multitrack editor.
• Live performance support: Pattern triggering and recording is live, so you could use this as a performance tool.
• 2 effects channels: Synchronized delay, 3-band EQ, bit-crusher capabilities
• Pre-loaded kits and samples
• Sync with desktop audio: Apple doesn’t provide music apps with easy ways of getting files in and out, so Intua has built one: a synchronization tool that lets you load in new audio kits and samples, and export audio back to your machine.

We can certainly see some of the strengths of the platform. The app looks absolutely gorgeous in screen shots; elements are big and friendly and don’t appear to strain the eyes. The touch capability works beautifully for pad triggering and step sequencing – there’s even a nice, draggable velocity and “groove” graph for the step sequencer.

So how does BeatMaker stand up to the competition, at least on paper?

Hardware sequencers were a fantastic idea: you had a box that did nothing but sequence other gear. Then along came the computer, then the idea of trying to make the computer do absolutely everything all the time, and the standalone MIDI sequencer disappeared. In a bizarre twist of fate, it’s back — on Nintendo DS.

Jed (beatsnbleeps.com) writes to let us know about his DS sequencer, DStep. It’s partly an “homage to the KP3″ from Korg, though unless your fingertip is the size of a DS stylus point, it should be a bit more accurate touch-wise. It’s a very elegant little step sequencer, shown here controlling a Nord Micro Modular. (The modular patch you see on the computer screen is the Nord editing software.) Hardware MIDI support gets hacked into the DS via Collin Meyer’s DS MIDI cable hardware/code solution.

It’s funny, because to me this brings the way you integrate a computer into a studio back full circle. It’s not that you dump the computer — on the contrary, you simply use it as a component in a set of gear.

As for mobile gadgets to work with, this also illustrates some advantages of the DS over the iPhone — well, aside from the obvious facts that it’s far cheaper, you’re not saving up battery life to make calls, and you can play Mario Kart. The old-fashioned game hardware buttons actually come in handy, and they’re ergonomically placed, you get the added precision of a stylus, and the DS hardware is more hackable. Multi-touch would be nice on those faders, though.

If you’re ready to give this a go, here’s what you need:

DS MIDI hack

Tob’s DS MIDI Website

DStep details and ROM download

It’s still in development, so we’ll be watching.

Previously: GrooveStep step sequencer / pattern maker for DS

The DS’ stylus and touchscreen make an ideal pocket-able interface: they’re coupled with friendly, conventional arcade buttons, but provide precise control of visual interfaces without using a mouse. (Touch with fingertips is not nearly as accurate, especially on tiny screens.) That’s already inspired quite a bit of music software, but GrooveStep earns extra points for employing a friendly interface for easy, quick pattern sequencing.