Android, Apple, and Multi-Touch, from the Man Who Hacked the G1

We’ve got further compelling evidence Apple doesn’t really own multi-touch and multi-touch gestures — and that other devices and interfaces will press forward (which is a good thing for everyone). Lest you think I’m straying too far from creating digital music, by the way, I think this means lots of new music apps – as musicians have devoured multi-touch more than any other group (and certainly have used it for the coolest stuff).

I am concerned about how multi-touch innovation will wrangle with over-zealous intellectual property legal wrangling. But hopefully I made it clear that, even with my concerns about Apple, the report that Google had pulled multi-touch capabilities to please Apple was full of question marks.

Luke Hutchison is more of an expert in this field than any Silicon Valley rumor reporter. Luke pulled off the kernel module hack that turns the Android G1 into a multi-touch gesture-capable device (with, incidentally, some examples that have tantalizing possibilities for musical applications). He has detailed instructions on that, if you’re interested – and his familiarity with the code gives him a compelling argument that Google did not cave to Apple – and Apple may not even have relevant patents in this case.

It’s worth reading his whole story as it’s full of technical details as far as multi-touch’s future on G1, but here’s the executive summary as far as Apple blocking multi-touch on Android:

(1) The G1 was simply never intended to be a multi-touch device.
(2) Apple’s multitouch patent may not even cover the pinch gesture.
(3) Google *is* interested in multitouch capabilities, it’s just nowhere near the top of their priority list.
(4) Google will deal with legal issues if and when they come up, but that hardly stops them doing something they think should be done.
(5) Apparently the driver for a resistive MT-capable/iPhone-like touchscreen was checked into the git kernel tree after the 1.0 release, so we now have (at least?) two MT-capable drivers in the tree.

In other words, if you make an iClone, expect to hear from Apple legal. If you just want to use or develop multi-touch devices and interfaces, rest easy – because even if Apple decides to make trouble, they’re likely facing even more multi-touch gesture-controlled devices and law teams to back them up.

Definitely worth reading, at Luke’s blog:
The Android Multi-Touch Conspiracy… and more tinfoil hats

Zoom-Zoom-Zoom — Get Multi-Touch Zooming Support on your T-Mobile G1 TODAY (and by the way, you can hack the kernel on new G1s without the Android developer unit?)

Lemur, Dexter Multi-Touch: V2 Software, Recession-Special Price Drops

Unboxing the Lemur, (CC) Bjarke Bech.

Before the iPhone, before HP computers and Windows 7 touch features and Apple trackpad gestures, the Jazz Mutant Lemur multi-touch interface was ahead of its time. Today, it’s still unique, in that it’s one of the few commercially-available devices to support OpenSoundControl, it’s a luxuriously-large multi-touch screen, and it has exceptional precision and low latency with its tracking. Of course, it has also been subject to two primary complaints: one, that the software options for creating onscreen interfaces is two simple, and two, that it costs too much.

Well, the Lemur and its more conventional DAW-controlling Dexter sibling address each of those. The Lemur has gotten a significant software upgrade, and both have gotten a steep price cut.

read more

Gestures, Mobile Music, and the “Low Floor” for Novices: ZooZBeat on iPhone, Nokia

From the time we’re kids, we use gestures to make music – shaking, tapping, moving our bodies around, and connecting physical movement to sound. The idea of using these kinds of gestures to control digital music has been something researchers have worked on for many years. But with increasingly smart phones, equipped with mics, tilt and acceleration sensors, cameras, and other inputs, it’s possible to actually deliver these tools to average users.

The latest entry in the field is ZooZBeat. Its life as a mobile app is just a matter of months, but the research behind it involves years of work at Georgia Tech (which recently opened the Georgia Tech Center for Music Technology). The work comes from Gil Weinberg and and co-designers/programmers Andrew Beck and Mark Godfrey. We’ve followed Gil’s work with smart music apps for some time. I got the chance to talk to him about ZooZBeat.

ZooZBeat Website

Georgia Tech Center for Music Technology

read more

Daito Manabe Makes Music with Parts of His Face

Facial music, indeed. Daito Manabe has made the music the controller and his face the controlled in a new project. (As several commenters were quick to note, I got this exactly backwards when I posted this a few minutes ago: his face is the output, and the music the input.)

Daito Manabe is a Japanese-based composer, media artist, and DJ who does strange and wonderful things with inputs. This time, he’s hooked up electrical outputs to his face, so multimedia software Max/MSP, his usual tool of choice, can sequence muscle movements via electrical pulses transmitted directly to the surface of his face.

This is just one tech demo, but as an artist he does work in more fully-formed, full-length works — and happens to be coming to New York in November as part of a multimedia show at the Japan Society. Daito, if you’re out there reading I hope to catch up with you then, and perhaps buy you a Kirin, my honorary beer since it’s typically how my name is misspelled. (Peter Kirin is my typo Japanese alterego; the more popular Peter Kim my typo Korean doppelganger.)

Here’s another video; thanks to oscillateur and cptn for catching my jet lagged error.

Game Day: Play Drums, MIDI, Guitar with a Wii Controller, Free

Wiinstrument on Leopard

Wiinstrument configBless Nintendo for making the Wii controller: inexpensive, lots of internal sensor data (motion sensing, tilt sensing, buttons), elegant design, and standard Bluetooth support allowing it to be used with Mac, Windows, and Linux.

Now there’s free and open source software for making the most of your Wiimote as a musical instrument. First up: Wiinstrument, a multi-purpose percussion instrument, now available for all three operating systems (a Windows version was recently added).

  • Plays percussion / drums with gestures
  • Use an (in-development) internal sampler with WAV files, or trigger other software via MIDI
  • Use tilt for control changes
  • Supports tilt, velocity (how much force you use when you move your Wiimote), with acceleration from both the Wiimote and nunchuk
  • It works with Mac, Windows, and Linux, via a standard OpenGL-based interface, thanks to the awesome 2D OpenGL library Gosu. (Programmers, take note.)

Of course, drums are just the beginning — you could use this to trigger clips, grooves, visualist videos and animations, whatever. And it comes with demos, tutorials, source code, the lot.

Wiinstrument Release Information
GarageBand tutorial (relevant to other apps, too)
Support information for Windows, Mac OS X Leopard, Linux
Via thread with the creator on our forums

Here is in action.

But, you say, that’s all well and good, but it’s not … air guitar. Today is your lucky day:

read more