MSAFluid for processing (Controlled by iPhone) from Memo Akten on Vimeo.

TUIO is a simple but powerful emerging protocol for multitouch control for live music and visuals, as used on the powerful live tangible synth reacTable. Apparently no one told Apple, however. While the App Store rubber-stamps useless toys like fake cigarette lighter flames, they bizarrely rejected a powerful application by a leading digital artist that would enable standardized TUIO control – for free. (More back story below; see an example in action above.)

As a blogger, my reaction is usually to whine and pontificate, for better or worse. The engineering approach would be to find some hack away the problem. That’s what Andrew Turley did with the TUIO protocol. So, Apple won’t allow an app that does the trick? Why not go back to what developers did before the SDK, and just use the iPhone browser?

As Andrew explains it:

After reading the story I started thinking about seeing how far one could push Safari as an application platform, using web apps to get around Apple’s tight control of the app store. Since you would be connecting to another computer anyway to use an OSC application, why not just have the app be a web app running on a web server somewhere on the local network? The web server can then take care of things like sending out OSC messages or playing music or doing whatever it is people want to do.

To that end I created a little system that implements the TUIO protocol. You use an iPhone to run a web app, which in turn talks to the web server, which in turn sends OSC messages.

MSA Remote for iPhone from Memo Akten on Vimeo.

Since the dawn of computing, developers have been free to create whatever software they can imagine for computers. Windows, Mac, UNIX, Linux, Atari, Amiga, Apple II, Commodore 64 – it doesn’t matter. Come up with an idea, and short of doing something destructive on the system, you can make it work on a computer. It’s this freedom that has made the computer age possible. Game consoles have been different, a relic of the days when cartridges were physical objects you put in the machine. But mobile devices have generally acted more or less like computer platforms – look at Windows Mobile, Symbian, Linux, Android, Palm OS, Palm’s Web OS, and so on. It wouldn’t be odd to expect the same of the iPhone or iPod touch, which is essentially a Mac running on a low-power platform with a mobile-optimized set of libraries. The iPod doesn’t even connect to a wireless phone network; it uses WiFi just like your computer.

As musicians and artists, this sort of freedom has given us the freedom to make expressive music and art using powerful tools. That same freedom hasn’t applied to comparatively restrictive game platforms, which is why music apps for platforms like PSP and Nintendo DS require hacking hardware and software.

But then there’s the iPhone / iPod touch. Apple claims that they create a superior user experience by controlling quality, and they use that control to pick and choose which applications they think are appropriate for their phone. Never mind that a whole lot of what’s available on the iTunes store is simply worthless crap. And, frankly, that’s okay – users pick and choose the good stuff, and a lot of it’s really great.

But far from simply protecting mobile carriers like AT&T from abusive apps, it’s clear from developer experiences that Apple has extended that supposedly superior judgment to second-guessing developers on design and application purpose.

The latest victim: a fully free wireless multitouch server that would empower iPod touch and iPhone users to control live art and perform, created by one of the world’s leading interactive artists, Memo Akten. It seems Apple’s powers that be rejected the app because they simply don’t understand what the heck it is.

The story so far: