You’re now approved to DJ with your iPhone. Or at least the app is. I’m not sure if I can take credit for getting Apple’s attention, but Apple has approved the TouchDJ application from Amidio. That’s big news, partly because developer Amidio has consistently been at the forefront of musical development on the platform, including their Noise.io synth and wild hexagonal JR Hexatone Pro.

This also is a big blog to the theory that Apple is intentionally blocking DJ apps — and a big boon to the theory that the App Store is just plain clogged, even if it may be disproportionately affecting more sophisticated applications.

Features in the release:

• “Visual mixing,” with a clever interface that uses overlays atop side-by-side waveform views
• Pre-listening using a special left/right adapter
• Faux vinyl and spin effects
• Real-time scratching, looping, positioning, EQ, effects, re-pitching
• Onboard sampler with 3 WAV sample slots, recording from the mic
• Uses a separate MP3 library with companion apps, since it isn’t possible to DJ from the library you sync from iTunes

Now, to me, that last point is a fairly significant one. You have to load tracks you wish to DJ separately, in MP3/M4A format. And I’m sure that this will start various debates about whether you’d want to DJ on your iPhone in the first place. But don’t look at me — I just work here. I’d be remiss if I started out the week talking about apps stuck in iPhone limbo, only to ignore them immediately becoming available. And I will say, Amidio is one of the smartest mobile music developers out there, so it’s worth checking out the range of what they’re doing.

Whether petitions and news stories did help this app to get to the top of the queue or not, I have no idea. I think maybe I’ll start running screaming headlines with things I want in them, if only for good luck.

Tomorrow on CDM: “You Know What Annoys Me? The Fact That We Don’t Have Unicorns. Magic Unicorns. Who Speak OSC.”

multi-touch the storm – interactive sound visuals – subcycle labs from christian bannister on Vimeo.

What if you could mash, mangle, mush, and morph sounds with your fingers on a screen, watching the waveforms dance in response in three dimensions? That “what if” is expressed beautifully in a project by musician-developer Christian Bannister of Portland, Oregon, who works as Subcycle Labs.

The result is like being able to touch sound directly.

Three-dimensional forms morph and vibrate using visuals programmed in Processing, making architectural-organic shapes and spaces that really begin to “look” like sound. These forms can represent synthesis and effects parameters (Christian has done some work with the Massive synth from Native Instruments), or can allow navigation through loops using touch. Gestures remap offsets and duration for audio, scrub and slice, and apply granular resynthesis.

Controls use multiple touch points on a screen (apparently via Community Core Vision and reacTIVision), with sound from Logic, Reaktor, and Max/MSP, and auxiliary control with a joystick array and KORG KAOSS Pad.

Here’s what happens with a Massive bass line:

low frequency entity – subcycle labs from christian bannister on Vimeo.

It’s spectacular, gorgeous work, and I can’t wait to see more. It’s well worth reading through the whole description on the blog for more details, technical, musical, and artistic:

http://www.subcycle.org/

As computer music practice – part composition, part instrumental play – spreads, the idea of software interface as performance tool is becoming second nature. Putting those opposable thumbs and sensitive fingertips to work, multitouch controllers are growing in number, variety, and sophistication. Berlin-based artist Marco Kuhn shows off his beautiful creation, the PlayBox multitouch hardware, and its first app, PlayLive. That first software focuses on Ableton Live performance, but Live could be just the beginning – Marco has worked with Pd in the past and promises other apps to come. He’s interested in selling this device in the future, and he shares with us the tools he used to create this work for those of you doing development along similar lines.

The Project:

“Play Box” is is a User Interface for Natural User Interaction.
? allows multi-touch and object recognition (TUIO marker)
? hovering is also possible
? 22 ” TFT display , 1680 x 1050 pixel
? robust
? plug`n play

“Play Live” is a dedicated multitouch controller surface for Ableton Live.

- GUI Elements support multi-touch interaction
- easy to setup , just load the “Play” Control Surface
- you need no controller assignment
- you can control 32 tracks and 127 scenes, that are 4064 clips
- track controls are mute, solo, record, send1, send2, pan, level
- scene feedback name and state
- clip feedback color, name and state
- Transport control
- 2 Returns
- Master
- support bidirectional communication
- display track level meter, name

The whole app is coded in python.
- use Python Ableton Live API
- and libavg www.libavg.de for the GUI and Trackingengine
- PyPortMidi receive/send Midi Messages

“Play Live” Future plans:
- FX View per Track
- subpage for abstract clip controlling

I tested it with my mac book pro, “Play Live” and “Ableton Live” is running at the same machine. It should work on all platforms (Windows, Linux, Mac OS X). That Project started with my Diploma Thesis in Applied Computer Science 1 year ago.

Everything is coded and built by myself. The GUI – elements has been designed by Gösta Wellmer.

In this work, I created a GUI-Controller Library which allow me to Develop very rapidly Multitouch Interfaces for other Audio Environments.
More Apps coming soon ;-)

I [plan] to sell the” Play Box” and Apps like “Play Live” if anyone is interested.
The price is yet not specified.

That`s not my first multitouch Interface. 2 Years ago I created forfour – http://forfour.hi-pi.de/
- used PD, Processing, Reactivision and OGRE.
But the “Play Box” is another level;-)

For more on the project:
www.hi-pi.de/play

I hope to have video to share soon – and yeah, it’s time to plan another visit to Berlin.

There’s plenty of rightful skepticism about the use of mainstream displays for multitouch in general purpose computing. And why not? As a full-time replacement for other input, multitouch probably doesn’t make sense. But for music, the equation is changing. Multitouch capabilities are showing up on commodity-priced PC computers like the multi-touch enabled HP laptop models – the tx2z seen here starts, incredibly, at US$850. And because computer musicians are looking for more control, having a touch-enabled display (even single-touch) just makes sense.

The screen for a laptop musician is a huge piece of real estate. Finally, instead of sitting dumbly in front of you glowing, it can become an X/Y controller or give you shortcuts for controls or provide additional parameters. Yes, using a touchscreen exclusively can result in the dreaded “gorilla arm.” The ergonomics of using a vertically-oriented screen are extremely poor – if you use it exclusively for an extended period of time. But if you look at the way people are using these touchscreens, for incidental control in combination with other things – and the ability of convertible laptops to transform into a horizontal orientation – I think this is no longer the deal killer it once was.

At top, an HP laptop ($850) plus the free version of Sensomusic’s Usine is all you need to create a multitouch interface for Ableton Live. Correction: right now this is limited to single touch only, but multitouch is supported in the hardware, in drivers, soon in Windows 7, and support is promised for a future version of Usine. The point still stands — as does the ability to optimize controls for your fingers. Being able to use more than one at once will, of course, be that much better.

Fractal (see Myspace) uses the combination to play Ableton Live with some simple controls. If you get hooked on Usine, you can get the full “Pro” version for EUR70 with additional patches and objects.

The one major remaining obstacle to multitouch, at least, is cost. If you don’t especially fancy buying a new HP laptop, add-on kits still run in the range of US$800-900 (meaning, ironically, you might as well just buy the HP instead). Laptop vendors are still slow to adopt the technology, though that could change when Windows 7 ships later this year. (On the other hand, tablet PCs, even when they were shipping in relative quantity, often were constrained in available configurations and either skimped on specs or demanded a significant premium.)

But let’s not complain too much. The simple reality is you can add an HP laptop now to a live rig as a performance instrument for under a grand.

To see something else with Ableton Live, here’s a video by Andrew Coenen from earlier this year of Pance Party’s Bartelby playing Live with the open source Max Multitouch Framework. This is a more sophisticated setup – it requires a table-style setup using the Frustrated Total Internal Reflection tracking method. But the idea is basically the same. (By the way, Max 5 is an optimal choice because of its excellent widgets, and it’s great having this choice, but it’s a little odd having an “open source” framework in proprietary software. If you want a fully open source solution, there are options like PyMT, which we recently saw on Create Digital Motion. And that said, there’s no reason you can’t try out both.)

And yes, someone has done Reason, too (poor-quality video, but gives you an idea).

Updated: As I’m posting this, I see that Oliver Chesler is writing about how effective touch interfaces can be for synthesizers – just using iPhone as the example (but the idea still holds). And, in fact, you don’t necessarily even need multitouch to make this work; single touch would be effective.

The example: an upcoming iPhone/iPod touch synth from the folks who gave us the Curtis granular synth, The Strange Agency.

Sound Scope Space for the iPhone [Wire to the Ear]

Sound Scope Space demo from strange agency on Vimeo.

Of course, I have to point out at this point, this is another reason that OSC (OpenSoundControl) support becomes essential. Whether or not conventional gear vendors adopt OSC, it’s a logical way to deal with the growing number of touch-enabled devices, from your own display to your iPhone.

I expect this could all accelerate as we near Windows 7’s release. (You don’t need Windows 7 – HP is doing just fine without it – but the presence of in-box APIs for paging through photo galleries and the like is almost certain to encourage Microsoft’s hardware partners.) Stay tuned.

More Examples

$200 Makes Your Laptop Touch-Enabled; Usine Music Demo

Sensomusic Usine + Ableton Live = Modular Touchscreen Interface

For that reason, you may be intrigued to see this video of Zen Piano, a demo app for the iPhone and iPod touch. The idea: respond not only to the position of your finger taps, but also to how hard you’re tapping the phone That promises “velocity-sensitive” tapping, which would make touchscreen interfaces more powerful.

Here’s the somewhat overheated description by GreatApps, who say their “patent-pending,” “cutting-edge” technology is the result of “having gone through the research and development phases.”

TapForce^TM has been developed from the ground up to provide a completely intuitive way of interaction for users. It can detect more than a hundred different levels of force, and has an accuracy that has to be seen to be believed. And all this can now be done in software, no hardware modifications are necessary. Hundreds of millions of devices currently on the market can make use of the TapForce^TM technology today.

A whole new range of games and apps has just been made possible.

http://greatapps.co.uk/technologies/

Okay, so what is it doing, exactly?

Most likely, it’s simply reading data from the accelerometer. Hit the device harder, and the accelerometer will respond to more force. That’s actually a fairly clever combination of two sensors – it’s just not the sort of stuff you’d necessarily want to trademark or try to get patented, at least, not if you’re a normal person. (TapForce creators, feel free to explain to us that you’re doing something fancier and I’ll eat my words.)

In fact, part of the reason I suspect that’s how they’re doing this is I’ve been tipped off by a developer who’s already implemented just this. He even uses a piano-style keyboard to show it off.

Sadly, that developer and application is Memo and his MSA Remote application, which was inexplicably blocked from the iTunes store – I think because whoever would have understood the app was on a lunch break or something. See, previously:

MSA Remote for iPhone

Apple Rejects Free iPhone Tool For Artists Because of “Minimal User Functionality”

But as it happens, this is something any mobile device can do that has an accelerometer. I may try something like this on the Android app I’m developing. (No one can reject that, because Google allows any application package to be installed on the device should the user chose to do so. Perish the thought.) Accelerometer data alone is usually not very useful, but combined with touch, it could start to make more sense.

It’s another reason to look forward to MSA Remote, and I do still think that the snafu with Apple will get cleared up at some point. (Unfortunately, what we had on CDM were a lot of rants – perhaps even justified rants – but not necessarily the best way to make the argument to Apple’s store.)

Ever feel like you’ve found the seam dividing past and future?

The past: restrictive UI frameworks requiring pages and pages of code to produce dated-look 2D displays. Proprietary software with rigid interfaces. Input bottlenecked through the x and y coordinates of a single mouse pointer.

The future: UIs whipped together graphically or with a few lines of code. 3D mixed with 2D. Open-source, friendly frameworks. Creating your own interface or drawing upon a community of creative software makers. Input that uses multitouch for gestures, collaborative input, manipulation of 2D and 3D space, and … well, just a lot more fun.

There’s no need to wait around for the future. Creative software inventors are building it for themselves. Here are two of the most promising multitouch interface projects I’ve seen in my inbox.

In no time at all, you’ll be painting a cow! (Okay, more on that in a moment…)

Make Max Multitouch

Max Multitouch Framework by composer Mathieu Chamagne makes turning your Max patch into a multitouch interface a breeze. When I first reviewed the Lemur, I was frustrated by the hardware-style abstraction between your software and the interface. Why was I having to go through Max patches painstakingly assigning Lemur controls to Max controls – why not just make the Max controls appear on the multitouch screen? Well, that’s exactly what you get with MMF. Using a set of Max abstractions, all you have to do is build your Presentation Mode style UI and add in the MMF ingredients – it automagically becomes touchable on a variety of displays.

It’s not hard to imagine how great this could be for musicians, especially those who have already been building original sonic creations in Max/MSP. Best of all, you don’t need an expensive, non-portable table with a projector inside, either – commodity hardware works just fine right now.

Requirements :

- cycling’74 Max5 (version 5.0.6 required)
- any multitouch interface that sends TUIO messages.

MMF has been tested and works fine with : Stantum SMK-15.4 multitouch screen, HP XT2 tablet pc (windows7 + W2TUIO), Demand Evolution + home made multitouch screen + Reactivision / Tbeta , …

MMF (Max Multitouch Framework) @ Mathieu Chamagne’s Site

Hmmm… apps that send (cough) TUIO, eh? Ah, yes, but that’s why you need companies like Apple to tell you what qualifies as useful in an iPhone app. You see, without Apple’s app review team and their superior wisdom, I might wrongfully assume this sort of app would be something I’d want. Now I know better – thanks! (Sorry, couldn’t resist.)

Back to the on-topic discussion, this does demonstrate a real advantage of Max: it has its UI absolutely nailed, and the open-source alternative Pd is woefully behind. It also demonstrates that the beauty of Presentation Mode is, by abstracting the UI from the underlying guts, you can consider alternative interfaces. We should see that in Max for Live, as well.

Pd is fantastic in other ways, but if there’s anyone out there who fancies writing a lightweight new front-end, it could use it – perhaps in Python. Which brings us to the next item.

pymt demo reel from Thomas Hansen on Vimeo.

PyMT: Juicy Multitouch, Just a Few Lines o’ Code

PyMT is a glimpse of what future development could look like. While Microsoft putzes around with their Windows-only Surface, PyMT makes multitouch platform agnostic, open, and easy. That frees up artists to dream up creative new ways of applying this interface to expressive musical and visual creations (among others). Instead of reinventing the wheel as far as plumbing, you can focus on the reason for using devices in the first place – your art.

PyMT is profoundly portable, using Python and OpenGL to deliver windowing and multimedia features across platforms. Documentation and code are both under heavy development, but there are already some friendly-looking resources. This is almost enough to shake me from my loyalty to Java, though, in fairness, you can do some of the same things with Java and other tools. What’s most important is that there are libraries that are providing standards, like TUIO, and implementations in cross-platform languages that can be easily developed.

There’s good reason to be bullish on the future of this tech. And if you want to see it happen, don’t wait – you can get involved in the project directly.

PyMT at Google Code

PyMT Project Page

This is interesting for two reasons: one, those lusting after iPhone and iPod Touch have another reason to drool. But secondly, Digidesign has been pretty closed about their controller mechanism. If this is real, Alex did a pretty great job of cracking into it. (I only just heard from JazzMutant, by contrast, that their Dexter won’t support Pro Tools because it’s not possible.)

ProRemote 0.0.1 on YouTube (darned nice “0.0.1″ release!)

Alex’s video on his .Mac page

Thanks to Chris O’Malley for the tip.

Could Apple be working on a Control Pro? One commenter thinks so, and this patent evidence from last year at least suggests they’ve thought about it. (Keep in mind, though, sometimes experimental ideas don’t become products, and patents are hard to read.)

Updated: How Alex Did It

Alex wrote in. He’s in fact a very experienced programmer with background in Pro Tools plug-in development, software architecture, and Macromedia’s multimedia architecture (pre-Adobe), among other things, and he’s kind enough to share with us how the whole thing works.

The remote is real. I plan to sell it if Apple lets me once they certify my code- I assume that will happen after they release they native software SDK in February.

Here are some snippets of previous posts that may answer some of your questions. If not feel free to ping me anytime.

It works on the iPod touch and the iPhone (on all firmwares supposedly) and the reason “why” you would want this remote in the first place (at least for me): by the time I have gotten up and walked over to my console 10 times to adjust the levels, I no longer want to play music. This software allows me to control my rig from the drums or my guitar setup and hopefully keep the music flowing.

I have a Tranzport which is what inspired me to write this software. I can’t get far enough away with my tranzport and it doesn’t have touch sensitive faders! :( Not to mention the UI on the tranzport is 2 lines and certainly not in color… I was thinking it would be cool to support their plugin architecture so that I could support the same DAWs as they do on my iPhone (they support them all it seems). I don’t think I can distribute their code but I could probably tell people where to get it! :)

more technical:
This software is in three pieces: the first piece is the software on the iPhone (the remote). The second is the server (the brains) and the third is the MIDI driver (to communicate with ProTools)… The midi driver and server live on the ProTools machine.

The server process uses a proprietary protocol over TCP on port 8183 and 8184. This isn’t some lame web service- it’s a high performance, low latency, full duplex server. It kicks ass and yes, it can act as an internet server if you so choose. The ideal however is to have local access to the server.

You can run the server program on any machine you like (this may change for performance reasons). In my case (and the best case) is to run the server on the same machine as ProTools is running on- This reduces any latency to the iPhone.

I’ve also tested the remote on the AT&T EDGE network which means you can control your rig from anywhere in the world that has internet or EGDE. Why you would want to do that is beyond me.

The communication between the remote and server is not standard MIDI over IP. The ProRemote protocol is optimized for Wifi-remote access versus serial access for MIDI. The server communicates with ProTools (and soon other hosts) via a MIDI driver using the Mackie HUI (MIDI) protocol.

Future:
There is a transport control in the app where you can also see the timecode. I may put the timecode somewhere else… I’m also considering adding a dedicated transport “page” with a large “footswitch” style button for punch (you could use your big toe or something to trigger the big punch button) and a finger controlled scrubber/scroller as well as the usual host of transport buttons (but larger) and buttons for track selection, in, out- loop, etc…

I was thinking it would also be cool to use the accelerometer inside the phone as a panner… (think Wii but with the iPhone as panner)- People who think you are crazy will know for certain if you start panning by making insane gestures with your iPhone.

Finally, there are other goodies planned for the remote that I can’t talk about at the moment!

Really amazing stuff, and I think says a lot about where hardware/software integration will go in the post-MIDI world — not just for the iPhone/iPod, but new generations of hardware devices. Alex has more planned, so naturally we’ll keep you posted. (Now, Alex, about an Ableton or Logic version…)