Paper, Drawing as Musical Controller: A Round-Up

touchanywhere

Imagine drawing an interface on paper, then being able to use it as a musical interface. Or, heck, don’t imagine it – do it. Unfortunately, the kinds of intelligence necessary to make the music video in yesterday’s post just aren’t practical yet. (That is, you could draw a picture of a keyboard, and even use the picture as a music controller, but while you or I could recognize a keyboard from a drum pad and know that line is a fader, a computer would need some sort of advance structure for any recognition to work.) But you can do some really clever things, as folks have shared in comments.

And using some basic paper interfaces, you can make entire instruments for just a few dollars.

Of course, the awesomest way to do anything is with LAZORS. Greg Kellum and Alain Crevoisier presented a paper at last year’s NIME (a conference for new interface designs for music) proposing a system for making any surface a control surface. Like the music video yesterday, you can configure your surface to function however you like – even dividing it up into pads and faders.

By now, you’e likely seen plenty of multi-touch interfaces or means of tracking hands. But, to paraphrase the NIME paper, these either require a special surface (or transparent surface), or they can’t actually detect when you’re touching. You can even use multiple cameras or an IR beam, but there are limitations to accuracy and the size of the usable surface that would result. Kellum and Crevoisier use an infrared camera and two illuminators, each built by pointing a laser at a mirrors.

Yawn, you say, been there, done that, seen Jeff Han’s video… The advantage of this system is that you can use any surface, like your dining room table. And you can configure that surface however you like. There’s even a freely-downloadable Surface Editor you can extend in Java and Processing. The creators claim they can even get input latency down to a reasonable 10 ms using high-speed cameras.

Transforming Ordinary Surfaces into Multi-touch Controllers [PDF paper, NIME 2008]
Future Instruments > Projects
Thanks, Randy Jones!

db3ll has created a keyboard out of paper, and of course it works better than those flimsy rubber “roll-up” pianos you see for sale. “Conductive ink is what I used,” he says, “painted on as traces on the non-printed side of the paper.” That’s the twist – I had assumed you’d use the top of the paper, but the trick is to use the reverse side to provide the “wiring.” He also offers advice for making a fader:

read more

Updated Lemur Touchscreen Display Coming

It’s still anyone’s guess exactly what fruit parent technology maker Stantum may soon ship, but the JazzMutant Lemur touchscreen is getting a component update soon. Nat Lecaude points to a quiet MySpace post from JazzMutant with the details of a coming manufacturing change.

“…the next batch of Lemur will feature the latest generation of our multi-touch technology: better optical performances, higher precision, greater accuracy and responsiveness. It will be clearer and have brighter colors. We plan on launching the new Lemur in early October, and of course we will keep you updated as we get closer to launch date. We once again thank you for your patience, and look forward to sharing the excitement early October!”

It’s actually quite remarkable to me that JazzMutant remains alone in this market – and with Stantum focused on the mass market, that could be the case in the future, too. The issue is that doing multi-touch well still costs some money. There are basic implementations on computers that are cheaper, but that restricts you to a few computer models, because slapping multitouch overlays on displays remains pricey. So HP can get a few computers to the mass market, but not without cutting some corners and not even on that company’s full range. The iPhone has brilliant multi-touch control, but a mobile form factor makes this much easier.

I’ve got some videos demonstrating what’s possible with the Lemur coming soon, as well as some notes on how the software has evolved since I first saw it in its initial release. Even if you don’t want or can’t afford a Lemur, it’s a fascinating demonstration of interaction design and OSC, with lessons (inspiring and tough alike) for other interfaces.

Photo by Rainer Knobloch for CDM.

TouchOSC Controller with Template Editing Coming Soon to iPhone, iPod touch

touchosc

The beauty of using touch for controllers is flexibility. Sure, you give up tactile feedback – but you can also quickly make your own layouts, make touch controllers an ideal complement to your existing hardware gear (the stuff with physical knobs and faders and pads).

For that reason, we’re all eagerly anticipating an upcoming version of the awesome OSC-based iPhone/iPod touch controller, TouchOSC.

http://hexler.net/software/touchosc

The included layouts are already fantastic, with rotaries and virtual buttons and multi-faders and toggles and X/Y pads. But custom control would be even better. Creator hexler writes CDM with the latest:

The long-awaited update to TouchOSC that will allow for custom layouts has just been submitted for review to Apple,
so I hope that as soon as next week it will be available as a free update to all users on the App Store.

Together with this release (1.3) there will be a free editor application to visually design and upload layouts to the device. You can take a look at the last beta version I published if you want, there’s both Windows and OS X versions available, but I will also prepare a Linux version as soon as possible, of course without the new version of TouchOSC this is but a preview of things to come:

http://dev.hexler.net/touchosc/touchosc-editor-0.7-osx.zip
http://dev.hexler.net/touchosc/touchosc-editor-0.7-win32.zip
http://dev.hexler.net/touchosc/touchosc-default-layouts.zip

And nicely enough, the editor is built in cross-platform Java, which I think makes a whole lot of sense. (Go Java, Python, etc., rather than getting stuck in hard-to-port platform-specific stuff like Cocoa.)

Thanks, hexler! I don’t have a video of the new features yet, so instead here’s a nice novelty – the beginnings of a creation using the free SuperCollider (which runs OSC natively) in combination with TouchOSC to make a custom step sequencer. Should fuel other ideas, too:

If You’re in LA, Clear Your Weekend Schedule

There are always more events than we can post for a site with global readership. We’re working on an interactive CDM event calendar – suggestions welcome. But in the meantime, here are a couple of events that I hope some CDMers can attend and document for the site, because I wish I could be there.

Saturday night, there’s a huge convergence of wonderful people in Los Angeles. The lineup looks terrific (music: Speakers, Sahy-Uhns feat. Bucc Rogerz, Eli Walks, Owen Vallis, Counters, D-Funk), and there will be a new iteration of the Brick multi-touch table which we’ll be seeing here on CDM soon. Flyer below; watch MySpace for address details.

Sunday, there’s a free design workshop/demo by the creator of Where’s the Party At, the open source sampler, at Machine Project.

Rest up and enjoy.

read more

MonoTouchLive, the Lemur, Imitation, and Hopes for an Older, Wiser CDM

monotouchlive

Even online, words have a tendency to linger long after you write them. And I recognize that the risk here is not only what those words mean to me, but others, too. So I want to revisit a topic today in the interest of moving forward.

I wrote a kneejerk post earlier in the life of CDM about MonoTouchLive, a single-touch interface with UI widgets inspired by JazzMutant’s Lemur. MonoTouchLive was (and is) Windows-only, standalone software for controlling Ableton Live. It’s now free of cost.

I’ll be honest: in my original post, I overreacted, and I didn’t choose my words as carefully as I should have. Some regular readers called me out on it at the time. Since that time, I’ve tried to be more careful. Some comment threads referred back to it, though, and the developer, Pablo Martin, has continued to push his tool and has been outspoken about not liking what I wrote.

It’s now clear to me that I can’t just let this go, as Mr. Martin today has posted a multi-page diatribe focused largely on my short, now nearly three-year-old blog post.

A little of JUSTICE please

To be clear: I got carried away. I have since come to the realization that copying – loosely or closely – isn’t such a bad thing. They’re a learning process, and if something really is original, it does tend to shine through.

Also, to my knowledge, Mr. Martin is correct: the layout on the Lemur was apparently a mock-up to show what the Lemur would look like if configured with the layout of the MonoTouchLive. I incorrectly said that both the widgets and layout had been copied, as I misunderstood the image I saw. Axou created that design as part of a thread with some complaints about the similarity to the Lemur widgets, but I now try to make CDM less like a quick forum post.

read more