Touchable tablets may be all the rage at the CES trade show, showcase to consumer-friendly gadgetry. But quietly, developer Sensomusic has accomplished multi-touch control of an open-ended music system on standard-issue PCs and accessories. They’ve pointed the way to just what this mechanism could be.

The latest video isn’t terribly easy to see, but it realizes something that has been the dream of fans of the music control protocol OSC (OpenSoundControl). “Learn” functionality lets you touch a control, then assign that control to something in your music software. But because these functions have relied on MIDI, they’ve generally been a bit arbitrary – touch one thing at a time, get a number for that thing, then assign that number to a controller. It works well enough, provided you step through each control. OSC promises to do more, though: an arbitrary touch controller on, say, your iPhone (or anything else) can have a plain-English name. And you can see multiple parameters appear on the screen at once, so that a sensor or multi-touch pad could have all its messages pop up at the same time.

Finally, Usine does OSC Learn correctly, with messages that pop up with names and get connected to whatever you like. I still think there’s more potential here to be plumbed, but it’s a great step.

If you don’t follow why that’s cool, check out another mapping notion from last year – here using a touch panel to make any graphic playable. And at the end of this story, check out the clever multitouch gesture recognition they’ve added.

Again, all of this you can do with standard-issue hardware – Apple iOS hardware, if you like, controlling a PC, or non-Apple hardware displays with touch or Android devices and the like. (Unlike the Emulator we saw earlier today or the original Lemur device, it’s a software solution that works with your hardware of choice.) More to watch:

More information (and more videos):
http://www.sensomusic.com/usine/

As a guitar, the Rock Band 3 Mustang is a bit unusual – there are strings, but an array of buttons replaces the frets, and it is intended as a game controller. But with all those buttons, strings, and sensors, it makes a remarkably flexible, surprisingly inexpensive controller. Our friend nay-seven puts it to good use with Sensomusic Usine. And talk about a budget-minded setup – one that could put platforms like the iPad to shame. Usine costs just EUR90 for a full license, with discounted educational pricing and a version you can try for free. The Mustang runs just over US$100, which could put it in the category of must-buy for anyone who loves experimenting with alternative controllers – guitarist or not. Add an inexpensive Windows laptop and audio interface, and you’ve got a pretty terrific setup.

Previously, with the help of Harmonix engineers, we documented how the MIDI spec works:
Exclusive Details: How the Rock Band 3 Fender Mustang Works as a MIDI Guitar

nay-seven writes:

I’ve discover this guitar with this article Peter, so thanks for this ! it’s a quiet cool guitar and cheap for the possibilities . I’ve made a little patch in Usine to add some features like open tuning, x/y visualization, and you can also use most of the buttons to run effects or samples.

Your mileage may vary, but it sure looks promising. Keep in mind, this is the cheaper Rock Band controller with buttons. As such, it’s a good choice for people wanting some cheap experimentation and people who aren’t guitarists. As for the real guitar controller for Rock Band 3, the Fender Squier Rock Band Controller, I have a writer working on documenting its more advanced MIDI features. It’s more complicated, and I can’t endorse it just yet – wait for the full review and details.

Touchscreens? Good, old-fashioned faders, knobs, and pads? Why not just use what suits the job – especially when you can choose both on the cheap?

Nay-Seven shares some of his latest work with Usine, the brilliant, modular and touch-centric tool for Windows. It’s a futuristic rig that’s also down-to-earth. Touchscreen monitors can be had for around US$300 street, and the Akai LPD8 and Korg nanoKONTROL controllers each figure under a hundred bucks. Usine, the software, is a bargain for its depth at EUR120, and free and educational versions are available.

Cost aside, though, this also puts sound making directly under your fingertips. Even aside from live performance, that means making sound kinetic — essential in the studio, too.

I asked Nay-Seven to comment on how he’d thought through this particular set of controllers – coming just as we cover the work done on grid-based sample control with mlrv2 and fader-based control in Max for Live:

Yeah, was funny to see your article at the same time I was working on this video..

My actual reflection is about the best place of a touchscreen in a set. And I join you in the idea that software has added a layer to the hardware.

Here, I use the LPD8 and the nanoKONTROL as an instrument, because we all prefer to use real pads and push-buttons to play, but it’s so fantastic to customize those tools to our own needs. And it’s more and more easy and quick. I’m using here the next version of Usine (it will be public soon), which adds polyphony in sub-patches. You create a sampler with the switch, add the buttons you need, change the polyphony of this patch to 5 and it’s done — you have a 5-voice polyphonic sampler !

I suppose the future will be a balance of all this, some customizable tools for users, more and more easy-to-use, real pads, keys, and faders so we can feel our musical expression, and a touchscreen to provide new tools like graphics and physical models.

Heaven, in fact.

More from the video description:

Here’s a work where I use the sequencer of Usine not to sequence audio or midi but patches: patches appear only when I need them, an easy way to have only the controls you need on the screen. I also associate here works with faders and pads via personal patches for [Akai's] LPD8 and [Korg's] nanoKONTROL and the use of a touchscreen . Made with Usine ( sensomusic.com ) thanks also to Michael Ourednik for his great vst Argotlunar

Note: Argotluner is free and open source (GPL) and has both a Windows and Linux (32-bit + 64-bit) build. Someone could build it for Mac, too.

nay-seven also uploads some patch images, so I’ve included those here. The granular patch, top, controls Argotluner. LPD8 and nanoKONTROL patches, bottom, connect to hardware (see callouts on the Korg image).

All images courtesy Nay-Seven – be sure to check out his excellent Flickr account.

Bonus: here’s a nice video demonstrating the touch side of things, posted in September.

The quickest route to expressing an idea remains the gesture of a hand. That gesture may be crudely interpreted through today’s touch displays, but the immediacy remains. Presumably because of some of the device’s limitations, a lot of the experiments with the iPad have involved controllers that operate independently from sound software, like a remote control. Those interfaces, while useful, largely simulate existing hardware controls in a more flexible form, rather than introduce new ideas. But it seems the long-term potential for touch devices is in designs that unite touch, graphic, and sound in a single piece of software, exploring new paradigms for interaction along the way.

Usine is one of music creation’s most surprising secrets: it’s powerful sound software that incorporates creative touch interfaces as a core design principle. And in the video above, it’s running on a relatively cheap PC two-touch display from Packard Bell. Nay-Seven is one of the founders of the Usine community, all while lecturing internationally, and has been pushing the Usine software to its limits.

Here, he tells us about some of his latest experiments, and the potential they hold.

Always looking for a way to use the computer as a real musical instrument, my latest works try to combine graphics and music using a touchscreen interface. The software Usine from sensomusic gives me the freedom to build my own interfaces. Some examples:

Drawing pitch and pan

Here [at top], the purpose is to draw directly some pitch information on the waveform display of a sample. I’ve also added an LFO [low frequency oscillator for modulation]; this way, the drawing can move slowly according to different speed presets.

[At bottom], I play with pan and volume: the x position of the black ball on the lines gives pan information and y the volume. As I’m on working with a dualtouch screen, I can quickly draw some speed changes. Note that this panel is not only for pan and volume; I can also send this drawing to others parameters like delay and filters, here with the << button.

Geometry …or not

This workspace is also dedicated to drawing. I’ve built four layers, each one with its own color and its own sound. The XY position gives the pitch value of the notes and other parameters, like velocity or pan. The geometry provides sequences; lines give a kind of glissando.

Vertical sequencers and Pads

Using the new Matrix module (thanks to Martin Fleurent), I’ve built this vertical sequencer [seen at top]. I like the idea that notes fly under my hands this way. [At bottom], I‘ve built pads for tablet surfing on the “iPad” mode, adding also a drone option.

Multitouch gestures

On the same idea of movement, here are two screenshots of a video illustrating a new patch made by Olivier Sens (the Usine developer). This patch provides multitouch gesture recognition, opening new doors to ways in which we use our computers and touchscreen. We can easily imagine some new symbols or alphabets, and new forms of interactions in our musical practice. You draw a ‘V,’ you play with volume, you draw a ‘P,’ you play with pitch…

For more on the display, check out the Packard Bell Viseo 200T. It was previewed by Engadget last year and carried a street price – impressively – of only about US$300, all for a 20-inch screen and low latency. I’m gathering either something happened or it was re-branded for distribution outside the UK; anyone with more information, let us know in comments and I’ll update the story.

More on nay-seven’s Flickr:
http://www.flickr.com/photos/usine/

All screen images courtesy nay-seven. Used by permission.

Usine is an overlooked gem in music making, a PC-based modular environment and live performance tool that runs as a host or VST plug-in. Pick the modules you need from a set of powerful building blocks, and build a custom musical rig, complete with multi-touch control on new Windows devices. It sounds like something you might request from a magical genie, but the thing is real, priced at EUR120 (or just EUR60 for educational users).

As with any modular environment, having ample access to powerful modules and some patches to get you started is everything. But that makes this week’s news worth noting: co-developer Olivier Sens has made some 200+ add-ons and patches free. All you have to do to grab them is register on the forum. The demo version of Usine is surprisingly capable, too, so if you’ve been waiting to test-drive and you have a Windows machine (or a dual-boot Mac), now could be a good time.

What’s included? Our friend runagate goes into details about the new patches and add-ons, as well as reviewing why Usine is worth some love and affection. And oh, yeah, a free update also promises a big boost in speed:
Usine 5.17 update available (it’s 20%% faster!?) and ALL 200 “add-ons” have been set free! [Digital Shiv @ noisepages]
(That blog is well worth adding to your RSS, by the way.)

Think touchable, monome-inspired multi-sequencers, multi-effects from dub to glitch, MIDI utilities, groove makers, synthesis, and … well, just a lot of stuff:
http://www.sensomusic.com/addons/

To whet your appetite even more, check out the Flickr goodness (photos and videos) uploaded by nay-seven, embedded at top, or at:
http://www.flickr.com/photos/usine/

Usine users, we count on you — got some tips on starting with the tool? Add-ons from the list people shouldn’t miss? Shout out in comments.

And meanwhile, I’ll just keep dreaming of a multi-touch tablet worth getting; my bet remains on the HP TouchSmart TM2 revision expected any day now, though if something better came along, well, even better. Side note: if this is the first wish for a magic music tech genie, can my second be that Delphi-developed stuff would get a framework on other OSes (Linux/Mac) to make these tools easier to port?

There’s plenty of rightful skepticism about the use of mainstream displays for multitouch in general purpose computing. And why not? As a full-time replacement for other input, multitouch probably doesn’t make sense. But for music, the equation is changing. Multitouch capabilities are showing up on commodity-priced PC computers like the multi-touch enabled HP laptop models – the tx2z seen here starts, incredibly, at US$850. And because computer musicians are looking for more control, having a touch-enabled display (even single-touch) just makes sense.

The screen for a laptop musician is a huge piece of real estate. Finally, instead of sitting dumbly in front of you glowing, it can become an X/Y controller or give you shortcuts for controls or provide additional parameters. Yes, using a touchscreen exclusively can result in the dreaded “gorilla arm.” The ergonomics of using a vertically-oriented screen are extremely poor – if you use it exclusively for an extended period of time. But if you look at the way people are using these touchscreens, for incidental control in combination with other things – and the ability of convertible laptops to transform into a horizontal orientation – I think this is no longer the deal killer it once was.

At top, an HP laptop ($850) plus the free version of Sensomusic’s Usine is all you need to create a multitouch interface for Ableton Live. Correction: right now this is limited to single touch only, but multitouch is supported in the hardware, in drivers, soon in Windows 7, and support is promised for a future version of Usine. The point still stands — as does the ability to optimize controls for your fingers. Being able to use more than one at once will, of course, be that much better.

Fractal (see Myspace) uses the combination to play Ableton Live with some simple controls. If you get hooked on Usine, you can get the full “Pro” version for EUR70 with additional patches and objects.

The one major remaining obstacle to multitouch, at least, is cost. If you don’t especially fancy buying a new HP laptop, add-on kits still run in the range of US$800-900 (meaning, ironically, you might as well just buy the HP instead). Laptop vendors are still slow to adopt the technology, though that could change when Windows 7 ships later this year. (On the other hand, tablet PCs, even when they were shipping in relative quantity, often were constrained in available configurations and either skimped on specs or demanded a significant premium.)

But let’s not complain too much. The simple reality is you can add an HP laptop now to a live rig as a performance instrument for under a grand.

To see something else with Ableton Live, here’s a video by Andrew Coenen from earlier this year of Pance Party’s Bartelby playing Live with the open source Max Multitouch Framework. This is a more sophisticated setup – it requires a table-style setup using the Frustrated Total Internal Reflection tracking method. But the idea is basically the same. (By the way, Max 5 is an optimal choice because of its excellent widgets, and it’s great having this choice, but it’s a little odd having an “open source” framework in proprietary software. If you want a fully open source solution, there are options like PyMT, which we recently saw on Create Digital Motion. And that said, there’s no reason you can’t try out both.)

And yes, someone has done Reason, too (poor-quality video, but gives you an idea).

Updated: As I’m posting this, I see that Oliver Chesler is writing about how effective touch interfaces can be for synthesizers – just using iPhone as the example (but the idea still holds). And, in fact, you don’t necessarily even need multitouch to make this work; single touch would be effective.

The example: an upcoming iPhone/iPod touch synth from the folks who gave us the Curtis granular synth, The Strange Agency.

Sound Scope Space for the iPhone [Wire to the Ear]

Sound Scope Space demo from strange agency on Vimeo.

Of course, I have to point out at this point, this is another reason that OSC (OpenSoundControl) support becomes essential. Whether or not conventional gear vendors adopt OSC, it’s a logical way to deal with the growing number of touch-enabled devices, from your own display to your iPhone.

I expect this could all accelerate as we near Windows 7′s release. (You don’t need Windows 7 – HP is doing just fine without it – but the presence of in-box APIs for paging through photo galleries and the like is almost certain to encourage Microsoft’s hardware partners.) Stay tuned.

More Examples

$200 Makes Your Laptop Touch-Enabled; Usine Music Demo

Sensomusic Usine + Ableton Live = Modular Touchscreen Interface

No doubt about it: touch is coming to more screens near you. But there’s no need to disappoint your current beloved laptop. $200 kits can turn your laptop into a functioning touchscreen.

Now, as I’m working with JazzMutant’s Lemur this week, before you get excited, this is no Lemur – or even anything like your iPhone or iPod touch. Sensitivity and accuracy are workable, but not exceptional, the overlay is pretty simple (as you can see in the video) rather than integrated with the display, and this is single-touch only — not multi-touch. Lastly, on a conventional laptop that isn’t convertible, you may miss the ability to fully extend your laptop perpindicular to your body. (Having the screen be parallel can put your arms in a fatiguing position.)

But that said, there’s a lot of potential once you have the ability to reach over and make quick gestures on a laptop screen that control a set. You might make your own instruments and effects or controller dashboards in a tool like Processing or Reaktor. And at $200, this could be a brilliant way to retrofit a machine and breathe new life into it. There’s support for Mac, Windows, and Linux; you just plug in via USB.

In this case, Sensomusic Usine is perfectly suited to the job, with an interface built just for this purpose. Their Touch Screen Edition earns major kudos for being a full desktop computer music environment built around touch, as covered here previously.

Of course, all of this potential is likely to make you want more sophisticated, multi-touch solutions even more. The outlook is improving. Windows 7 will bring native support for multi-touch gestures – not so much important news in itself so much as a sign that more hardware vendors could add support, ramp up volume and lower prices. HP is already shipping computers (including laptops) with multi-touch.

Also interestingly, the creators of the JazzMutant Lemur multi-touch hardware – specifically designed for music and visuals – have now expanded their mission to targeting general-purpose devices. The new company, Stantum, is showing off fantastic, unique technologies for multi-touch, as seen recently in an Engadget preview. Beautifully designed as the iPhone is, these offer some unique features like intensive accuracy and support for input from objects (like styluses) and not just fingertips. That could mean the Lemur is just the tip of a much bigger iceberg.

Here’s a tantalizing look at the Santum SMK screen working with Max/MSP. Unlike the Lemur, that means direct controlling Max’s widgets, rather than treating the screen like an independent controller.

Of course, that doesn’t mean the simpler, single-touch, cheap solution couldn’t be a great project right now, and a chance to get a leg up on The Future. If anyone tries one, let us know what it’s like.

Touch interfaces abound on this site, but Usine has one edge: it’s built right out of the box to enable touch interfaces with custom, modular creation of whatever you might like. And there’s now an Ableton Live template in testing, with a lovely 5×5 controller.

The advantage of working this way, as I see it, is that you can begin to expand Live sessions beyond endlessly-looping, pre-built audio clips or DJ-style mixing.

Discussion on the Sensomusic forum:

5 x 5 Live Control Patch

More on Usine:

Modular Sound by Touch: Usine

And for two significant new multitouch tools, from last week:

Roll Your Own Multitouch Screens, Tables: Max Multitouch Framework, PyMT

Touchable, open-ended, modular sounds and music – it’s an appealing idea. I’d be remiss in talking this week about touch apps if I didn’t mention the free/cheap Windows tool Usine, which has recently made the jump to a touchscreen-optimized version. (Big thanks to alby75 in comments on our Kore minisite for the nod.)

Usine is a modular, patchable music and sound app that runs as a portable, USB-key-ready standalone app and VST plug-in. A free version is limited in I/O and track-count, with a pro version EUR50. The 4.0 “stable beta” offers touchscreen features, with management for interfaces, custom layouts, and other features that make it work well with touchscreens. This is generally single-touch at this point, but as hardware evolves, I imagine the software will, as well.

Other highlights of Usine:

• Sound analysis for reacting to pitch, peaks, and dynamics in your patches
• Scripting support
• Custom modules via C++ and an open API
• OpenSoundControl support
• Virtual mixing table, modular mixing mode, unlimited internal audio
• SMPTE, MIDI, MTC, MMC sync and control
• Patch organization by track and on a timeline, so you can sequence your sounds and presets
• VST hosting, VST parameter modification, MIDI automation
• Built-in patches: Auto Pan, Bass Liner, Bit Crusher, Break Beat Maker, Compressor, Expander, Filter Bank, Synchronized Filter, Forward & Reverse, Freezor, Kaos Player, Limiter, Master meter, Metronome, Phaser, Random Delay, Resonnator, Step filter, Stereo enhancer, Midi Clock synchro.
• Direct-to-disk recording

And that really just scratches the surface. Having recording and audio analysis built in, plus extensive options for easy selection of presets and sequencing presets and sound modulation is really nice, I have to admit. (Developers of other modular environments, you listening?)

I’m embarrassed not to have spent any time with Usine; hope to correct that soon. (I know what you’re saying, because it’s what I’m saying … too … many … tools …)

More on Usine at Sensomusic’s site:

Usine Product Page