Paper, Drawing as Musical Controller: A Round-Up

touchanywhere

Imagine drawing an interface on paper, then being able to use it as a musical interface. Or, heck, don’t imagine it – do it. Unfortunately, the kinds of intelligence necessary to make the music video in yesterday’s post just aren’t practical yet. (That is, you could draw a picture of a keyboard, and even use the picture as a music controller, but while you or I could recognize a keyboard from a drum pad and know that line is a fader, a computer would need some sort of advance structure for any recognition to work.) But you can do some really clever things, as folks have shared in comments.

And using some basic paper interfaces, you can make entire instruments for just a few dollars.

Of course, the awesomest way to do anything is with LAZORS. Greg Kellum and Alain Crevoisier presented a paper at last year’s NIME (a conference for new interface designs for music) proposing a system for making any surface a control surface. Like the music video yesterday, you can configure your surface to function however you like – even dividing it up into pads and faders.

By now, you’e likely seen plenty of multi-touch interfaces or means of tracking hands. But, to paraphrase the NIME paper, these either require a special surface (or transparent surface), or they can’t actually detect when you’re touching. You can even use multiple cameras or an IR beam, but there are limitations to accuracy and the size of the usable surface that would result. Kellum and Crevoisier use an infrared camera and two illuminators, each built by pointing a laser at a mirrors.

Yawn, you say, been there, done that, seen Jeff Han’s video… The advantage of this system is that you can use any surface, like your dining room table. And you can configure that surface however you like. There’s even a freely-downloadable Surface Editor you can extend in Java and Processing. The creators claim they can even get input latency down to a reasonable 10 ms using high-speed cameras.

Transforming Ordinary Surfaces into Multi-touch Controllers [PDF paper, NIME 2008]
Future Instruments > Projects
Thanks, Randy Jones!

db3ll has created a keyboard out of paper, and of course it works better than those flimsy rubber “roll-up” pianos you see for sale. “Conductive ink is what I used,” he says, “painted on as traces on the non-printed side of the paper.” That’s the twist – I had assumed you’d use the top of the paper, but the trick is to use the reverse side to provide the “wiring.” He also offers advice for making a fader:

read more

Imaginary Instruments: Marker and Paper as Controller

Note Pad from Charlie North on Vimeo.

This charming music video from Charlie North imagines creating your own simple music controllers with a piece of paper and a marker. (There’s some similarity to M-Audio pieces there, too.) Of course, that raises another question: could this actually be done?

Computer vision isn’t quite intelligent enough to work out automatically what’s going on here, but it seems to me that you could get a little closer. Another alternative would be using conductive ink or graphite to make the drawing itself a sensor. I’m going to leave you to puzzle out the rest.

It’s technically still a holiday weekend here in the U.S. of A., so I’m going to keep with the whimsical inspiration for the rest of the day.

Kids Making Music: Interactive Music Box Draws Experience from Games

Ten minutes. Four or five kids (or adults). Make a song. Go.

That’s the idea behind the Youth Music Box, developed by Silent Studios and Chris O’Shea. (Our friend Chris you may recall from various interactive projects and the blog pixelsumo; he sends this project our way.) The software is build in openFrameworks, the C++-based creative coding environment for artists.

With keys, drums, and yes, even a scratching DJ-style interface, the music box brings together kids for quick music making, inspired by the phenomenon of musical games. The experience is guided by genre, with some effort to make sure whatever they do sounds good, but it’s extraordinary how effective it is at conveying the experience of the successful jam. It’s a bit of a confidence builder, in other words, for a group musical experience, perhaps more so than those ear-splitting, cheap plastic recorder consorts I recall from my youth.

And oh yeah, those kids look super cute once they get rocking out. (See video below.)

Youth Music Box Experience from Silent Studios | Resonate on Vimeo.

All of this raises some fascinating questions, and not always with the answers you might expect. In a normal musical ensemble, you begin sounding like crap, amp up difficulty, and eventually sound something like this – at least as far as coherence goes, assuming you’re not aiming for experimental free jazz. But with the addition of technology, whether musical games or the presets on our favorite synths or the quantization and beat-synced loops of our sequencers, it goes something in reverse. You start out sounding like this, pull apart the mechanisms that make you sound a certain way, and eventually find your way to your own personal approach. (And at some point, you get some of the readers on this site, writing code to produce their own sounds and musical structures line by line.) In fact, one could imagine scaling difficulty of even this particular setup, gradually adding greater musical freedom and taking away the “training wheels” of all the rules-based restrictions that make the results sound a particular way.

read more

Tilt, Smack, Mash, Tweak: Ableton Live Jam with monome + nanoKONTROL

dromama from Altitude Sickness on Vimeo.

Turning one knob and bouncing up and down may work for some, but virtuoso electronic performers want more live control out of music. Why? Because we have more fun. Raymond Weitekamp is a monome power user based at Princeton who has organized like-minded monomists. As with Edison’s performance work yesterday, Raymond is working to develop real performance technique.

He’s already got the monome doing more that button mashing, thanks to clever mapping of tilt controls. (Check out the custom housing, too.) But to provide additional timbral controls, Raymond makes use of the Korg nanoKONTROL and the humble MIDI Remote Scripts I made and documented here on CDM. The nano provides some compact, accessible controls for adjusting the active rack. Details below.

If you want to learn from this setup, Raymond is sharing everything he’s doing, so you can take this in a direction that works in your performance rig. Here’s the full setup:

read more

Squeeze Tech: Concertinome Combines Monome, Concertina

Finally, we’ve got a digital instrument you can squeeze.

Arrays of buttons may be digital in character, but they’re not a recent invention. Combining the organic, physical gesture with precise control over pitch via some sort of actuator is part of the tradition of musical instrument design. So, strange as it may be, this hybrid monome-concertina is a perfectly natural combination.

Inventor and musician Esper Sommer Eide writes with more:

read more