Paper, Drawing as Musical Controller: A Round-Up

touchanywhere

Imagine drawing an interface on paper, then being able to use it as a musical interface. Or, heck, don’t imagine it – do it. Unfortunately, the kinds of intelligence necessary to make the music video in yesterday’s post just aren’t practical yet. (That is, you could draw a picture of a keyboard, and even use the picture as a music controller, but while you or I could recognize a keyboard from a drum pad and know that line is a fader, a computer would need some sort of advance structure for any recognition to work.) But you can do some really clever things, as folks have shared in comments.

And using some basic paper interfaces, you can make entire instruments for just a few dollars.

Of course, the awesomest way to do anything is with LAZORS. Greg Kellum and Alain Crevoisier presented a paper at last year’s NIME (a conference for new interface designs for music) proposing a system for making any surface a control surface. Like the music video yesterday, you can configure your surface to function however you like – even dividing it up into pads and faders.

By now, you’e likely seen plenty of multi-touch interfaces or means of tracking hands. But, to paraphrase the NIME paper, these either require a special surface (or transparent surface), or they can’t actually detect when you’re touching. You can even use multiple cameras or an IR beam, but there are limitations to accuracy and the size of the usable surface that would result. Kellum and Crevoisier use an infrared camera and two illuminators, each built by pointing a laser at a mirrors.

Yawn, you say, been there, done that, seen Jeff Han’s video… The advantage of this system is that you can use any surface, like your dining room table. And you can configure that surface however you like. There’s even a freely-downloadable Surface Editor you can extend in Java and Processing. The creators claim they can even get input latency down to a reasonable 10 ms using high-speed cameras.

Transforming Ordinary Surfaces into Multi-touch Controllers [PDF paper, NIME 2008]
Future Instruments > Projects
Thanks, Randy Jones!

db3ll has created a keyboard out of paper, and of course it works better than those flimsy rubber “roll-up” pianos you see for sale. “Conductive ink is what I used,” he says, “painted on as traces on the non-printed side of the paper.” That’s the twist – I had assumed you’d use the top of the paper, but the trick is to use the reverse side to provide the “wiring.” He also offers advice for making a fader:

read more

Millioniser 2000: 80s-tastic MIDI Harmonica Whose Time Has Come?

“It comes from tomorrow …but it’s here today.”

Well, now it is tomorrow. And yesterday’s tomorrow still looks futuristic. Try this test: show someone the video above for the Millioniser 2000, a MIDI harmonica designed by Ronald Schlimmer. Tell them this is a 2009 video designed to go viral, a fakery of 80s cheese. After all, the instrument itself looks impossibly futuristic. Surely this wasn’t really designed in 1979. Surely the close up thigh shots of the backup singer girls in the back are tongue-in-cheek parody.

Your friends will believe you. Of course, you’ll be lying.

read more

Music Sequencing as Bicycle Wheels, Rubik’s Cubes at Fest in Argentina

Performance with Cubie from sadmb on Vimeo.

Music sequencing as a Rubik’s Cube-style game, or hypnotic, kinetic rotating wheels – your piano roll won’t know what hit it. New musical art is set to be performed in Argentina, but you can download both tools, free.

Computer interfaces for music date back decades now, but with ingrained notions of hardware sound sequencers, linear media like tape, and hundreds of years of notation in staves and bars, old habits can be hard to kick. Yet it seems that suddenly, a younger generation of audiovisual composers is exploding notions of how musical interface and sequence could work, fully embracing a virtual space in which they themselves have come of age.

Next month’s spectacular-looking 404 Festival could make anyone want to book a flight to Argentina. Two highlighted artists from this festival for me really embody the possibilities of new sequencing metaphors. Both are built in Java.

read more

d-touch, Free Tangible Interfaces, and a Walnut Drum Machine

Software doesn’t have to mean virtualizing everything and letting go of physical objects. On the contrary, it can create all sots of imaginative, new ways of mapping musical ideas to the physical world. And that’s how we wind up with a walnut drum sequencer.

There’s something about virtual drum machines and snacks. We’ve seen bubblegum and Skittles, beer bottle caps, soda bottles, and now walnuts. Don’t stop now: someone has to do Cheetos, even if it means dealing with orange stuff all over your fingers.

That said, it’s not walnuts that make d-touch an important project. Built by Enrico Costanza back in 2003, the project is now available for free download as an open source library, a server (in case you don’t want to get into the C++ code but might want to use this in your own projects), a free, usable drum machine, and a set of documentation that can help you make your own stuff easily. Enrico worked on the original reacTable prototype and has done some really important work in this field. Right now, Enrico and co are looking for feedback, but if you’re ready to just be a tester and play with this – and see what you can do musically – now’s your chance.

d-touch also combines high levels of computer readability for accurate tracking with the ability to make your own tags. Instead of using ugly-looking glyphs, you can make patterns that make sense to human beings as well as computers. Oh, yeah – and mobile fans, this runs at a full 14 fps even on S60 phones.

For more, check out the d-touch site:
http://d-touch.org/ [Register first to make the download available]
and follow them on Twitter:
http://twitter.com/audiodtouch

Thanks to Martin (of reacTable, which is moving toward a commercial product) for sending this our way. Thanks, too, to Ben, who’s working on tangible interfaces with special needs students. I really look forward to hearing how that’s going.

Tangible Interfaces: Beat Sequencing with Beer Bottle Caps

Digital technology has made music oddly invisible, virtualized somewhere inside a screen – but it also allows music to be mapped more literally to the physical world than ever before. Some of these experiments may even be silly, but they suggest a lot of possibilities.

From Poland, BeatMachine is a project that sequences beats in a step sequencer using discarded beer bottle caps. Would-be Internet haters, I suggest you count the number of beer bottle caps on the table, and start drinking that number while watching. I guarantee eventually it’ll seem like a brilliant idea.

Make sure you keep watching to the clever-looking software they’ve evidently developed for the task.

http://mw.boo.pl/beatmachine/

If this seems familiar, it was in fact inspired by the Bubblegum Sequencer featured here previously, and its rival I Eat Beats. Through the power of the Internet, iterating and improving ideas isn’t just something you do for yourself alone – it’s something you can share with others. That’s the idea behind our own tangible interface hackday coming up on Saturday:

http://hackday.noisepages.com

Thanks to Artur Nowak for the tip. I know we have a number of readers in Poland, so is there anyone who could help with a quick translation?

(Oh, and Poland, by the way – my book was actually translated into your language!)