Software doesn’t have to mean virtualizing everything and letting go of physical objects. On the contrary, it can create all sots of imaginative, new ways of mapping musical ideas to the physical world. And that’s how we wind up with a walnut drum sequencer.

There’s something about virtual drum machines and snacks. We’ve seen bubblegum and Skittles, beer bottle caps, soda bottles, and now walnuts. Don’t stop now: someone has to do Cheetos, even if it means dealing with orange stuff all over your fingers.

That said, it’s not walnuts that make d-touch an important project. Built by Enrico Costanza back in 2003, the project is now available for free download as an open source library, a server (in case you don’t want to get into the C++ code but might want to use this in your own projects), a free, usable drum machine, and a set of documentation that can help you make your own stuff easily. Enrico worked on the original reacTable prototype and has done some really important work in this field. Right now, Enrico and co are looking for feedback, but if you’re ready to just be a tester and play with this – and see what you can do musically – now’s your chance.

d-touch also combines high levels of computer readability for accurate tracking with the ability to make your own tags. Instead of using ugly-looking glyphs, you can make patterns that make sense to human beings as well as computers. Oh, yeah – and mobile fans, this runs at a full 14 fps even on S60 phones.

For more, check out the d-touch site:
http://d-touch.org/ [Register first to make the download available]
and follow them on Twitter:
http://twitter.com/audiodtouch

Thanks to Martin (of reacTable, which is moving toward a commercial product) for sending this our way. Thanks, too, to Ben, who’s working on tangible interfaces with special needs students. I really look forward to hearing how that’s going.

Barry Threw demos the K-Bow at Maker Faire from The Amazing Rolo on Vimeo.

Yann Seznec aka The Amazing Rolo brings CDM his coverage of
music tech at the Maker Faire in three episodes today.

As long as there have been computers, violinists have looked for ways of extending the nuances of their physical performance into the digital realm. (Us keyboardists have it easy – we’re used to pressing an array of levers, and a lot of the gestures we make are, arguably, superfluous.) Many of these concepts return to the idea of the bow.

The K-Bow by Keith McMillen Instruments is a Bluetooth-enabled bow with sensors that read bow angle, length, acceleration, grip pressure, and even hair tension. It’s accompanied by software developed in Max/MSP. The bow itself is one of those “if you have to ask, you can’t afford it situations,” at US$4000-5000 retail, though they claim the bow itself – specially-designed kevlar and carbon graphite, anyone? – can compete with more expensive bows even before you add in the sensors.

Fritzcrate Project / lusidLearn Early Demo from Michael Schieben on Vimeo.

Knobs and faders can be rigid. Fancy multitouch devices can be expensive. But for the cost of a webcam and some spare materials, you can build computer interfaces with objects around the house, thanks to the power of open source software.

In just one day, a group of artists in the CDM community, from Austria and Germany to New York to Australia, got quite a lot working with tangible interfaces. At top, Michael Schieben and Christophe Stoll experimented with using soda bottles to control software like Future Audio Workshop’s lovely Circle. (Ableton Live works, too – as does any MIDI software.) As Precious Forever, these guys are responsible for some of the best UIs in music software, from FAW to recent Native Instruments designs, so it’s lovely to see them experimenting with this idea.

As you add more people to the mix, you get ideas you might otherwise never have imagined, from a game involving blocks of the Tokyo skyline to an interface built into floor toms.

We also got a lot of real-world data on what works, what needs work, and what causes trouble for beginners, which we’ll be documenting. (Adam and Martin from the Trackmate and reacTIVision projects, respectively, were both tuned in to see progress and provided lots of help – and are also collecting that data to improve their own documentation and libraries.) More commentary on all these side benefits, as well as a discussion with visitors from Argentina on the scene around the world, at Create Digital Motion.

Musical Resources

We also got some really helpful tips for working with the free, powerful, tri-platform synthesis tool SuperCollider:
Charles Martin wrote up an easy SC test script for receiving Trackmate messages (and also had the clever idea of using a floor tom)

And for connecting Trackmate to MIDI and working with Processing, lots of tips are available on Michael Schieben’s noisepages blog:
http://fritzcrate.noisepages.com/

Get Involved

More documentation:
Tangible Interface Hackday: The Projects (So Far)
http://hackday.noisepages.com/

http://trackmate.sourceforge.net/
http://reactivision.sourceforge.net/

So, what’s next? You can join discussion and brainstorming for how to proceed, and how to get in on another hackday (formal or ongoing), even if you missed the first. Stop by the Tangible and Multi-Touch Interface group on noisepages:
Tangible + Multi-Touch noisepages Group

Our noisepages community is still in “alpha” state, but it’s usable – we’ve just fixed avatar uploading, which was the biggest problem. We’ll have more features, functionality, and improvements down the line, as well as more extensive documentation for how to get started. But if you’re a bleeding edge sort of person, join up free and give us some advice on what you’d like out of it.

I look forward to more work on these projects. Stay tuned for more, including some additional documentation (I’m developing some stuff around my own project).

Mixed Up – Beat Blender and Mixmaster 1200 from Matti Niinimäki on Vimeo.

Ableton Live enthusiasts, you take very seriously what gear you plug into your laptop sets. We’ve seen painstakingly-created DIY controllers like the arcade button hardware below, and bizarre oddities like calculators and arcade cabinets and blenders and Osterizers (above). So, in celebration of New York installment of the Dubspot Ableton Live 8 Tour, Saturday, June 27, we’re going to get together in a fantastic space and have a little Live party. And we want to see what controllers you’ve made.

If you’re coming to town for the Live Tour or are in the New York area, we’d love for you to show some of your creations. Built or customized your own controller? Got your Wii remotes and webcams running your Live set? Built your own special Reaktor / Pd / Max / Python creation to customize your Live performance? Invented some hardware that works with Live? We’d love to see it. It’s a week that includes some of the most skilled Live minds in the planet presenting, plus celebrity appearances by the likes of Richie Hawtin, Scientist, and others. So we expect that even though this is last-minute, this could be a fun chance to get together.

If you’re interested, just sign up below or head directly to the Google Docs form. This is an informal, relaxed venue with drinks and finger foods. (Check out the recent New York Magazine write-up.) The idea is to bring along some headphones or small speakers and show things off in the catacomb-like former stables (and former sex club) nooks of this fantastic bar, meet up, relax, and get to know each other. We’ll also feature a live performance or two; if interested, let us know what your stuff sounds like.

The event will be open to the public; stay tuned for more details on this and the event itself.

And if you want to learn how to use controllers intelligently with Ableton Live – from the cheap and accessible to the weird – I’ll be teaching a workshop at Dubspot on Sunday 6/28.

Sign up, creative folks:

Free software, a webcam, and some stickers printed on an inkjet can turn any object into a real-world controller. That’s what Paul Rose of Institut Fatima and his team did with a soccer ball (translation for the civilized world: football). The software is powered by the same framework used for the reacTable, but in this case there’s no table and no projector: just a ball.

Institut FATIMA uses a Fussball as (des-)controller for triggering drumsamples. The camera detects the symbols on the ball, kicks numbers into the sequencer, the sequencer matches goals. The goal is always music. Software used is reactivision and ableton live. Do it at home.

As it happens, reacTIVision just got a significant update, with more improvements planned. You can read up on the full details on Create Digital Motion:

Free Tangible Tracking: reacTIVision 1.4 Here, TUIO2 Coming Soon

Martin Kaltenbrunner, co-creator of the framework (and the reacTable), has some tips for working with tangible interfaces and music, and where to find more inspiration.

In addition to TUIO, reacTIVision also has an alternative MIDI mode, where you can map the appearance of fiducial symbols to note ON and OFF events, as well as their X,Y and rotation angle to a control channel value. Quite a few people have been using this for the creation of cheap web-cam based MIDI controllers.

http://www.youtube.com/results?search_query=reactivision+midi

Using TUIO, you have more alternatives though, you can currently use Max/MSP, Pure Data, Quartz Composer, Processing, Java, C++, C# and so on to receive the object & finger tracking data. Here are a few cool musical projects, that have been built using reacTIVision:

http://modin.yuri.at/tangibles/?list=7

Patrick H. Lauke (patch pictured, from Flickr) has a video on YouTube that shows some of the basic workflow for combining the free patching environment Pd with TUIO and reacTIVision. He cautions:

this may not be pleasant from a musical point of view, but it only serves as a first test for further experimentation.

Hopefully this gives folks some ammunition if you’re getting involved in the tangible interface hackday! [Project site | on CDMu]