Fritzcrate Project / lusidLearn Early Demo from Michael Schieben on Vimeo.

Knobs and faders can be rigid. Fancy multitouch devices can be expensive. But for the cost of a webcam and some spare materials, you can build computer interfaces with objects around the house, thanks to the power of open source software.

In just one day, a group of artists in the CDM community, from Austria and Germany to New York to Australia, got quite a lot working with tangible interfaces. At top, Michael Schieben and Christophe Stoll experimented with using soda bottles to control software like Future Audio Workshop’s lovely Circle. (Ableton Live works, too – as does any MIDI software.) As Precious Forever, these guys are responsible for some of the best UIs in music software, from FAW to recent Native Instruments designs, so it’s lovely to see them experimenting with this idea.

As you add more people to the mix, you get ideas you might otherwise never have imagined, from a game involving blocks of the Tokyo skyline to an interface built into floor toms.

We also got a lot of real-world data on what works, what needs work, and what causes trouble for beginners, which we’ll be documenting. (Adam and Martin from the Trackmate and reacTIVision projects, respectively, were both tuned in to see progress and provided lots of help – and are also collecting that data to improve their own documentation and libraries.) More commentary on all these side benefits, as well as a discussion with visitors from Argentina on the scene around the world, at Create Digital Motion.

Musical Resources

We also got some really helpful tips for working with the free, powerful, tri-platform synthesis tool SuperCollider:
Charles Martin wrote up an easy SC test script for receiving Trackmate messages (and also had the clever idea of using a floor tom)

And for connecting Trackmate to MIDI and working with Processing, lots of tips are available on Michael Schieben’s noisepages blog:
http://fritzcrate.noisepages.com/

Get Involved

More documentation:
Tangible Interface Hackday: The Projects (So Far)
http://hackday.noisepages.com/

http://trackmate.sourceforge.net/
http://reactivision.sourceforge.net/

So, what’s next? You can join discussion and brainstorming for how to proceed, and how to get in on another hackday (formal or ongoing), even if you missed the first. Stop by the Tangible and Multi-Touch Interface group on noisepages:
Tangible + Multi-Touch noisepages Group

Our noisepages community is still in “alpha” state, but it’s usable – we’ve just fixed avatar uploading, which was the biggest problem. We’ll have more features, functionality, and improvements down the line, as well as more extensive documentation for how to get started. But if you’re a bleeding edge sort of person, join up free and give us some advice on what you’d like out of it.

I look forward to more work on these projects. Stay tuned for more, including some additional documentation (I’m developing some stuff around my own project).

Free software, a webcam, and some stickers printed on an inkjet can turn any object into a real-world controller. That’s what Paul Rose of Institut Fatima and his team did with a soccer ball (translation for the civilized world: football). The software is powered by the same framework used for the reacTable, but in this case there’s no table and no projector: just a ball.

Institut FATIMA uses a Fussball as (des-)controller for triggering drumsamples. The camera detects the symbols on the ball, kicks numbers into the sequencer, the sequencer matches goals. The goal is always music. Software used is reactivision and ableton live. Do it at home.

As it happens, reacTIVision just got a significant update, with more improvements planned. You can read up on the full details on Create Digital Motion:

Free Tangible Tracking: reacTIVision 1.4 Here, TUIO2 Coming Soon

Martin Kaltenbrunner, co-creator of the framework (and the reacTable), has some tips for working with tangible interfaces and music, and where to find more inspiration.

In addition to TUIO, reacTIVision also has an alternative MIDI mode, where you can map the appearance of fiducial symbols to note ON and OFF events, as well as their X,Y and rotation angle to a control channel value. Quite a few people have been using this for the creation of cheap web-cam based MIDI controllers.

http://www.youtube.com/results?search_query=reactivision+midi

Using TUIO, you have more alternatives though, you can currently use Max/MSP, Pure Data, Quartz Composer, Processing, Java, C++, C# and so on to receive the object & finger tracking data. Here are a few cool musical projects, that have been built using reacTIVision:

http://modin.yuri.at/tangibles/?list=7

Patrick H. Lauke (patch pictured, from Flickr) has a video on YouTube that shows some of the basic workflow for combining the free patching environment Pd with TUIO and reacTIVision. He cautions:

this may not be pleasant from a musical point of view, but it only serves as a first test for further experimentation.

Hopefully this gives folks some ammunition if you’re getting involved in the tangible interface hackday! [Project site | on CDMu]

For an increasing number of artists, data is becoming the raw material for creative work. Most of this has focused on visual media, but in the digital space, you can just as easily use sound. Sometimes the results are aesthetic only; sometimes they tell you something about the numbers being sonified. But either way, sound is a powerful medium.

“Weather Report” is a multi-touch instrument that makes music out of surface temperature data. The results feel a bit like US weather agency NOAA gone IDM. Fire up the multi-touch table, and you can “read” temperature data as sound. Co-creator Jordan Hochenbaum writes us:

I just wanted to turn you guys onto a multi touch interface I have been developing with a friend of mine here at California Institute of the Arts (his name is Owen Vallis). We had out first installation a couple weeks ago at Sea and Space Explorations gallery in Los Angeles and will be bringing it to Yuris Night Bay Area in April. The table is called “Brick,” and our first piece of software for it is called “Weather Report.” Were trying to use the table as a playable and meaningful musical instrument, so Weather Report uses Brick to sonify real-time U.S. surface temperature information into ambient and melodic mini-compositions. You can check out the website (we just put it up so it will constantly be updated shortly) for more information and photos, or check out our first youtube video @ http://www.youtube.com/watch?v=45p_TPtQjR0

Are current plans for the table is making it more stable, and getting multi-touch finger tracking working nicely.

It was custom built and uses custom software written in Max/MSP/Jitter and Reaktor, as well as Reactivision (like the ReacTable).

Hope you like it so far! We are finding out new ways people like to interact with the table in order to refine how it is used, so the more people see and use it, the more usable and interesting we will be able to make it as a musical instrument.

brick: A Multi-Touch Sonification Instrument [Project blog]

CDM will be at Yuri’s Night, the global space party, in a very big way, so expect more!