Dig into humanity’s past, and alongside the earliest tools, you’ll find some of the earliest instruments. Designing objects for expression seems to be an essential part of civilization.

Martin Kaltenbrunner, a co-designer of the Reactable tangible music interface, is also a professor in Interface Culture at the Linz University of Arts in Austria. There, in the land of Mozart and Haydn, he works with students to explore what interface design is.

So, when I got to spend some time with Martin in New York in September, I was interested in more than just the flashy coolness of the Reactable, the futuristic table-with-blocks interface for music. We got a chance to talk about instrument design generally. The funny thing about the Reactable is that it is closer to the experience of working with a modular synthesizer and oscilloscope than anything else, with the sense of physical connections of sound to object you’d get from classic synths. It is something unique, truly, but that’s its pedigree.

Martin and I got to give a talk together at the Austrian Cultural Forum New York, a terrific hub in which Austrian artists frequently are paired with New York-based folks, all in a lean, tall modern landmark building in Midtown. We also performed together, which for me was a real pleasure; Martin claims not to be a musician as such, but was good fun as an improvisation partner.

The next day, we headed to Manhattan music education center Dubspot, where Martin’s creation quickly attracted crowds of interested students and educators. Dubspot filmed our encounter for the video at top. Amusingly, the prominent synth sounds you hear at the beginning are not the Reactable, but our own MeeBlip open source synth, which I brought along to illustrate conventional tangible instrument design with switches and knobs. (If you’ve been impatiently waiting for news on the MeeBlip, believe me, I’m even more impatient – more announcements on that this week and next, following a production quality issue with a contractor that required us to reboot the run of new instruments.)

Reactable Live @ Dubspot! Interactive Sound Design Workshop Video Recap [Dubspot Blog]

YouTube commenters, that subtle and thoughtful bunch, are complaining that the tangible Reactable will set you back thousands of Euros. But at ACF and Dubspot, I was also equipped with the far more economical and portable alternative: Reactable Mobile runs on both Android and iOS. (I was pleasantly surprised to discover the app runs perfectly on a Galaxy Tab 10.1 from Samsung; I’m still a long, long way from being able to recommend buying an Android tablet, but if you’ve got one, I can certainly recommend this app.) Now, don’t get me wrong: the experience was nowhere near as fun as using the table. On the other hand, you can’t fit the table into a seat-back pocket on easyJet, and the savings in cash is proportional to the sacrifice in experience. What impresses me is that the design of the physical Reactable “flattens” so nicely onto the screen; I think it’s a user experience triumph that you can make that translation. And I was able to load up a few loops of my own music and jam along with the MeeBlip and Martin on the (real) Reactable.

Looking beyond the Reactable, Martin addressed these larger issues of tangible interface design at TEDx Vienna – a fitting locale for talking the history and future of music. His whole presentation, and a sweeping concept map of what he discussed, is available.

Martin Kaltenbrunner: Tangible Music

If you just want to get your Reactable on and can’t afford the table, see Reactable Mobile below. (Seen here on an iPad 2, but I’ve run successfully on the original iPad and the Galaxy Tab – the experience is more or less identical, thanks to portable code.)

And if you can afford the table, you rockstar, uh, can we be your friend?

http://www.reactable.com/products/mobile/
[the awesome table version]
Martin Kaltenbrunner website [with plenty of academic links]

Streaming live from Dubspot in New York, Martin Kaltenbrunner and I are talking about interface design and music, in the context of his Reactable tangible interface. Join us, ask some questions, and stay tuned for more video after the session is done. For his part, Martin has the enviable title of “Professor for Interface Culture.” Tune in now and he’s making music with blocks. I’ll be talking to him, and talking about performing without a computer, with Reactable Mobile running on Android, MIDI out of an iPad, a MeeBlip, and a Korg KAOSS Quad, hopefully as part of our ongoing discussions about mobile and interface design.

Weekend fun, part 1: as Reactable makes the leap from custom, tangible interface to go-anywhere iPhone/iPad app, here’s a look at what the fingertip-controlled music creation experience is like. The first of a series of tutorials, the video above walks you through some basic music production. It should lay to rest any question about whether this kind of interface can work in musical performance or live arrangement. I still think some artists will want to bang on something rather than just gently finger-paint their way through music, but as arrangement tool, it’s intriguing – and this video makes clearer what the thing is about.

(Just a couple of quick posts by way of apology for breaking one of our two servers, causing an outage. My fault.)

ReacTable Mobile has arrived for iOS mobile devices – even handhelds – bringing the visual, modular sound-making environment to the masses. Apart from building your own interactive musical table, the only way to get ReacTable’s software previously was to spend some EUR9700 – and get on a waiting list. Now, any Apple mobile device will do the trick.

The ReacTable certainly is intuitive and fun, and I imagine this could appeal to people new to music performance, as well as satisfying some long-time ReacTable fans. There’s also sample import, so you can really use this in your own performances and make it your own. Features:

One app for iPhone, iPad, and iPod touch
Accelerometer and mic input
Import your own samples and loops
20 virtual objects
Session sharing with others

Full details:
http://www.reactable.com/products/mobile/

I’ve been talking with the ReacTable crew, so hope to cover this in more detail soon. In the meantime, I’m back to playing a mobile game called “shake your jetlag,” and thanks to everyone who sent this in!

Addendum: At least one person on Twitter (Elliott Fienberg) points out the one disadvantage of this is that the original ReacTable is a tangible interface – physical objects you can move with your hands. And that’s worth saying; there’s something rather significant missing in the iOS translation. The iPad et al are undifferentiated glass surfaces, intuitive to use but lacking in physical feedback. I can certainly see a place for both approaches. It’s also possible look at the same question from a different angle. Multitouch, once an exotic technology, is now a commodity, shippings on millions (perhaps, soon, billions) of devices. I wonder what form the tangible future imagined by ReacTable might someday take, and indeed, if it might re-emerge in more economical form.

In the meantime, as you’ll read in comments, ReacTable works surprisingly well as a multi-touch interface, even if it was originally conceived for objects. You’ll likely be happier with the iPad’s larger surface area, and you’ll want a current-generation device for its greater processing power, based on feedback in comments. I hope to offer more a complete review after some tests on devices.

Fritzcrate Project / lusidLearn Early Demo from Michael Schieben on Vimeo.

Knobs and faders can be rigid. Fancy multitouch devices can be expensive. But for the cost of a webcam and some spare materials, you can build computer interfaces with objects around the house, thanks to the power of open source software.

In just one day, a group of artists in the CDM community, from Austria and Germany to New York to Australia, got quite a lot working with tangible interfaces. At top, Michael Schieben and Christophe Stoll experimented with using soda bottles to control software like Future Audio Workshop’s lovely Circle. (Ableton Live works, too – as does any MIDI software.) As Precious Forever, these guys are responsible for some of the best UIs in music software, from FAW to recent Native Instruments designs, so it’s lovely to see them experimenting with this idea.

As you add more people to the mix, you get ideas you might otherwise never have imagined, from a game involving blocks of the Tokyo skyline to an interface built into floor toms.

We also got a lot of real-world data on what works, what needs work, and what causes trouble for beginners, which we’ll be documenting. (Adam and Martin from the Trackmate and reacTIVision projects, respectively, were both tuned in to see progress and provided lots of help – and are also collecting that data to improve their own documentation and libraries.) More commentary on all these side benefits, as well as a discussion with visitors from Argentina on the scene around the world, at Create Digital Motion.

Musical Resources

We also got some really helpful tips for working with the free, powerful, tri-platform synthesis tool SuperCollider:
Charles Martin wrote up an easy SC test script for receiving Trackmate messages (and also had the clever idea of using a floor tom)

And for connecting Trackmate to MIDI and working with Processing, lots of tips are available on Michael Schieben’s noisepages blog:
http://fritzcrate.noisepages.com/

Get Involved

More documentation:
Tangible Interface Hackday: The Projects (So Far)
http://hackday.noisepages.com/

http://trackmate.sourceforge.net/
http://reactivision.sourceforge.net/

So, what’s next? You can join discussion and brainstorming for how to proceed, and how to get in on another hackday (formal or ongoing), even if you missed the first. Stop by the Tangible and Multi-Touch Interface group on noisepages:
Tangible + Multi-Touch noisepages Group

Our noisepages community is still in “alpha” state, but it’s usable – we’ve just fixed avatar uploading, which was the biggest problem. We’ll have more features, functionality, and improvements down the line, as well as more extensive documentation for how to get started. But if you’re a bleeding edge sort of person, join up free and give us some advice on what you’d like out of it.

I look forward to more work on these projects. Stay tuned for more, including some additional documentation (I’m developing some stuff around my own project).

Free software, a webcam, and some stickers printed on an inkjet can turn any object into a real-world controller. That’s what Paul Rose of Institut Fatima and his team did with a soccer ball (translation for the civilized world: football). The software is powered by the same framework used for the reacTable, but in this case there’s no table and no projector: just a ball.

Institut FATIMA uses a Fussball as (des-)controller for triggering drumsamples. The camera detects the symbols on the ball, kicks numbers into the sequencer, the sequencer matches goals. The goal is always music. Software used is reactivision and ableton live. Do it at home.

As it happens, reacTIVision just got a significant update, with more improvements planned. You can read up on the full details on Create Digital Motion:

Free Tangible Tracking: reacTIVision 1.4 Here, TUIO2 Coming Soon

Martin Kaltenbrunner, co-creator of the framework (and the reacTable), has some tips for working with tangible interfaces and music, and where to find more inspiration.

In addition to TUIO, reacTIVision also has an alternative MIDI mode, where you can map the appearance of fiducial symbols to note ON and OFF events, as well as their X,Y and rotation angle to a control channel value. Quite a few people have been using this for the creation of cheap web-cam based MIDI controllers.

http://www.youtube.com/results?search_query=reactivision+midi

Using TUIO, you have more alternatives though, you can currently use Max/MSP, Pure Data, Quartz Composer, Processing, Java, C++, C# and so on to receive the object & finger tracking data. Here are a few cool musical projects, that have been built using reacTIVision:

http://modin.yuri.at/tangibles/?list=7

Patrick H. Lauke (patch pictured, from Flickr) has a video on YouTube that shows some of the basic workflow for combining the free patching environment Pd with TUIO and reacTIVision. He cautions:

this may not be pleasant from a musical point of view, but it only serves as a first test for further experimentation.

Hopefully this gives folks some ammunition if you’re getting involved in the tangible interface hackday! [Project site | on CDMu]

The idea of the Reactable is to make music tangible, with control of sound mapped to physical objects you move around on a table. But that hasn’t stopped the Psychosynth from creating a virtual version. (Upside: it’s a lot more portable.)

Psychosynth

Watch the video, but they seem to have made the opening minutes as dull as possible to thin out the non-believers. Skip past the generation of the white noise oscillator (wow, white noise!), and somewhere around halfway through, it becomes laugh-out-loud funny, with trance-style vocals about freeing your mind with free software. (Seriously – it’s awesome.)

While it’s in alpha stage, the software is fully free and open source (binaries available for Debian and OpenSUSE) – and that means this could be a good project to snoop around in or code through, those of you who are eager hackers.

At its heart, it’s simply an interactive modular synth inspired by Reactable. Drag objects around and connect them to make sounds and patterns. Underneath is a powerful C++ synth library, a 3D synth, and even a server version – so even if you aren’t sold on this interface, there are pieces here that could be useful. It’s all virtual now, but that’s not to say you couldn’t add input; support for the input library is planned later.

That said, I don’t think they went far enough with the virtual thing. Next, why not simulate virtual players for the virtual Reactable inside the computer. They could even behave like Sims, requiring regular stimulation and bathroom breaks. Eventually, you could unlock Bjork.

Enjoy. If anyone gets this up and running even in alpha state, let us know.

Previously: tables and tangible, like the lovely acoustic sounds of Etiquette and, of course, Spaces / Roots

Take the modular, patchable sound-making capabilities of Reaktor and (at the other end of the scale) Reason, and combine it with a graphical, zoomable, nodal interface with patch cords showing actual signal, as on the reacTable interactive table interface, and you should get something like Mod271. (Pronounced “mode.”)

The software is in pre-pre-alpha phase, but it’s freely downloadable for Windows users if you’re adventurous, and the developer promises more progress and other operating systems soon.

Features:

• ASIO/MIDI support, VSTi version coming
  
• Everything is full audio-rate, meaning you can mix and match MIDI and DSP
  
• Powerful nodes: “every node can be automated with unlimited control points and automation takes place right in the 3D environment.” … “nodes can influence any amount of other nodes or switched into a singular state.”, with radial and linear modes for the nodes
  
• Interface is 3D hardware-accelerated, and the signals even (optionally) draw at audio rate for realistic previews
  
• sample-accurate envelopes and motion, “meaning you can make an oscillator out of an envelope.”
  
• 25 node types and growing
  
• Make your own nodes with Python

Crazy stuff! It’ll be interesting to see how this one develops. And I hope the Reaktor developers are paying close attention; there’s a lot here that could inspire a future Reaktor version.

Full description, lots of background, and that bleeding-edge super-pre-alpha-at-your-own-risk:

Mod271 @NuDSP

Thanks to Ronnie of rekkerd.org for the tip!