Bored with mouse pushing and knob twiddling? The d-touch tangible sequencer / drum machine makes a cheap interface (with free downloadable software) for assembling sequences. Make some (attractive) blocks, set up a webcam, and plug into your computer. I took a first look at this tool last month, and noted its use in sequencing walnuts. (Yes, the ones that fall from trees.) Since then, the developers have been hard at work on updates. Enrico writes:

We just released the d-touch sequencer, a new, more advanced, audio application. In the sequencer you can record your own samples in real time.

We also have few updates for the drum machine, which should solve the activation problems we were having at the beginning.

Go grab the markers and the software, and you have your own webcam-based drum machine.

Should you decide to go beyond their free instrument, the underlying system is really quite sophisticated. Part of what makes it beautiful is that you can design your own markers rather than settling for predefined patterns, as with most similar marker-tracking systems. There’s even a tool for correcting problems in your design. The freely-downloadable analysis software is written in C/C++, but if you use another environment (like Max or Processing or Reaktor), you can simply pipe data to your tool of choice.

The drum machine and sequencer are available now, so go download them and let you know how you fare! System requirements: a printer, a webcam, and a PC/Mac. Enjoy!

http://www.d-touch.org/

For some hands-on impressions of working with these things, the excellent PC Music Guru has a great description of the experience. Or, if you read the language, there’s a Japanese-language hands-on blog entry.

Gestural Music Sequencer from Unearthed Music on Vimeo.

Something as simple as remapping a single knob can give you new musical ideas. So expand that to entire gestures and live video input, and you can help push your performance in new directions and out of old habits. That’s why it’s always great to see projects like the Gestural Music Sequencer.

Built entirely in free tools – tools fairly friendly even to non-coders – the GMS lets composer and musician John Keston explore new ideas through gestures captured in a video stream. It’s easier to see than to talk about, so check out the just-completed documentary short by Josh Klos, with the aid of Julie Kistler and Brian Smith. (And yes, documentation makes a huge difference; we’d love to see more of this stuff!)

The ingredients:

• Processing, the free, multiplatform coding environment [site | cdmu tag | cdmo tag]
• controlP5, a lovely, light, quick-and-dirty library for UI controls
• Ableton Live – though you could substitute other software via MIDI, Live makes a nice, familiar interactive music engine

Lots more information on John Keston’s wonderful Audio Cookbook blog, which is fast becoming one of my favorite reads:

http://audiocookbook.org/category/gms/

And here’s a really lovely video that demonstrates what you can do with video. It uses a string of lights in a jar as the source. Yes, in a way, it’s almost like having a very focused random generator, but I think there’s nothing wrong with that. There’s an almost analog approach to seeing the source, and using that to organically create music.

GMS: Chromatic Currents Part II from Unearthed Music on Vimeo.

I have to observe, while this works reasonably well with MIDI, it reveals why standardizing on networked communication, as OSC does, makes more sense. In a world of software, “controller” can really mean anything you like. Control is increasingly about software talking to software – including when devices are involved, since they generally have a software layer of their own. Also, because sometimes it’s easier to code this with Processing than with Max, I can see some powerful uses of the Python-based Live API, which we expect to mature later this year. (Yes, the project called Live API seems to be in a holding pattern, but we may be able to work up a more complete, Live 8-ready alternative.)

By the way, our goal is to make noisepages a platform and collection of tools for people doing this sort of work (or anything creative with music and motion), even if you host your blog elsewhere. Stay tuned for the details on that.

The translation of music from something largely invisible to a physical object is oddly beautiful, even when imperfect. That’s part of why we’re working on the Tangible Interface Hackday – less than 48 hours away now.

Here are a couple of additional sources of inspiration as we prepare.

At bottom, Guy John has made a sequencer out of one of the world’s most ancient games, Go. Over two millenia ago, Chinese people were passing the hours playing this game, so it’s an incredible way of connecting our passtimes today with the leisure time of our ancient ancestors – and a sign that gaming is a part of culture that endures. It’s fitting, too, as a lot of computer musical interfaces can be thought of as games. This particular game uses Max/MSP/Jitter and the CV Jitter externals for image analysis, then translates the game into a grid. Guy’s idea is fairly early in development, so I actually think you could go all sorts of different directions with this basic concept. (As seen in Hack a Day at the end of last year.)

At top, the Graphite Sequencer translates optical images made in the electricity-conducting material to sound in a simple turntable. It’s lovely seeing these patterns as sound objects, especially since usually we go the other way (trying to find patterns to affix to sounds). The same basic graphite-conducting process is used in the business card PAiA kit we showed at a past Handmade Music, as well as the Drawdio pencil (based on the same circuit).

Graphite Sequencer (2006), as seen recently via the blog of the fabulous-looking Montreal Elektra Festival

I’d love to see people continue to combine these fairly basic analog-style techniques – or thousands-year-old games – with the newer digital approach. Let us know what you come up with, creative folk.

Digital technology has made music oddly invisible, virtualized somewhere inside a screen – but it also allows music to be mapped more literally to the physical world than ever before. Some of these experiments may even be silly, but they suggest a lot of possibilities.

From Poland, BeatMachine is a project that sequences beats in a step sequencer using discarded beer bottle caps. Would-be Internet haters, I suggest you count the number of beer bottle caps on the table, and start drinking that number while watching. I guarantee eventually it’ll seem like a brilliant idea.

Make sure you keep watching to the clever-looking software they’ve evidently developed for the task.

http://mw.boo.pl/beatmachine/

If this seems familiar, it was in fact inspired by the Bubblegum Sequencer featured here previously, and its rival I Eat Beats. Through the power of the Internet, iterating and improving ideas isn’t just something you do for yourself alone – it’s something you can share with others. That’s the idea behind our own tangible interface hackday coming up on Saturday:

http://hackday.noisepages.com

Thanks to Artur Nowak for the tip. I know we have a number of readers in Poland, so is there anyone who could help with a quick translation?

(Oh, and Poland, by the way – my book was actually translated into your language!)

Free software, a webcam, and some stickers printed on an inkjet can turn any object into a real-world controller. That’s what Paul Rose of Institut Fatima and his team did with a soccer ball (translation for the civilized world: football). The software is powered by the same framework used for the reacTable, but in this case there’s no table and no projector: just a ball.

Institut FATIMA uses a Fussball as (des-)controller for triggering drumsamples. The camera detects the symbols on the ball, kicks numbers into the sequencer, the sequencer matches goals. The goal is always music. Software used is reactivision and ableton live. Do it at home.

As it happens, reacTIVision just got a significant update, with more improvements planned. You can read up on the full details on Create Digital Motion:

Free Tangible Tracking: reacTIVision 1.4 Here, TUIO2 Coming Soon

Martin Kaltenbrunner, co-creator of the framework (and the reacTable), has some tips for working with tangible interfaces and music, and where to find more inspiration.

In addition to TUIO, reacTIVision also has an alternative MIDI mode, where you can map the appearance of fiducial symbols to note ON and OFF events, as well as their X,Y and rotation angle to a control channel value. Quite a few people have been using this for the creation of cheap web-cam based MIDI controllers.

http://www.youtube.com/results?search_query=reactivision+midi

Using TUIO, you have more alternatives though, you can currently use Max/MSP, Pure Data, Quartz Composer, Processing, Java, C++, C# and so on to receive the object & finger tracking data. Here are a few cool musical projects, that have been built using reacTIVision:

http://modin.yuri.at/tangibles/?list=7

Patrick H. Lauke (patch pictured, from Flickr) has a video on YouTube that shows some of the basic workflow for combining the free patching environment Pd with TUIO and reacTIVision. He cautions:

this may not be pleasant from a musical point of view, but it only serves as a first test for further experimentation.

Hopefully this gives folks some ammunition if you’re getting involved in the tangible interface hackday! [Project site | on CDMu]

“Augmented Reality” is a fancy term for describing ways of using computer vision to overlay digital intelligence on images. In other words, you can, for instance, scratch a vinyl record using a camera – plus a tag for identifying the object’s position in 3D space.

Cambridge-based designer Todd Vanderlin put together an elegant demonstration of the possibilities here, and his video has accordingly been making the rounds. (See: Synthtopia – and I actually heard about it this morning from a high school friend. The power of the Internet.)

Todd has more details on his site, which includes all kind of wonderful projects, like laser sound fountains and, always favorite around here, creepy circuit-bent baby dolls.

AR Scratching [Todd Vanderlin]

There’s actually some work to this: you need to figure out how the album is spinning. And of course, because this is augmented reality and not reality, there’s real potential here to imagine a new kind of vinyl DJing in which normal physics don’t apply.

From the video description:

I was playing around with some AR markers the other day and came up with this idea. taking just a plain old vinyl record and attaching an AR marker to the label you can track the record in 3D space. The next question was, can you scratch the record?

So by figuring out the velocity of the records rotation and applying it to the payback of the audio you can scratch. There is some digital noise that needs to bee worked out, but sounds pretty good. Its still really hard to scratch, it takes some practice but is super fun. The next step is to figure out some nice triggers for different modes. I like the idea of not needing a turntable but the actual spinning of the record helps with the scratching and playback. I made a couple modes, one where the record is paused and you can just scratch through the song. The other looks for zero velocity for x time and then continues on with the song. If there is velocity you then are scratching and the audio is affected. I think that this project has some legs can’t wait to play more.

I Want My Augmented Reality TV

So, this has sufficiently inspired you and you want more augmented reality? We’ve got more for you.

Digital artist and magician Marco Tempest has just demonstrated what happens when you do card tricks with augmented reality – and he shares some details of his rig:

Virtual Magic: Augmented Reality Card Tricks with Marco, OpenFrameWorks [Create Digital Motion]

We’ve even seen augmented reality climbing walls.

If you’re ready to do this yourself, we have a number of resources:

CDMotion has Andy Best’s tutorial on OpenCV with Processing (not an AR-specific library, but relevant): Getting Started, Popping Bubbles

We’ve also got an in-progress library for use with mapping projections in space for “spatial augmented reality”

A New Year’s video with a library for Flash, Java

A tutorial on getting started with augmented reality using Flash

openFrameworks, a library for C++ coding (which in turn supports multitouch, augmented reality – you’ll see some projects on that page)

Bryan Chung is working on a library for Processing

As an addendum to the last story, Ivica Ico Bukvic sends along an example of the [myu] Max/MSP + Unity game engine combination in action. Here’s the surprise: Unity isn’t generating visuals. Instead, Unity simulates ripples created by movement in the space, and builds physical models that are sonified and spatialized by Max/MSP.

Speaking of work involving art museums and the combination of Max and Unity, VJ Anomolee notes in comments his own work with the pairing. Lightbent Synth is an in-progress piece with alternative controllers and sensors that produces sound with a novel visual representation (sound’s very quiet in this preview — more hopefully once it progresses):

Lightbent Synth from VJ Anomolee on Vimeo.

Ivica explains the top work:

This past fall [myu] had seen its first real-world implementation in an exhibit that was a part of the grand opening of the Taubman Museum of Art in Roanoke, VA (http://www.taubmanmuseum.org/). The exhibit utilized [myu] as part of an interactive aural installation titled "elemental." An online tech
demo video of the installation, including written synopsis is available also via Youtube at http://www.youtube.com/watch?v=PA-9BOgc1gk. Below is a brief synopsis of the installation:

"elemental" interactive communal soundscape premiered in November 2008 as part of the Revo:oveR collection commissioned for the grand opening of the Taubman Museum of Art in Roanoke, VA. The Youtube video focuses primarily on the technical aspects of the installation. Using Max/MSP/Jitter, a homebrew IR webcam with fish eye lens and a LED-based IR spotlights, entire 24×36-foot exhibit space is converted into an aural sandbox giving visitors an opportunity to generate and shape the
ensuing soundscape. Positional data of up to 20 visitors is forwarded to Unity3d using [myu] Max-Unity interoperability toolkit developed at DISIS (http://disis.music.vt.edu). Unity is used for physical simulation of ensuing ripples and the resulting data is sent back to Max for spatialization across a 12-channel (4×3) ceiling-mounted speaker array. Driven by communal interaction, virtual ripples refract from each other spawning an algorithmically generated aural fireworks. The exhibit ran non-stop for approximately 5 months until March 2009.

Bonus video below: an early prototype that did include visuals. After days of looking at emulated knobs and faders, it certainly does speak to some of the possibilities for musical interface and expression.

Want to interact with your computer musically using physical objects and other fancy-schmancy, science-fiction-y interfaces? Don’t want to rely on Microsoft or wait until 2019? You’re in luck. It’s like Christmas for DIYers and interactive futurists.

Enter LusidOSC, a set of protocols, libraries, and useful code, and Trackmate, a clever and cheap-to-build system for tangible interfaces. Together, you’ve just got a bunch of tools to help you start playing with blocks — erm, experiencing new spatial interfaces.

• LusidOSC, the library maps “spatial input devices” – really, any tangible devices or sensors in the real world – to applications, like live music or live visuals. It uses the network-savvy OpenSoundControl protocol. The library is available now for Processing, with Java, Python, Flash, and C++ in the works.
• LusidOSC, the apps/code: a set of Processing utilities to get you started includes a basic example app, command launcher, playlist mixer, and a MIDI sequencer. You can build on these for your own Processing apps.
• Your own input device: Tags? Sensors? Markers? Regions? Fingertips? If it’s in physical space, you can map it via LusidOSC. Or, if you want a place to start, try:
• Trackmate: A project of MIT’s Tangible Media Group, Trackmate lets you affix tags to any objects you want and use them as an interface.

LusidOSC is just the protocol; it’s physical applications like Trackmate that get really interesting. In these economically-challenged times, Trackmate gives you tangible interfaces for next to nothing. All you need is a computer (Mac, Windows, or Linux), and a camera (even a webcam will do). Print out randomly-generated tags in the free and open source software, stick them on stuff you want to use, and go to town.

You can make your own Trackmate surfaces out of hardwood or plexiglass for as little as $40 in parts. There’s even a Processing-based simulator app so you can experiment without the physical objects. (Good for troubleshooting on the bus or plane, I imagine.)

Trackmate is just one project, though; LusidOSC promises to support other interface ideas, too.

LusidOSC at Sourceforge, the work of “many research institutions and companies.” (Which, I wonder?)
Trackmate at Sourceforge, a project of the MIT Media Lab Tangible Media Group

Alternatives: TUIO, the protocol used in the Bjork-endorsed Reactable project marches forward, as well. And as both projects are open source, there could be some cross-pollination. I hear a revised TUIO is coming, and in the meantime, LusidOSC acts as a gateway to TUIO.

The urgency of being way behind a single dominant player can make electronics makers do some odd stuff to promote their products. iPod, once an icon of digital cool, has achieved such ubiquity that it doesn’t even try to be hip any more. The thing is being promoted with American Idol, for crying out loud — not exactly indie cred. We saw Microsoft enlisting indie musicians and animators to sell Zune, of course.

But here’s where things get surprisingly amazing: Sony is using weird and wonderful Japanese experimental music to promote Walkman.

Now we’re talking.

And whether or not Walkman is cool again, this is for sure: Japanese experimental musicians? Mind-blowingly cool. And, apparently, in love with using light as a controller for sound.

Atsuhiro Ito uses contact mics on a fluorescent bulb he dubs the Optron. Instead of just being stage eye candy, the bulbs are really making the sounds here; coupled with guitar effects, he can solo on the bulbs. It’s what the Knitting Factory will be like after the nuclear winter. I can’t wait.

Taeji Sawai uses a light pen to draw melodic lines and rhythmic onto a screen. The basic effect – track light from a single source – is old. Yet he’s clearly got a brilliant aesthetic mind that makes it all work; the elements are strikingly simple but never fail to be engaging. And there’s a strong connection to work by his fellow sonic inventor Toshio Iwai.

Thanks to our friend Donald Bell of cnet, aka very talented and (cool) musician Chachi Jones, who has a great write-up:

Sony Walkman promos are awesome, confusing

Confusing? No, I’d say Sony is confusing; the real question is why their Walkman can’t be more like these ads. Plus, since neither Don nor I can read Japanese, how do we know those characters don’t say something like “Hey, guys, sorry for that bit with the lousy boring electronics – we’re coming back from the dark side to make awesome things again”? Okay, maybe not. (Do let me know if the next one says “Fine, you damned snarky blogger, I’d like to see you run a giant multinational corporation.”)

Admittedly, the problem here is this makes me want to toss my iPod touch out the window and build my own open source MP3 player with Popsicle sticks and wire, or, at best, mod an original Walkman so I can play circuit-bent OGG files using power from a bicycle. At the very least, I’m ready to add to my Atsuhiro Ito and Taeji Sawai collection. And I don’t think their full body of work is on iTunes. That’s just as well.

So, Sony, thanks. Now, will you let us run homebrew music apps on your PSP? Please?

Our friend and interactive hero Gustavo Bravetti must have been inspired by all the talk of hexagonal sequencers, because he’s come through with a brilliant prototype of a new interactive sequencer design. He writes:

I just wanna share mi first very unfinished and at ultra alpha stage, hexagonal sequencer prototype!

Between many things, I have planed to include many automatic scale definition tools, follow actions, you’ll can easily change the hexagon density, and multi-touch support via IR (wiimote or cams) is planned also.
This is just a sneak peak.

For an “alpha” version, as you can see, there’s already a lot of goodness going on. The visuals and interaction are powered by vvvv, the free-for-non-commercial use (and otherwise affordable) Windows-only patching language. Max is great, but vvvv is capable of some very powerful features of its own, including particularly nice hooks into Windows’ DirectX rendering engine.

vvvv Site + Wiki + Community

More on vvvv at Create Digital Motion, as it’s most often used on the visual side:
http://createdigitalmotion.com/tag/vvvv

As with so many of these things, vvvv’s community is more valuable than even the tool itself; we’re seeing lots of work on doing clever things with the environment. And vvvv has gotten some powerful music features like VST plug-in support, meaning you could build your sequencer in vvvv and skip something like Live altogether.

Previously on this topic:
Music on the Game Grid: Interactive Arpeggiators Al-Jazari, reacTogon
Alternative Sequencers: Elysium Generative Mac App and the Joy of Hex

And for more of the Awesomeness of Gustavo (pay close attention to that interview, especially):
Live + FM8 = Drum Kit Love: Free FM8 Drum Kit Download
Weekend Inspiration: Ableton Live Follow Actions, Dummy Clips, Making Snares
Interview: Gustavo Bravetti, Playing Music with Light and Interactive Gloves