For everyone who thought Twitter was just about “i m eating a ham sandwich lolz,” the desire to use connectivity to actually be connected continues to win out in unexpected ways. So far this month, we already saw the use of Max/MSP. Now, Twitter is showing up in the geeky, open source sound tool SuperCollider and in DJ sets in Traktor by Richie Hawtin.

Tweet a Sound, to the Max

First, some updates on Tweet a Sound, the sound design tool in Max that lets you share synth presets.

Creator Andrew Spitz has an updated story on adding a cleaned-up subpatch to Max/MSP. It uses the Ruby programming language to access the Twitter API. (You should be able to port to Pd, too – I have to look closer at this.) Correction: Ruby is implemented as JRuby, so it runs on the Java virtual machine – and there is a Java implementation for both Max (mxj) and Pd (pdj)

This means, if you’ve got a Mac or Windows copy of Max/MSP, you can now send Tweets from your patches. And that should open up still more possibilities when Max for Live becomes available, for Ableton fans.

How To Send A Tweet From Max/MSP { sound + tutorial }

Even if you’re skeptical about Twitter per se, if you’re interested in using Ruby and Max, this should be a good starting place for other APIs, too.

Friends of mine like Francis Preve have gone utterly nuts for this.

As an addendum to the last story, Ivica Ico Bukvic sends along an example of the [myu] Max/MSP + Unity game engine combination in action. Here’s the surprise: Unity isn’t generating visuals. Instead, Unity simulates ripples created by movement in the space, and builds physical models that are sonified and spatialized by Max/MSP.

Speaking of work involving art museums and the combination of Max and Unity, VJ Anomolee notes in comments his own work with the pairing. Lightbent Synth is an in-progress piece with alternative controllers and sensors that produces sound with a novel visual representation (sound’s very quiet in this preview — more hopefully once it progresses):

Lightbent Synth from VJ Anomolee on Vimeo.

Ivica explains the top work:

Take a powerful game engine (for animation, 2D and 3D graphics, physics, and on-screen interaction). Add the flexibility of a visual development environment for programming with virtual patch cords, for rich sonic and musical capabilities plus easy interaction with data and input. That’s the idea of combining something like Unity 3D with Max/MSP. In the example from earlier today, the solution simply routed basic data from a Unity-based game to a responsive music engine in Max.

In the case of [myu] – the Max Unity Interoperability Toolkit – that integration goes further still. Developed at the DISIS (Digital Interactive Sound & Intermedia Studio) at Virginia Tech, [myu] allows bi-directional integration of the Unity engine with Max or Pd. The two tools use netsend/netreceive to send data via TCP and glue the two together.

For visualists using Jitter, you can even exchange texture data, which offers some mind-blowing powers for live visuals.

Download at Virginia Tech — bonus, an extension of the aka.wiiremote object so you can use the lovely Wii Fit controller, among various other projects
Discussion on the Unity Community Forums
Discussion on the Cycling ‘74 forum
Virginia Tech DISIS

As an interactive prototyping tool, this should have a lot of potential for lovers of patch-style programming.

Thanks to Dr. Ivica Ico Bukvic, DISIS Director and researcher, for sending in his project. I’ll be curious to see what other people might do with this.

Game Audio: Selected Student Works from Matt Ganucheau on Vimeo.

In the early days of game sound, musical soundtracks were all largely adaptive and interactive, fused with the sound effects of the game and the logic of gameplay. Scores were less Alfred Newman or John Williams, more Spike Jones. Today, game music has the potential to reinvent composition itself, to help us reimagine what makes a musical score as on-screen user action drives musical ideas. But with a few, notable exceptions, most modern titles have opted for big, Hollywood-style soundtracks – and the linear composition that goes with them, as though someone just took a film score CD and hit play.

It’s one thing to talk about that in theory. Better yet: give it a shot yourself. So why not teach game music as its own discipline?

Matt Ganucheau, a composer, sound designer, and interactive developer/artist, is teaching just that, working with students at Expression College in Emeryville, California. The accelerated course works with the elegant Unity game engine and a clone of the legendary Space Invaders arcade game, adding music built in Max/MSP. If Max seems an unlikely choice, its open source cousin Pure Data (Pd) is actually integrated with the game engine for Electronic Arts’ Spore, with music by Brian Eno working with EA’s Kent Jolly and contributor Aaron McLeran. So, this could be the wave of the future. The first problem: figuring out how to actually compose.

The results are astonishing, given that the students were just learning Max and had extremely limited amounts of time. I asked Matt to write up for CDM how the coursework evolved; he shares his process and what he learned as a teacher. We’re also working on open sourcing the coursework content and the patches, which we’ll soon provide both for Pd and Max/MSP. I’m doing some work on the game side so that you can play with game mechanics in Processing. Stay tuned for more on that.

We spoke a bit about this process – and interactive music in general – with Xeni Jardin and Boing Boing in their Game Developer Conference livecast a week ago Friday. Edited video of that coming soon.

Here’s Matt on the coursework itself:

I ask you: what is the foundation for rhythmic electronic music? I suggest that the humble step-sequencer is the backbone of many of today’s musical genres and memetic evolutions. To have electronic rhythm, you need to start with a clock and go from there, dividing it into fractions and multiples. Then start assigning sounds to those divisions and you’re pretty much there- techno is happening.

I’ve been working on prototyping a sequencer-synth and in doing research, I’ve come across numerous projects that tackle this idea with great enthusiasm. Because a sequencer can drive any type of electronics, projects tend to fall into two categories: audio, or visual. Additionally, I’m seeing two main drivers for the sequence itself: the nimble arduino, and the CMOS 4017 Decade counter IC. I’ll survey here some of the finished projects to give an idea of what’s possible. Come with me, won’t you, on an exploration of the world of DIY sequencers.