Design in music in a digital world can be about the object as the sound – musical ideas translate from one medium to many others. And just when you think you’ve seen it all, someone comes up with a new visual metaphor, a new creation for manipulating music.

OTTO is a functioning prototype combining interactive hardware and computer software, the invention of Luca De Rosso. He produced the design as a thesis project for his masters’ degree in Visual and Multimedia Communications at IUAV University of Venice. It uses the Arduino open source hardware platform and Cycling ’74’s Max/MSP software, and Luca accordingly is quick to credit the assistance of those two communities. In that sense, two, I think it points to lots of new design in the field of integrated hardware and software – not just standalone hardware or standalone software or generic controllers for anything, but hardware that itself behaves like software.

All photos here courtesy Luca and used by permission; see his Flickr account.

OTTO ~ demo.01 from Luca De Rosso on Vimeo.

Luca sends along some more details of the behind-the-scenes workings just for us. (Thanks, mate!)

Take a powerful game engine (for animation, 2D and 3D graphics, physics, and on-screen interaction). Add the flexibility of a visual development environment for programming with virtual patch cords, for rich sonic and musical capabilities plus easy interaction with data and input. That’s the idea of combining something like Unity 3D with Max/MSP. In the example from earlier today, the solution simply routed basic data from a Unity-based game to a responsive music engine in Max.

In the case of [myu] – the Max Unity Interoperability Toolkit – that integration goes further still. Developed at the DISIS (Digital Interactive Sound & Intermedia Studio) at Virginia Tech, [myu] allows bi-directional integration of the Unity engine with Max or Pd. The two tools use netsend/netreceive to send data via TCP and glue the two together.

For visualists using Jitter, you can even exchange texture data, which offers some mind-blowing powers for live visuals.

Download at Virginia Tech — bonus, an extension of the aka.wiiremote object so you can use the lovely Wii Fit controller, among various other projects
Discussion on the Unity Community Forums
Discussion on the Cycling ‘74 forum
Virginia Tech DISIS

As an interactive prototyping tool, this should have a lot of potential for lovers of patch-style programming.

Thanks to Dr. Ivica Ico Bukvic, DISIS Director and researcher, for sending in his project. I’ll be curious to see what other people might do with this.

c

Ever feel like you’ve found the seam dividing past and future?

The past: restrictive UI frameworks requiring pages and pages of code to produce dated-look 2D displays. Proprietary software with rigid interfaces. Input bottlenecked through the x and y coordinates of a single mouse pointer.

The future: UIs whipped together graphically or with a few lines of code. 3D mixed with 2D. Open-source, friendly frameworks. Creating your own interface or drawing upon a community of creative software makers. Input that uses multitouch for gestures, collaborative input, manipulation of 2D and 3D space, and … well, just a lot more fun.

There’s no need to wait around for the future. Creative software inventors are building it for themselves. Here are two of the most promising multitouch interface projects I’ve seen in my inbox.

In no time at all, you’ll be painting a cow! (Okay, more on that in a moment…)

If you haven’t been following Max 5 updates, the folks at Cycling ‘74 have been aggressively bug squashing. The changelog for 5.0.6 alone is exhaustive. (Via @rekkerd on Twitter, of rekkerd.org.)

Updated: Also new in Max 5, it’s now possible as of 5.0.6 to properly save your patches to a version control repository. Don’t know what that is? Now’s a perfect time to find out — it means it’ll be easier to track changes you make to your own patches, and easier to collaborate with other people. And it’s free. From adamj, on comments:

RE: the diff’ing issue I was talking about above. Timothy Place (one of the Max developers) shared this helpful tidbit:

“Since the change log is a mile long, I’ll point out an obscure new power-user feature in Max 5.0.6.

You can send a new message to Max like this (or put it in an init file):
;max sortpatcherdictonsave 1

This makes it so that the JSON files that are use by Max for saving patches will keep the dictionary in the same order (alphabetized) every time you save. If you are keeping your patches in version control (e.g. SVN, GIT, CVS, etc.) then this should make your diffs a lot more usable.”

See: Version Control and Sharing for Patching: Keep Those Max, Pd Patches in Order with Git

And in other Max news, Expo74 will be a full-blown Max conference in April in San Francisco. You still have a few days to lock in the US$295 intro price (through 3/1). On the menu:

• C74-taught workshops for users: live looping, 3D, Max for Live, new timing objects, etc.
• Workshops for developers: C programming and the Max external API
• Special guest speakers, including Robert Henke — but also Miller Puckette, the creator of the original Max and developer of Cycling ’74’s open-source rival Pd.
• An afternoon on teaching Max
• A “Science Fair” for sharing projects
• Field trips
• A “Relationship Manager” – a sort of conference concierge – plus access to the C74 folks, a bit like the Apple Worldwide Developer Conference

Expo74

It’s good stuff. And the price seems a very reasonable deal for a conference.

You know, it also reminds me that some of the events around the open-source tools could be friendlier than they are. And we like science fairs. I’m not sure that I’ll be able to make it out to California in April (I’ll be there in March for the Game Developer Conference), but eager to hear how this goes.

But speaking of open source, don’t want to spend April at an event for a proprietary tool? Prefer the East Coast to the West Coast? Like code better than patching? Like tools that begin with the letter “S” better than the letter “M”? Want tools that make you think of supermassive black holes? Oh, April in North America has you covered regardless of what you like. One moment while I write up another post…

We get the “where do I go to learn this stuff” question a lot in the inbox. With Max for Live coming later this year, bringing the powers of Max to Ableton Live, I imagine the hunger for knowledge on that tool will be all the greater. (At the same time, I think the growing popularity of DIY tools means that it won’t make alternative tools like SuperCollider, Pd, Csound and the like less popular — I think we’ll see a growing trend toward all of these tools, provided we can show folks how to use them and get better at them ourselves!)

I know one route that has been successful for many people is the coursework at Harvestworks, the storied research and study center in New York. I can heartily endorse this one and say that, while I know and am friends with all the faculty, I have absolutely no investment in this. Dafna Naphtali, Hans Tammen, and Zach Seldess will all be teaching week-long intensives at Harvestworks in Manhattan. They’re not cheap – $1275 for the whole week – but I know some people have even flown to New York from other parts of the world to study up.

And what does all this mean? Well, it means you can turn Street Fighter, the game, into an improvisational ballet as instructor Zachary Seldess has done (above). Among other things, of course.

If it’s all out of your budget, don’t worry; we’ll have some other learning resources for you soon. But for those of you who can take the plunge, here are some details: