Take a powerful game engine (for animation, 2D and 3D graphics, physics, and on-screen interaction). Add the flexibility of a visual development environment for programming with virtual patch cords, for rich sonic and musical capabilities plus easy interaction with data and input. That’s the idea of combining something like Unity 3D with Max/MSP. In the example from earlier today, the solution simply routed basic data from a Unity-based game to a responsive music engine in Max.

In the case of [myu] – the Max Unity Interoperability Toolkit – that integration goes further still. Developed at the DISIS (Digital Interactive Sound & Intermedia Studio) at Virginia Tech, [myu] allows bi-directional integration of the Unity engine with Max or Pd. The two tools use netsend/netreceive to send data via TCP and glue the two together.

For visualists using Jitter, you can even exchange texture data, which offers some mind-blowing powers for live visuals.

Download at Virginia Tech — bonus, an extension of the aka.wiiremote object so you can use the lovely Wii Fit controller, among various other projects
Discussion on the Unity Community Forums
Discussion on the Cycling ‘74 forum
Virginia Tech DISIS

As an interactive prototyping tool, this should have a lot of potential for lovers of patch-style programming.

Thanks to Dr. Ivica Ico Bukvic, DISIS Director and researcher, for sending in his project. I’ll be curious to see what other people might do with this.

If you haven’t been following Max 5 updates, the folks at Cycling ‘74 have been aggressively bug squashing. The changelog for 5.0.6 alone is exhaustive. (Via @rekkerd on Twitter, of rekkerd.org.)

Updated: Also new in Max 5, it’s now possible as of 5.0.6 to properly save your patches to a version control repository. Don’t know what that is? Now’s a perfect time to find out — it means it’ll be easier to track changes you make to your own patches, and easier to collaborate with other people. And it’s free. From adamj, on comments:

RE: the diff’ing issue I was talking about above. Timothy Place (one of the Max developers) shared this helpful tidbit:

“Since the change log is a mile long, I’ll point out an obscure new power-user feature in Max 5.0.6.

You can send a new message to Max like this (or put it in an init file):
;max sortpatcherdictonsave 1

This makes it so that the JSON files that are use by Max for saving patches will keep the dictionary in the same order (alphabetized) every time you save. If you are keeping your patches in version control (e.g. SVN, GIT, CVS, etc.) then this should make your diffs a lot more usable.”

See: Version Control and Sharing for Patching: Keep Those Max, Pd Patches in Order with Git

And in other Max news, Expo74 will be a full-blown Max conference in April in San Francisco. You still have a few days to lock in the US$295 intro price (through 3/1). On the menu:

• C74-taught workshops for users: live looping, 3D, Max for Live, new timing objects, etc.
• Workshops for developers: C programming and the Max external API
• Special guest speakers, including Robert Henke — but also Miller Puckette, the creator of the original Max and developer of Cycling ’74’s open-source rival Pd.
• An afternoon on teaching Max
• A “Science Fair” for sharing projects
• Field trips
• A “Relationship Manager” – a sort of conference concierge – plus access to the C74 folks, a bit like the Apple Worldwide Developer Conference

Expo74

It’s good stuff. And the price seems a very reasonable deal for a conference.

You know, it also reminds me that some of the events around the open-source tools could be friendlier than they are. And we like science fairs. I’m not sure that I’ll be able to make it out to California in April (I’ll be there in March for the Game Developer Conference), but eager to hear how this goes.

But speaking of open source, don’t want to spend April at an event for a proprietary tool? Prefer the East Coast to the West Coast? Like code better than patching? Like tools that begin with the letter “S” better than the letter “M”? Want tools that make you think of supermassive black holes? Oh, April in North America has you covered regardless of what you like. One moment while I write up another post…

We get the “where do I go to learn this stuff” question a lot in the inbox. With Max for Live coming later this year, bringing the powers of Max to Ableton Live, I imagine the hunger for knowledge on that tool will be all the greater. (At the same time, I think the growing popularity of DIY tools means that it won’t make alternative tools like SuperCollider, Pd, Csound and the like less popular — I think we’ll see a growing trend toward all of these tools, provided we can show folks how to use them and get better at them ourselves!)

I know one route that has been successful for many people is the coursework at Harvestworks, the storied research and study center in New York. I can heartily endorse this one and say that, while I know and am friends with all the faculty, I have absolutely no investment in this. Dafna Naphtali, Hans Tammen, and Zach Seldess will all be teaching week-long intensives at Harvestworks in Manhattan. They’re not cheap – $1275 for the whole week – but I know some people have even flown to New York from other parts of the world to study up.

And what does all this mean? Well, it means you can turn Street Fighter, the game, into an improvisational ballet as instructor Zachary Seldess has done (above). Among other things, of course.

If it’s all out of your budget, don’t worry; we’ll have some other learning resources for you soon. But for those of you who can take the plunge, here are some details:

Many people are asking about what Max for Live can do. That’s a short answer: everything Max/MSP/Jitter can, plus some new stuff to make it work with Ableton Live. It might be better called “Max in Live.” Max for Live has all the objects that Max/MSP and Jitter have – all of them. Right now, I’m gathering a big part of the testing Cycling ‘74 is doing is to try to make anything not work, but so far, it sounds as though everything does. That means Max for Live is an environment for JavaScript and Java. It means you could have Processing sketches, wrapped in Max patches, running in Live.

And it also means you get Jitter, which gives you video playback, processing, and output, plus 3D visuals. You’ll apparently be able to open a window for output, just as in Jitter. So you could have Live sets that trigger video clips, all from within the same tool – or, if that sounds unwieldy on one machine, have a Max patch that communicates with any visual app you like on another machine.

8-bit and robots and odd Max and Reaktor patches and custom visual software and visualizations of data packets and sound made from plants and mutant trumpets and gloves for DJing and laptop music – we’ve got quite a lineup here in New York this week.

Friday night, a live audiovisual lineup from the worlds of createdigitalmusic.com / createdigitalmotion.com invades the HOPE conference, aka Hackers on Planet Earth, the three day-long convergence of tech hacking. $10, open to all, 11-2a Friday July 18 at the Hotel Pennsylvania in New York. It’s a live digital, technological variety show in a doomed NYC landmark hotel with an audience of famous and infamous hackers. (Think Kevin Mitnick and MythBusters’ Adam Savage and Steven Levy, all in one place.)

Facebook event page; also on Going.com

Here’s a look at the performers and projects. If you can’t be in New York, this should give you a little taste of the range of work people are doing here and in our community in general, and I hope to have more coverage after the event.

Michael Una performing at SYNC Fest 08 from Michael Una on Vimeo.
Robot drummer from Michael Una on Vimeo.

Michael Una’s live-looping, robot-drumming, circuit-bending experience

CDM contributor, Circuit Bending Challenge coordinator and sage of all things DIY and sound art Michael joins the ensemble with robotic assistance:

I will be using custom-built interface devices, acoustic and circuit-bent instruments, and a robot drummer to create a rhythmic, textured and melodic sonic experience on the fly.

http://una-love.com

(Hey, does anyone know why Renee and Michael’s site is being blocked by Google? Was it the beat bike or the prayer wheel? What gives?)