Inside a computer, digital music is entirely unseen. But translate it into the tangible world, and it can be anything you imagine – not limited by acoustic reality or practicality, music can become three-dimensional sculpture.

For artist Christoph Bauder and composer Robert Henke, ATOM’s light and sound sculpture found a three-dimensional matrix of balloons as its medium. Flashing in hypnotic patterns and moving into different configurations, accompanied by live laptop music from Henke (aka Monolake), music and visuals become an inseparable fusion.

ATOM received its North American premiere at Montreal’s MUTEK in May. That turned out to be perfect programming, as it placed ATOM in a week that featured complementary work from artists Artificiel. Henke says some of his matrix manipulations – and even the specific Max/MSP patches from ATOM – came from collaboration with Artificiel and their light bulbs. For their part, at MUTEK they unveiled a new audiovisual etude called POWEr Play involving a live-sampled Tesla Coil. The science fair ethos of ATOM and POWEr Play could have been gimmicky or overly fixated on spectacle, but in these pieces, it was anything but. Both works contemplated their subject matter so thoughtfully that balloons and electrical coils seemed perfectly natural media for the audiovisual imagination, and audiences were left marveling at phenomena in a way too rare in 2009.

Video episode at Blip.tv [includes mobile/desktop video downloads]
YouTube Part 1 and Part 2 (if you prefer YouTube for viewing)

It’s worth downloading the video above and really getting to soak up some of this piece when you have time. I also have an audio interview of a conversation with Robert and Christoph immediately following one of the performances.

You’ll hear Christoph’s voice first, followed by the unmistakable percussive enthusiasm of Robert. For me, the best part of the interview was hearing them discuss whether you should notice some of the unintentional randomness of drifting balloons or technical hiccups, and how they structured the work formally with a palette of possible balloon patterns.

Download the audio interview

Play this track:

For more on POWEr Play, see my Montreal flat mate Greg Smith writing for Rhizome – and stay tuned for the CDM audio interview, coming next week:
power play – artificiel at mutek [Serial Consign Blog]
Variable Frame Rate: Multimedia Performance at MUTEK 2009 [Rhizome]

More information:
Atom project Information at monolake.de
Text interview by Bertram Niessen for Digimag magazine, October 2007, also at monolake.de

Design in music in a digital world can be about the object as the sound – musical ideas translate from one medium to many others. And just when you think you’ve seen it all, someone comes up with a new visual metaphor, a new creation for manipulating music.

OTTO is a functioning prototype combining interactive hardware and computer software, the invention of Luca De Rosso. He produced the design as a thesis project for his masters’ degree in Visual and Multimedia Communications at IUAV University of Venice. It uses the Arduino open source hardware platform and Cycling ’74’s Max/MSP software, and Luca accordingly is quick to credit the assistance of those two communities. In that sense, two, I think it points to lots of new design in the field of integrated hardware and software – not just standalone hardware or standalone software or generic controllers for anything, but hardware that itself behaves like software.

All photos here courtesy Luca and used by permission; see his Flickr account.

OTTO ~ demo.01 from Luca De Rosso on Vimeo.

Luca sends along some more details of the behind-the-scenes workings just for us. (Thanks, mate!)

Handheld eggs, ironing boards, machinedrums, phones … live setups can involve all sorts of oddities, especially among the rabid (in a good way) Ableton Live fanbase, and we’ll be showing them in NYC. Saturday night, we’ll chill out after Dubspot’s day-long workshop with a free, open party in Manhattan’s Meatpacking District at 675 Bar to explore some new musical interfaces, have a few drinks, meet each other, and hear some new sounds. [Facebook RSVP]

For more on the whole week’s events with Dubspot, see our previous post.

Confirmed lineup:

• Isomer Transition (aka RJ Valeo) doing some superb-quality techno with lots of knobs and a machinedrum + Ableton Live
• Ted Hayes’ EggBeater wireless shaker for rhythms, built in free software Pure Data and used (in this case) with Ableton Live
• Sound artist Ranjit Bhatnagar with a musical MIDI ironing board (pictured below) controlling Live, as seen at Handmade Music (at which it was covered by Wired.com)
• Track Team Audio’s Michael Hatsis showing some tweaked-out Live control in action – hopefully including his APC40 hacks and monome patches.
• Me, playing a set with control TBD – possibly Lemur and/or my Android phone

The “beater” application is really quite nice, and follows with a lot of handheld-style, gestural controllers we’re seeing lately. That could mean that soon we could have some sort of software layer that works with any of these controllers — substituting, say, a Wii or mobile phone. Here’s a great video from the ITP show (the bi-annual exposition of the work of interactive technology students at New York University):

Editing drum patterns in RjDj/Pd from Frank Barknecht on Vimeo.

If making your own musical tools seems like a lot of work, you’re not wrong. The beauty of making your own stuff is all about making your own reusable modules that help you build musical solutions more quickly. Finding those useful modules can also help people new to programming or patching.

In Pure Data, the free and open source cousin of Max/MSP, one form of these reusable modules is called the “abstraction.” It’s an object that you can stick into your creations to help build what you need without a lot of fuss.

Translation: even if you’ve never patched before, you can start making fun drum pattern makers quickly using all-free software. The folks at RjDj, who have been creating mobile interactive toys for the iPhone and iPod touch (see our interview, recent story) have also been building a library of useful abstractions. Because that library is also free and open source and built for Pd, it works with your Mac, Windows, or Linux machine.

Here’s a great starter tutorial, useful for even newcomers:
Editing Drum Patterns in RjDj

For more Pd learning (see additional tips in comments):
Be a Music Geek Ninja with Electronic Music Programming in Pd: New Book

If you create stuff with this, be sure to share with us! And it’s brand new, but feel free to come join our Pd group on the in-alpha/beta Noisepages:
Pd Group

I wish I could be in London in July, but since I can’t, hopefully some readers of this site can make it to the upcoming Music Hackday, which features RjDj and lots of other online music projects (Soundcloud, Last.fm, the music API for The Echo Nest, 7digital, more):
http://musichackday.org/

Out of the box, Akai’s APC40 has some lovely features for plug-and-play control of Ableton Live, with clip triggering, track control, device control, and dedicated buttons for command shortcuts. It also sends and receives standard MIDI messages for every last button and encoder. But what if you still want more? What if you need more controls to do multiple duties, or get bored with simple clip triggering and decide you want additional interaction? Enter the hackers. Already, using MIDI, clever APC40 users are squeezing more function out of this box. And while it isn’t solved yet, there are some clues to the infamous hardware handshake – a System Exclusive string exchanged between the APC and Live that locks certain Live software features to the APC and not to other hardware you might like to use.

Manual MIDI

Before we get too fancy, for power tricks, your first stop should be Akai’s own site:
Tips and Tricks June – APC40

Live allows you to manually override the APC’s dynamic control assignments using the standard MIDI Map. Let’s say you don’t use headphones for cueing. You can select the MIDI Map, pick a control to which you want the Cue Level encoder to be assigned, and you’ll manually assign just that control – the rest of the dynamic template remains in place. Akai has some tips for scrolling through scenes, selecting scenes with one of the two footswitch jacks on the back of the unit, scrubbing and nudging clips, fine-tuning tempo control, and more.

monome Emulation for APC40 and Korg padKONTROL

Our friend Michael Hatsis of trackteamaudio has been hard at work in Max/MSP patching an emulator for the creative patches for the open-source monome hardware. (Thanks on Twitter to ruaridhTVO, too.) By translating from the (and, cough, superior) OpenSoundControl messages the monome supports natively to MIDI, the emulator supports not only the APC but Korg’s padKONTROL, as well. This opens up the use of the APC for creative microsampling and other tasks.

Video demo at top (updated late Sunday night, so if you saw this over the weekend, here’s a tighter version).

Direct download:
http://www.warperparty.com/datter/Monomulator0.9.zip

Forum discussion:
http://forum.ableton.com/viewtopic.php?f=1&t=117307&start=0

And be sure to check out the Java- and Python-powered open-source library for the monome on which Michael’s work is based:
net.loadbang.shado

You’ll find plenty of documentation in Michael’s download, and the hope is that this is just the beginning — you Max patchers out there (and Pd, if we can port this) can keep hacking on it and try out some new ideas. One reason you might want to keep hacking on the padKONTROL is that you could find uses for velocity – unlike the monome and APC, Korg’s 4×4 drum pads are velocity sensitive.