It started as some compelling demos or proof of concept, but it’s plenty real now: the tools for translating movement, gesture, and dance from the body to interactive music march forward. Empowered by Microsoft’s Kinect and an artist-friendly toolchain, even a single, clever developer can do a lot. Sound designer, music producer, and Max/MSP developer Chris Vik of Melbourne has been one of those busy early pioneers, with an incredible tool called Kinectar.

So, the tech is cool and shiny and impressive: what about the actual music? And, even more importantly, what if all the hand waving and moving about could be meaningful? That’s the next step. For his part, Chris is teaming up with a dancer and choreographer to combine his compositional ideas with someone who knows how to move. The Dubstep-y demos (all below) are impressive, true, but the early tests of the work with the choreographer are simply beautiful, and demonstrate that wobble bass isn’t the limit of what this can do. They also turn the arbitrary arm-waggling into a part of the art.

And as for you: the software’s alpha, but you can fire up your copy of software like Ableton Live and grab this software for Mac or Windows and try it yourself. So if you don’t like the results – be the gesture-controlled basslines too wobbly, be they not wobbly enough – you can put your music, and your movement, where your mouth is.

At top, Chris shows off an early test of the dance collab. (There’s more to come.) Below, a tutorial that shows how this works with Ableton. And read on for more from Chris on what the work with the dancer is about, and what the tool can do.

Chris writes:

Since April 2011 I’ve been working solidly with the Microsoft Kinect, developing my software, Kinectar, to enable its use as a MIDI controller for performing music live. I’ve done a number of performances around Australia since I started the project, however, it’s safe to say that, although I would consider myself an electronic musician, I’m certainly no dancer. Enter, Paul…

Dancer, Paul Walker and I have joined forces to bring the Kinect controlled music concept into the world of contemporary dance. Recently we obtained a residency at PACT theatre (centre for emerging artists), where we spent the week developing different ways of implementing my Kinect music control system in a dance context.

My system is developed in Max and uses OpenNI drivers, OSCeleton and Ableton Live.

via Chris’ blog

CDM will check back in with Chris soon, because:

I’ve got some more videos to release over the coming weeks from a range of my different Kinect music performance applications, including controlling/conducting the Melbourne Town Hall Organ and a 100+ speaker Kinect-controlled diffusion performance. I’ll keep you posted when they’re released!

More on the software:

Kinectar Performance Platform is a toolkit developed by music producer Chris Vik to allow the use of Microsoft’s Kinect motion tracking sensor in computer-based music. The software is designed for electronic musicians to expand the way they control their music in a futuristic and extremely expressive way, using only the waving of hands and a small amount of creativity. It can be used to control the simplest of parameters like a filter or LFO, play notes and chords on a sampler or synthesizer, or be programmed to control an entire live-set through nothing more than gesture.

Key Features:

Movement Tracking UI allows manipulation of the Kinect’s human tracking capabilities, displaying all relevant data extracted from the hands location in 3d-space

Instrument Builder lets the user build virtual ‘instruments’ by outputting MIDI notes in three modes:

• Static – Produces a single note value. Useful for drum triggers, turning on/off effects within a DAW or feed that trigger into Kinectar to switch between presets using your gesture
• Solo – Do sweeping solos by selecting from over 40 musical scale presets or click the notes on the UI to make your own
• Chord – Create a progression of up to 8 chords per preset to play live

Global Flags lets you turn on/off Kinectar’s instruments using a MIDI note sent from your DAW, external MIDI controller or Kinectar itself

MIDI Preset Control lets you switch between Kinectar’s presets and instruments using a single MIDI note

Value Editor enables many more MIDI/OSC outputs, for controlling device values

Visual Metronome popout window sits on top of all programs to make it easy to see if you’re in-time when the music gets messy

It’s labeled “rough alpha,” so don’t expect a finished tool here, but you can go download it and give it a try (or learn more about what’s possible):

http://kinectar.org/download

And now, the obligatory (but quite awesome, Chris) Dubstep demo videos:

In a twist on generating music from dance, artist and coder João Pais sends us Pd-generated scores, transformed into twinkling sounds by music boxes. As it happens, the music boxes are the same featured in Friday’s story on Ritornell.

The piece is RISS, a “performative installation/concert” produced outdoors in Berlin, with a 30-meter score generated by Pd from movement.

João describes his work: “The patch was simple, it analysed the sounds, and made a score using data structures. then I printed the score, and spent lots of hours puncturing all the holes.”

The video documents those sounds, in a project produced by the collaboration of composer and artist Christian Graupner, dancer/choreographer Phuong Nguyen, and João Pais. (For his part, João has been utterly invaluable in helping me with some Pd patches – I need to post some abstractions based on that work soon for everyone.)

More info:
http://www.humatic.net/art/p/riss/index.html

And I know this is just the tip of the … music box iceberg. Sorry, that’s a really horrible mixed metaphor. There are lots of people using music boxes, yes.

Touch performance control on devices like the iPhone and iPad has become increasingly popular, but the question remains: can developers push these interfaces further? Richie Hawtin has initiated a new touch control project and promises more “advanced” control of Ableton Live for iPhone, iPod touch, and iPad users.

Details remain murky – developers Liine say they’ll tease out features over the coming weeks. But the system, when fully revealed, will be modular, with a set of touch objects and gestures across a set of apps that provide touch control. The first application is Ableton Live-specific, and provides a new mechanism for controlling Live’s grid of clips. The developers say Griid makes it easier to find clips and see information about them, even when navigating large sets of clips. (You know who you are, those of you with enormous Live sets with a zillion colored clips.)

Different editions will scale to different screen sizes, with Griid Pro for iPad, and Griid for iPhone/iPod touch, plus a Lite version for free.

What all of this means or whether it lives up to these claims is, well, a complete unknown outside of the Plastikman stage. That is, unless you happen to be in Barcelona at SONAR this weekend. Tomorrow, Saturday, Richie will be demonstrating the app in person. Liine tells us:

“At the hands-on Richie will show how he uses the app in his Plastikman Live show. There will also be another laptop or two set up and hooked up with Griid so that they can give it a try themselves.”

If you can make it and want to report back to the rest of us, I’d love to hear it. And I expect to bring more info to CDM soon, if not. But it certainly works for Richie; check out the video below of him using the tool at Detroit’s Movement festival, for his new Plastikman Live show. (And yes, this is bringing back Plastikman and more of the live performance, rather than simply DJ, the side of Richie a lot of us love best.)

http://liine.net/griid/
http://liine.net/

If you’re at SONAR, check out http://ghost.m-nus.com/ (and if you’re not, that site has live streams and audio – warning, audio auto-plays!)

The video cuts fast, but in these still images, you can get a better view of the software and Richie’s setup, including the JazzMutant Lemur touch hardware and Behringer BCF-2000 motorized hardware faders alongside the iPad:

From John Cage to Radiohead, there are few people in any medium so closely tied to the explorations of experimental music’s frontiers than Cunningham. To understand why music was so important to him – and electronic music in particular – we can listen to Merce himself. He explains that part of this shift in thinking about time came from the eradication of bars and beats in electronic music:

http://ubu.artmob.ca/sound/aspen/mp3/cunningham1.mp3

From an interview on UbuWeb.

(Thanks to Benjamin Dauer for the tip.)

That’s just one example, though; there’s quite a lot more we could talk about. I’d like to do a timeline of Merce’s significant sound collaborations and review some of the moments in electronic music history with which he was involved. On Create Digital Motion, we’ll look back at his LifeForms software and the work he did with motion. But I need your help: please send along resources you think may be helpful, any of your own experiences of the artist and his work, and other tips and questions.

On Create Digital Motion:
Remembering Merce Cunningham, Digital Motion, and Digital Portraits

Merce Cunningham Dies [New York Times ArtBeat]
Merce Cunningham Foundation

MCF and MCD will be receiving visitors today. (See site above.)

Lusine on the Detroit People Mover, Movement 2009 from Create Digital Media on Vimeo.

I’ve been a big admirer of Lusine’s adept sound palette, which smartly blends minimal, techno, and ambient techniques. That, in turn, represents to me some of the best stuff the US-based label Ghostly International is turning out. Liz McLean Knight sends us this video of a conversation she had with Lusine at Detroit’s Movement Festival in May, wandering onto the city’s People Mover. (You can join in a chorus of the Simpsons “Monorail” tune if you like.)

One aside from Lusine not in the above video: he talked about sticking with stock plug-ins for stability. What he didn’t say, but what you might infer, is that this may help him keep his sound focused rather than getting distracted by other capabilities. On the other hand, speaking of rules that are meant to be broken, he’s friends with Richard Devine, who has a VST folder that could put any of us to shame and bring any VST host to its knees.

You can bet CDM will check in with Lusine when the new album comes out – and we’re eager to hear just what this vocal/”pop” direction may actually sound like.

http://lusineweb.com/

No relation to the Lusine who was Miss Armenia 2003, though I can’t imagine this Lusine would mind the comparison.

CDM’s Peter Dines and Liz McLean Knight (Liz literally on her honeymoon) are keeping us posted with the latest events from Detroit’s Movement and Montreal’s MUTEK festivals. You can keep track of their travels and live impressions on our new CDM events blog, and I look forward to some artist interviews planned with some of our favorite people, coming soon.

So far, Peter is getting his synesthesia on with live audio and visuals at A/Visions, while Liz notes the spooky near-ubiquity of UC-33e controllers running Ableton Live at Movement. (Guess they need to invite us with some odder controllers, huh?)

Lots more coming soon — if you’re at either of these events, too, send in your reports and we’ll publish or link them:

events.noisepages.com

The events site will soon feature more information on CDM-hosted events, as well.