Alex Nowitz for BodyControlled #2 from CDM on Vimeo.

Electronic media artist Mario de Vega (Mexico City/Berlin) says his work plays with the creation of “unstable systems.” As part of the official Vorspiel, or lead-up, to Berlin’s massive Transmediale festival, here we get to visit two artists working with the materiality of live performance, drawing from the festival theme of “in/compatible.” The sonic environments they create seem poised on the brink of sonic chaos, a dance at the edge of entropy.

CDM will again be editorial co-presenter of BodyControlled; you can see the show for free (donation suggested) in Berlin at LEAP, or tune into the live video stream from anywhere in the world, and we’ll be bringing you details of the artwork. We’re a ticket to Alexanderplatz that’s even cheaper than easyJet, in other words. The performances start at 20h CET Thursday, 26 January. (That’s 2p East Coast time / 11a Pacific, so scare your office mates and turn it up loud.) Full details below.

At top, composer/singer Alex Nowitz demonstrates his gestural performance techniques. I got to see his work for the first time at the Patterns + Pleasure Festival in the fall at Amsterdam’s STEIM research center. While at STEIM, Nowitz built on previous work with the Wii remote, and augmented his gestures with a new instrument, entitled the “Strophonion.” You can see that creation in the video above.

With each contortion of his body, Nowitz rips apart sounds, all while sputtering non-lingual utterances with his gymnastic voice. In the Amsterdam performance, one had the sense of following him into the Schwarzwald (Black Forest), an operatic odyssey echoing with forboding birdsong. But the system can also be dynamic and even, at moments, whimsical.

steim.org/projectblog/?p=3715
nowitz.de/

For his part, Mario de Vega’s “unstable systems” flirt even more with this notion of engineered incompatibility, with sounds that seem like they will explode in an earthquake-like tremor.

Mario de Vega for BodyControlled #2 from CDM on Vimeo.

mariodevega.info/

Films by João Pais, co-curator of the series; edited by CDM.

Also on this program, more works engage the idea of what the curatorial statement terms “hidden acoustics”:

Echo Ho (Canada/Cologne, DE)

Tuned to Site #26012012
This title is from a series of concerts, called “Tuned to Site #…”. As a whole, the series formulates the idea of “musification of urban landscapes”.
In the first performance of this series in 2012 Echo Ho will play a set of instruments: a self-fabricated hybrid semblance of the ancient Qin from China, which combines traditional acoustic and digital interfaces in one unique transparent plexiglas body. Like a sensor box, it will enable Echo Ho to make field recordings of inaudible hidden sounds within
the city environment, such as electro-magnetic fields, variation and wind movements. The performance thus marks the process of generating action by outlining situations in which sounds may occur.

http://www.echoho.net/

Ignaz Schick (DE)
Turntablist, sound artist, performer & composer Schick promises, through motors and objects, genuine accidents:

Site-specific performance with transducers, wireless controllers, feedback systems and back tape
Through accidents and their outcomes, actions, processes and objects that conceptually connect with acoustic information, the work of Mario de Vega researches the value of vulnerability, exploring the causes and effects that determine the construction of realities. In this site-specific performance with transducers, wireless controllers, feedback systems and back tape, de Vega is investigating aesthetic and social realms through a multiplicity of mediums.

http://www.zangimusic.de

Co-curator João Pais tells CDM that this installment, in keeping with Transmediale’s theme, will “give the performers a room where they can show their ways of working with the dissociation of matter (through sound, in this case) and expression.” Pais co-curates the event with Daniel Franke of LEAP.

This episode includes two self-made instruments that expand on existing practice, he says, in the case of Nowitz and Ho, and the hacked and modulated machines of Schick and Vega.

More information; where to see the show

26 January 2012, 20h (free/donation)

Show details

Anywhere in the world – all performances will be available from 20.00 CET via live stream:
http://bit.ly/uXRgyq

Facebook: on.fb.me/AmEtO9

LEAP
Lab for Electronic Arts and Performance
(Berlin Carré, 1. Stock)
Karl-Liebknecht-Str. 13
10178 Berlin

How to find LEAP

Look around the room you’re in. Drum your fingers against some of the objects around you. Now imagine that you could turn those touches into any imaginable sound – and all you’d need to play them is a single contact mic. And we’re not talking just simplistic sounds – think expressive, responsive transformation of the world around you, all with just that one mic, thanks to clever gestural recognition.

Bruno Zamborlin has made that idea a reality, with hold-onto-your-chair results. It’s not available yet for public consumption, but it’s coming.

Bruno explains to CDM:

Mogees is a novel way for transforming any surface into a musical instrument.

By putting a (very cheap) contact microphone over a surface, the software can recognise different types of touch and associate them with different synthesisers.

Users can train the software with their own ‘gestures’, using both bare hands and objects. In the video demo we put the microphone over different surfaces such as kitchen tables and balloons.

The sound synthesis is based on two different techniques:

1 – physical modeling, which consists in generating the sound by simulating physical laws. Different materials can be simulated, such as membranes, strings, tubes and plates

2 – mosaicing, that works as follow: first, users load a sound folder; then, the noise coming from the microphone is analysed and the software continuously finds and plays its closest segment within the sound folder.

Mogees has not been realised yet. It could be published as Max4Live patch in some month.

Yes, we’ll be watching for future versions and publication, with bated breath and eager hands.

http://www.brunozamborlin.com/mogees

Update: Readers point to similar earlier work; obviously, contact mics have long been readily available. I’m not always concerned with whether something is new or not – old and cool can be cool. But what does appear to be new here is the additional gestural analysis to work more accurately with location. That takes an existing technique and refines its musicality. -PK

LA-based bang Fol Chen (Asthmatic Kitty records) wanted to go beyond the computer as the playback and manipulation device for their music. So they worked with collaborators to invent a solution. In a new video, sounds, and an interview, we can share some of how this came into being.

Built with the monome creators (Brian Crabtree and Kelli Cain) and LA research and experimentation center Machine Project, the Tetrafol is a custom, pyramidal sound device. The object warps Fol Chen’s music using gestural manipulation of playback, but can also use your own samples. And with open-source circuit and firmware, the project could be an opportunity to learn or to build your own creation.

Description:

The Tetrafol is a hand-held tangible electronic sound toy. Circuits enclosed by a wooden tetrahedron detect orientation and motion-gestures to modify the playback of a collection of Fol Chen’s micro-compositions, allowing the user to explore sound through physical manipulation.

The battery-powered device has its own internal speaker but can additionally be hooked up to a headphone or amplifier.

The circuit and firmware are based on open-source hardware and is itself published as open-source, allowing anyone interested to learn about its deepest inner-workings.

Here’s a sample of the project, via the Tetrafol-created Fol Chen track “So Good”:
Fol Chen – So Good by WeGetPress

Built by hand in a limited run of 100, the device sells for US$110 direct from Machine Project. We spoke to monome’s Brian Crabtree about the project – and a new, comically-inclined video shows off the project.

Stems from the track “Back on Kent” come preloaded:
Fol Chen, “Back on Kent” by asthmatickitty

CDM: How did this collaboration come about? How did you work together?

brian: kelli and i have a loving and working relationship with machineproject, a phenomenal organization founded by our good friend mark allen. we’re always amazed at the fantastical variety of projects that are born there. a few inspiring works of recent include a cash machine designed for a children’s museum and a workshop on lockpicking. so when mark approached us on behalf of his good friend adam goldman and adam’s band fol chen regarding a possible collaboration we were all ears. the goal was to design and produce some sort of synthesizer-sampler-effect-instrument-toy-object to accompany the release of their new album. that was about a year ago and we’re happy to see it finalized and soon in playful hands.

in the early stages there was much whittling of ideas (too expensive, too complicated, etc). we arrived at some sort of gestural sample player and a demo video was ready to show the proof of concept (we live on opposite coasts so there was much back and forth through internets and mails) the basic build used a waveshield (by adafruit) and an arduino and some very hacky code i modified.

fol chen provided the sound set. kelli and i proposed a series of enclosures– diamonds, stars, ice cream cones, d20. the tetrahedron ended up being the most beautifully minimal, and incidentally the most cost effective. our friend jason voytilla laser cut a prototype from thin birch ply and we sent the “finished” sample to california where it underwent a series of intense focus groups – thanks to the rigorous machineproject laboratories. after more back and forth, and basic design changes here and there we were in agreement. we used our very reliable production chain that we depend on for monome releases… it was nice really helpful to have that all in place and sped up the process considerably.

the tetrafol accompanies the release of some exciting new fol chen tracks, and there will be a release party of sorts in early december at machineproject. should be very interesting, as the current installation is a 30 foot deep window sill of sorts.

What went into the design? The construction of the thing?

the final circuit board is an arduino, [Lady Ada - Limor Fried] waveshield, and accelerometer smashed together and made very small. i really just put existing technologies together– i can’t take a lot of credit here.

the industrial design was more fun. we didn’t want to use plastic so we experimented with felt and wood. coming up with a size, shape, and feel were the main goals- to create something that was pleasant to hold and sturdy enough to be tossed in the air.

What’s the basic notion of the instrument?

it plays sound loops, or “micro-compositions” written by fol chen. when you pick up and tilt the device it modifies playback: in one axis it changes the playback speed, in the other it triggers a variable-speed stutter (playback position jump). sounds are changed by a shaking motion. given the response is immediate, it comes alive very quickly.

i’d also hesitate to endorse it as an Instrument, though it’s very playable. it’s a bit like a responsive buddha box.

Any other documentation?

i posted the firmware/hardware source on github. there is a no “build your own” guide as you’d be much better off just looking at the waveshield documentation (which is very good.)

this was a fun collaborative side project– and it makes me even more curious to see how musicians continue to create tangible objects to accompany their releases.

More information:
folchen.com

Tetrafol @ GitHub (firmware + hardware, under a GPL v3 license)

When we last saw Onyx Ashanti, he was speaking of a grand vision to remake himself into a music-performing Tron. Now, the elements of that vision are coming together, with a crowd-sourced funding campaign that ends today, Friday. Update: Apparently after seeing this story, IndieGogo extended the funding deadline for five days, with the new deadline Thursday, December 1.

I knew Onyx back when he was playing more conventional wind controllers. Now, that fingering arrangement is freed from the virtual wind instrument, handheld and movable through space. Because of the plans to open source everything he’s making, you might yourself pick up that hand controller – or, if you’re like Onyx, go full-tilt with physical training to make your body do new things and a carbon fire, full-body prosthetic transformation.

Onyx has been at auditions for the main TED (the big one, not TEDx), experimenting with a beatbox configuration, and honing alien-like futuristic human reinvention with the help of artist Christopher Logan, aka Loganic. Loganic makes the art, then prosthetic engineer Uli Maier – with doses of carbon fiber – translates those notions into physical form. And the whole thing is mobile; Onyx draws on his busking background to take this thing wherever he goes.

Initially built as an open/proprietary hybrid, the new system is increasingly open source from the ground up, from customized Linux-based software to Pure Data (Pd) patches to open source designs for the molds. The wearable system can be 3D printed. Plans for the system also were featured in Make Magazine.

It’s actually quite a lot to digest, but Onyx has been posting videos, the most recent and illustrative of which I’ve included here. And because there’s a lot to do physically, from personal training to buying clay to engineering the prosthetics, Onyx is relying on crowd-sourced funding. In place of Kickstarter, which has specific requirements for minimum funding and other restrictions and requires US-based banking, he’s opted for IndieGogo.

If you invest just a few dollars, you at least get music; with successively larger donations, Onyx throws in his software, custom artwork and posters, t-shirts, or starting at US$500, the custom hardware itself for your use.

The IndieGogo campaign ends Thursday, December 1:
IndieGogo: Beatjazz System

– but we’ll be in touch with Onyx on an ongoing basis, so let me know if you have questions for him or want to watch this continue to evolve.

Videos showing the making of the elements of the system:

Above: New visualizations in 3D have vastly expanded the now-Pure-Data-based audio system with heads-up displays worthy of the spacesuit. Below: Some of the beautiful concept artwork produced for the project.

IndieGogo Campaign

Previously: Onyx Wants to Make Himself Into Helmeted, Wearable-Music-Tech Tron, With Your Help

Compare the complex model of what a computer can use to control sound and musical pattern in real-time to the visualization. You see knobs, you see faders that resemble mixers, you see grids, you see – bizarrely – representations of old piano rolls. The accumulated ephemera of old hardware, while useful, can be quickly overwhelmed by a complex musical creation, or visually can fail to show the musical ideas that form a larger piece. You can employ notation, derived originally from instructions for plainsong chant and scrawled for individual musicians – and quickly discover how inadequate it is for the language of sound shaping in the computer.

Or, you can enter a wild, three-dimensional world of exploded geometries, navigated with hand gestures.

Welcome to the sci fi-made-real universe of Portland-based Christian Bannister’s subcycle. Combining sophisticated, beautiful visualizations, elegant mode shifts that move from timbre to musical pattern, and two-dimensional and three-dimensional interactions, it’s a complete visualization and interface for live re-composition. A hand gesture can step from one musical section to another, or copy a pattern. Some familiar idioms are here: the grid of notes, a la piano roll, and the light-up array of buttons of the monome. But other ideas are exploded into spatial geometry, so that you can fly through a sound or make a sweeping rectangle or circle represent a filter.

Ingredients, coupling free and open source software with familiar, musician-friendly tools:

• Two projectors
• A monome
• Processing, the elegant and artist-savvy free software for visual code
• Ableton Live and Cycling ’74′s Max for Live, acting as the interactive glue with the sound world
• Drumaxx, Image-Line’s tasty physical-modeled drum synth
• Native Instruments Battery, the sampled drum engine
• Eclipse, the free IDE, for Java coding in this case
• Community Core Vision and reacTIVision (based on our previous info, at least), free and open source community-based projects for making the interfaces you see in movies happen in real life.

Another terrific video, which gets into generating a pattern:

Now, I could say more, but perhaps it’s best to watch the videos. Normally, when you see a demo video with 10 or 11 minutes on the timeline, you might tune out. Here, I predict you’ll be too busy trying to get your jaw off the floor to skip ahead in the timeline.

At the same time, to me this kind of visualization of music opens a very, very wide door to new audiovisual exploration. Christian’s eye-popping work is the result of countless decisions – which visualization to use, which sound to use, which interaction to devise, which combination of interfaces, of instruments – and, most importantly, what kind of music. Any one of those decisions represents a branch that could lead elsewhere. If I’m right – and I dearly hope I am – we’re seeing the first future echoes of a vast, expanding audiovisual universe yet unseen.

Previously:
Subcycle: Multitouch Sound Crunching with Gestures, 3D Waveforms

And lots more info on the blog for the project:
http://www.subcycle.org/

I love this controller, but I think we should keep it Platonic. Solid.

Sorry, geometry humor. See, the controller in question is constructed as a convex regular polyhedron, such that all its faces are themselves congruent regular polygons meeting at each vertex, and … uh, never mind.

Above, a stunningly gorgeous video from Polish media art group panGenerator, with some lovely chiming music following by the evidently-now-requisite dubstep demo. (Tip all of us could use, guys and gals – makeup. Styling. Now, they just need some post-production so you can’t see the IR sensors or the wires.)

Hedoco, also based in Poland, is the manufacturing and distribution partner, and donated this prototype. I love their stated philsoophy: “a unique brand that connects two trends: open source design and fashion.”

No, seriously. And, seriously, why not?

The controller itself looks actually quite lovely – and it’s open source hardware, too, from top to bottom. MIT license for the source, Creative Commons for everything else. (One trick: by choosing “Non-Commercial,” they don’t technically qualify under the Open Sound Hardware Definition. I’d suggest keeping the ShareAlike, since any commercial user would have to share modifications. I know not all designers are comfortable with that, though.)

Designer Jakub Koźniewski and whole team of panGenerator, seen in these parts building a kinetic sound organ out of cans, is behind this project, too. Ingredients:

• Bluetooth. (The revolution will not have wires.)
• Infrared distance sensors. (Though if you know what those are, you already knew that.)
• Arduino, the open source hardware prototyping platform.
• Processing. (Whatever. No one cool uses that any more.)
• OpenSoundControl.

Source code is available now on GitHub, with hardware schematics coming soon. And that could lead to an all dodecahedronal music festival. You may recall the work of Ted Hayes, whose Neurohedron has the same shape. Ted’s work, by contrast, works with a drum sequencer — meaning these two could even play onstage together. Ted and Jakub each tell us that’s coincidence, and when Jakub did realize the form had been taken, the two connected. Now I say we just need more. Dodecahedronstock. Polyhedrapolaooza. Platonaroo. Euclid Fair. Let’s make it happen.

On Ted’s Neurohedron side, he tells us that his work, featured at a Handmade Music event I produced in New York as well as at NIME, has gotten significant updates, so we look forward to seeing that. Previously:

Pretty, Nodal, Non-Linear Music, on iPad + iPhone and Big Dodecahedrons

Handmade Music NY 8/29: Meet the Musical Inventors, Pong to Dodecahedrons

More:

http://www.pangenerator.com/

http://www.hedoco.com/

You might imagine sound in space, or dream up gestures that traverse unexplored sonic territory. But actually building it is another matter. Kinect – following a long line of computer vision applications and spatial sensors – lets movement and gestures produce sound. The challenge of such instruments has long been that learning to play them is tough without tactile feedback. Thereminists learn their instrument through a the extremely-precise sensing of their instrument and sonic feedback.

In AHNE (Audio-Haptic Navigation Environment), sonic feedback is essential, but so, too, is feel. Haptic vibration lets you know as you approach sounds — essential, as they’re invisible. The work of Finland-based DJ/VJ Matti Niinimäki, aka MÅNSTERI (“Mons-te-ri”), the project is part of research undertaken at SOPI Research Group at Media Lab Helsinki. Like some sort of sound sorcerer, the user is entirely dependent on movement, feel, and sound as they move unseen sound sources through space. (More technical details below.)

It’s labeled, as always, “proof of concept.” The creator promises more videos to come; we’ll be watching as this evolves, as it looks terribly promising.

Below, “Tension” is a fair bit simpler, in which users walk through a space and control synth parameters. (“You are the knob,” one might say, though I don’t suggest shouting that at someone you don’t know. They could take it the wrong way.)

More descriptions:

AHNE

This is a demonstration video of AHNE – Audio-Haptic Navigation Environment.

It is an audio-haptic user interface that allows the user to locate and manipulate sound objects in 3d space with the help of audio-haptic feedback.

The user is tracked with a Kinect sensor using the OpenNI framework and OSCeleton (github.com/​Sensebloom/​OSCeleton).

The user wears a glove that is embedded with sensors and a small vibration motor for the haptic feedback.

This is just the first proof-of-concept demo. More videos coming soon.

HEI Project 2011
SOPI Research Group
sopi.media.taik.fi/

Aalto University School of Art and Design

AHNE – Sound and Physical Interaction

Tension

A brief video showing Tension. An interactive spatial sound installation for multiple users.

A person enters the space and a generative sound is assigned to that person. The sound pans around in the 6-channel speaker system following the user in the space.

Up to 5 users can use the installation at the same time. Each person modifies the other sounds based on the distance to the other users. The closer you are to other people the more the tension in the sound increases.

Tension – Sound and Physical Interaction

Side note: watching these two videos makes me want to consult with someone on non-verbal expression, posture, and stage presence. That criticism is mounted at myself – I could use it. Perhaps we need an all-physical, unplugged music event for laptopists, controllerists, and electronic musicians. And I can at least say I’ve had some experience in this, working in the dance program at my undergraduate alma mater, Sarah Lawrence. Anyone game? (Sounds like something we could do while CDM is in Berlin in the fall.)

For their part, the Finnish research facility is working with dancers, along with Nokia Research Center. (Sadly, I can’t find documentation.) But I think interesting things happen when us non-dancers learn movement technique, too.

While we’re on the subject of making music with Kinect, the 3D computer vision camera with depth-sensing, here are some other experiments into how music might work. As with the classic Theremin, those musical gestures tend to be mapped against two-dimensional axes in space.

And from there, things become wide open. Johannes Kreidler, a musician and artist known for irreverent and inventive experiments in music, shares his studies for the Kinect, which he terms “conceptual music.” A solo “for violin” can involve literally waving a violin around. “House music” can mean making music whilst ironing a shirt. Any gesture in space becomes musical. Without tangible feedback, that can be challenging, and since these are just gestures in air, precision and nuance may not be a strong suit. But it’s a fascinating look into what’s possible, a set of thought experiments in music with a camera.

Composer Johannes Kreidler’s other works have included provocative ideas like making a performance of a short piece with 70,200 quotations of other “sampled” works, tunes from wildly-gyrating stock market quotes, entire bodies of work (like the Beatles) compressed into seconds, and pieces from avant-garde happenings to more conventional electro-acoustic scores. See his site for more.

And he’s got a killer book on using Pd, too.

It’s hard to assemble an April Fool’s Joke involving technology these days, because actual inventions keep proving stranger than fiction. When Google created a prank involving gestures for controlling email, it was only a matter of time before someone whipped up a prototype that actually did the job.

The Moog Music company, therefore, may be asking for trouble. Their highly-entertaining polyphonic Theremin is spot-on parody, down to the “Stairway to Heaven” solo. And part of the geekier joke for Theremin players is the knowledge that the technology behind this instrument makes what they’re describing safely impossible.

But what’s impossible with conventional Theremin technology could be very possible with computer vision – even the goofy gestures in Moog’s faked video. Artist, inventor, and musician Tim Thompson has been at the bleeding edge of new music instruments for some time. It wouldn’t be overstatement to say Tim was using multi-touch before multi-touch was cool. When I shared a booth with him at Maker Faire a few years ago, he had with him FingerWorks hardware, a now-discontinued tactile, multi-touch pad, and was using it to play visuals live. In a pattern too often repeated in technology, the independent niche tool was snapped up by a larger player. In this case, that larger player was Apple – and, apparently backed at least in part by FingerWorks’ know-how and patents, Apple made history.

In a new project filmed by the superb Modulate This!, Tim works instead with touch-less control, using the Kinect to track multiple areas of expression. (Tim is using the free environment Cinder, which joins tools like Processing and OpenFrameworks as well-liked options for Kinect hackers. In this case, the Kinect support itself comes from libfreenect, the open-source drivers for Mac, Windows, and Linux.)

What he’s built, in other words, is a true polyphonic Theremin – able to play more than one line and employ more than a monophonic gesture, all without touch. The joke may be on Moog.

Read the full story on Modulate This, Mark Mosher’s all-original repository for great writing on music making.
An Exclusive First Look at Tim Thompson’s Kinect-Based Instrument: MultiMultiTouchTouch
(Thanks to Tim and Roger Linn for sending this my way!)

Part of the value of trying extreme ideas is to demonstrate not only advantages, but disadvantages. And I still find some reason to express healthy skepticism. The similarity to the Theremin isn’t accidental in the Kinect experiments. These projects also inherit the Theremin’s weaknesses. A lack of tactile feedback means it’s difficult to orient pitch or achieve precise control, without the resistance a physical object provides. Reliance on gestural control also opens the opportunity for accidental input and calibration challenges. (The Kinect fares better than the Theremin, but it’s not immune to similar problems, if for different reasons.) Taking a page from the Theremin, Tim’s physical frame makes a big difference – while it doesn’t provide tactile resistance, it at least creates a point of reference in physical space.

The Kinect also adds a new problem the Theremin didn’t face: latency. All of this means if you still like knobs, keys, strings, or even physical multi-touch (which can in certain variations provide excellent tactile feedback via deformable meshes), you needn’t worry. Your revolution may not be Kinect-ified.

But if there were one perfect design for musical instruments, we’d all play just one instrument. Instead, the history of instrument design across the world is an evolutionary explosion of different tradeoffs, different playing styles, and resulting different musical idioms. Any joke can become an instrument, just as any instrument – to someone – can seem like a joke. And that means if you’re looking for something new, you might just celebrate every day as if it’s April Fool’s Day. No kidding.

Updated: Tim offers some comments. He says what other musicians experimenting with Kinect have told me – that while it has certain restrictions as a solo instrumental controller, there’s tremendous potential for multi-user scenarios like installations. And that is itself significant (back to the question of choosing tradeoffs in order to accomplish goals). Tim writes:

Folks whose goal is to replace conventional instruments are sure to be disappointed, as you describe. You could add more detail on other goals:

Goal: using it for art installations at events like Burning Man, creating new and “casual” instruments which are unusual yet inviting and easy to play. Matt Bell ran an experiment related to that goal: http://www.youtube.com/watch?v=mQiyKFDvzkU

Goal: creating controllers which have a much larger visual appeal to an audience, who deserve performers more interesting to look at than someone hunched over buttons and sliders. That’s the reason why musicians like Mark Mosher are interested, in the same way he’s interested in the Percussa Audiocubes, for their visual appeal in performances.

Goal: provide an instrument that dancers can use in performances. I’ll be exploring this in the fall, with a choreographer friend.

Good food for thought; feel free to discuss more in comments.

Nearly as long as we’ve had electronics, musical inventors have tried to imagine new electronic instruments. In the crowded world of new instrument design, the Margaret Guthman Musical Instrument Competition has emerged as a key prize for the best work, with creations battling fiercely for attention.

But in the oddball world of sound and music, how do you judge a winner? As a starting point, organizers this year asked the judges what they personally found important. With an expert panel including synth pioneer Tom Oberheim and reacTable creator Sergi Jorda, those answers are themselves revealing.

As for the competitors themselves, even with eclectic entrants, one theme stands out. Human gesture and performance presence is a strong dimension of the winners. And in perhaps the most promising first-prize winner yet, research begins to crack the code of how to make real gestural analysis work, even allowing everyday objects to become musical instruments.

To help us learn more, Competition founder and Georgia Tech Music Technology director Gil Weinberg grants CDM a window into the philosophy of some of these leading technologists, and introduces us to this year’s winners.

The Winners

First Prize: MO, Interlude Consortium. Everyday objects become novel gestural interfaces.

From the project site:

The MO tangible interfaces are a series modules to capture various gestures, from motion to touch. The central module MO contains motion sensors (3D accelerometers and 3axis gyroscopes) and transmits the data wirelessly. Moreover, two accesorries, i.e. other sensors can be added to both side of MO.

Second Prize: MindBox Media Slot Machine, Humatic Berlin. A vintage slot machine is transformed into a compositional interface.

Personnel:

Christian Graupner , Humatic
….media artist, director, composer

Roberto Zappalà
… performer, choreographer

Norbert Schnell, IRCAM — Centre Pompidou
… interactive music & sound design

Nils Peters, Humatic
…system developer and software artist.

Third Prize: Samchillian Tip Tip Tip Cheeepeeeee, Leon Gruenbaum. It began as an ergonomic computer keyboard, but years of layered work on relative pitch makes it an instrument – a bit like a macro keyboard for composition.

Honorable Mention: Hexenkessel, Jacob Sello. A conventional acoustic timpani is both projection surface and multi-touch input.

From the creator’s description on the video:

The Hexenkessel is a modded 22″ timpani using LLP multitouch technology for control of live-electronics & dmx-light. the realisation of the instrument involves a modified led-projector, webcam and IR-Lasers. the programming is done entirely using max/MSP/Jitter + CCV. The instrument-hack is non-destructive and costs less than 300$.The instrument is intended for the use in multimedial stage performances and innovative concepts of new music.

Pioneering Judges Offer Their Philosophies

A musical instrument design may seem like subjectivity atop more subjectivity, a meeting of the aesthetic of the object with personal musical expression. Judges were asked, therefore, to describe the philosophy they brought to the contest. The reason, explains organizer Weinberg: “To steer it away from general statements – this is the better instrument than this – to make it more personal, about the judge’s opinion and artistic manifesto and instrumental manifesto.”

Tom Oberheim, the man who created the first polyphonic synth product, responded:

The first thing that I look for in a new musical instrument is its musicality. This means where appropriate: does is sound good, is it playable, does it add to the music making language. Then I consider if the device has some sort of universality; in other words, can it be used by a variety of musicians from different backgrounds. Finally, I consider the ease with which the device can be learned.

Sergi Jorda, creator of the reacTable tangible interface:

The ultimate goal for any new instrument could arguably be the potential to create a new kind of music. In that sense, baroque music cannot be imagined without the advances of sixteenth- and seventeenth-century luthiers, rock could not exist without the electric guitar, and jazz or hip-hop, without the redefinitions of the saxophone and the turntable. Yet, this extremely ambitious objective is often beyond the reach of its creator (eighty years separate Adolphe Sax from Coleman Hawkins, and no less than thirty go by between Les Paul and Jimi Hendrix). Being a bit more pragmatic, as a performer, my goal when constructing the instruments I will play is clear. I need instruments that are enjoyable to play and that mutually enhance the experience when playing with other musicians. Thereby allowing me to create or co-create music that will surprise me as much as possible, that will keep revealing little hidden secrets at every new performance. Music not necessarily better, nor worse, than a piece that I could compose in a studio, but music, in essence, that could not have been created in any other possible way. As a ‘professional’ luthier, I need to take some additional considerations into account, but the overall goals do not change: my aim is to create instruments which people can enjoy playing; instruments that will be able to enrich and mature the performers’ experiences in any imaginable way; instruments that allow scope for the performer (particularly in the case of a non-expert user) to be proud of the music created. In order to survive in the extremely demanding instrumental ecosystem, any new instrument should clearly excel in something. It should either be able to do one thing that no other instrument could or, at least it should do it better (whatever this can be and whatever “better” may mean). My last advice would be that when envisaging new instruments one should not only concentrate on the instruments’ sonic capabilities, on their algorithmic power or on the amount of sensors used. One should also be especially careful about the instruments’ conceptual capabilities, and consider how new instruments impose or suggest new ways of thinking to the player, as well as new ways of establishing relationships, new ways of interacting, new ways of organizing time and textures; new ways of playing, in short.

Jason Freeman, a composer, technologist, and Assistant Professor at Georgia Tech:

For me, new musical instruments are significant for their potential to transform our experiences with music. They may enable us to create new acoustic or electronic sounds not previously possible. They may encourage us to think about musical content, structure, and hierarchy in unusual ways. They may suggest new methods of musical collaboration, performance, or education. And they may make musical creativity more accessible to everyone. I am interested in instrument makers who have thought deeply about their work from technical, musical, and design perspectives to create musical instruments that transcend novelty to suggest new paradigms for musical creativity.

A Chat with the Organizer

Now in its third year, the Guthman competition has become a coveted award. As a result, says organizer Weinberg, who is director of the hosting Georgia Tech Center for Music Technology, quality and quantity were up in entrants. And, he says, he feels that entrants have transcended some of the typical designs in the field.

“New interfaces for many [means], let’s think about an object that we didn’t use before, and some kind of gesture, stick on some sensors, make some music … But I think the winners of our competition were outside of this realm, really innovative, completely new approaches for playing music,” he says.

On the prize-winning MO tangible interface:

In a section of the performance, they took a ball – a soccer ball – and did some [musical] gestures with it, threw it … moved it … on the hands, on the floor. Each one of these gestures was recorded with the gesture recognition. And then they actually threw the ball to the audience. The audience members started to throw the ball back and forth. If you threw it in a particular way, it made a particular sound — and everything’s wireless, completely — if you threw it back and forth in a different way, it made a different sound. It was really fun; people threw the ball at each other, threw the ball back at the stage. And all made music that was pretty cool to listen to.

Basically, the instrument becomes an intelligent entity. It can sense similar but different gestures and create something smart and relevant musically.

On the slot machine:

The gesture is mostly visual — the intelligence here is of the human performer. He makes his own gestures, accompanied by sounds. And it allows you to manipulate and change [the sound] — and get some surprises, because it is a slot machine, after all.

You can play, explore it. He was able to very expressively pet and touch and click and manipulate the slot machine to create some very nice — not only musical outcomes, but visual outcomes. In some cases, this guy is lying in the sea and making gestures in the sea. Sometimes he’s hanging stuff on the walls, and making sounds with his mouth. Sometimes it’s basic stuff that you can manipulate in real time, with a pretty unique interface — it’s not a monome, it’s a slot machine. It surprises you.

On the Samchillian:

Some instruments – controllers – have this short or sometimes long learning curve, but once you get to a certain point, you know it, and that’s what it can do. And you cannot get better at it. I think the Samchillian is really an instrument with a learning curve that’s very long, and just like other acoustic instruments, violin, piano, there’s a wide range of [technique]. And this guy was really a virtuoso with this instrument. He was able to play chords, all kinds of arpeggiators.

What I liked about it is it’s an instrument more than a controller. There’s always more to learn about how to become better with it. And I think that’s valuable.

Notably, Weinberg has no illusions about the challenge of making new instruments. It’s no accident that the winners were typically the result of years of development and evolution. “I don’t think any of the great instruments were invented in months,” says Weinberg. “It’s a lot of iteration, a lot of building… only a few are good enough to stick.”

And perhaps the great electronic instrument, while getting nearer, hasn’t yet been created. Weinberg says one example of a new instrument design that doesn’t work particularly well is the legendary Theremin – it’s beautiful in the hands of only a couple of artists, but generally a design that stumps musicians and is hard to play.

Looking at the winners this year, though, there are ideas on which new work can be built, not just impressive one-off instruments but real research into handling pitch and gesture. That, at least, should present a bright future. But with the competition heating up, aspiring engineers may want to get started on those designs now.

Thoughts? Questions about the work? Let us know.

More on the MO tangible interfaces from the IRCAM-based Interlude:
MO Interfaces

That work isn’t yet available for download, but an “augmented score viewer” is.