Composing the sounds of an animal’s life cycle and ultimate consumption into a musical portrait, Matthew Herbert’s “One Pig” is in turns grotesque and sentimental, rock and opera. I expected squeamishness and vegetarian conversions when I saw it on tour, but instead, the crowd eagerly devoured the creature at the end. (Make of that what you will.)

One Pig is in Manchester, UK tonight before continuing to Brighton and Portugal.

As my own incurable appetite is for musical instruments, for me a highlight of the show is Scotland-based, American artist Yann Seznec’s Sty Harp. (See also our coverage of his iPad music game development work.) Gut strings in historical instruments already make use of animal parts, so a stringed instruments seems appropriate. But by dissecting obsolete, forgotten technology – a bit of a theme in these parts lately – Yann is able to make an effective, expressive instrument.

Sadly, there’s not much video of the instrument in action, but seeing it is a highlight of the live show. Yann’s performance has its own theatricality, rocking out on these extended strings around the “pig pen” like a boxer swinging against the ropes of a ring. First, Yann shares some notes on the show itself:

The album is an elegy to a life lived for the benefit of humans and raises complex questions about our relationship to these often-maligned and misunderstood creatures.

The album is made entirely out of sounds from the pig and its surroundings – the first squeals, the sound of it being alone for the first time, and the dripping of its blood after being butchered. The result is a delicate, beautiful, and occasionally terrifying musical composition with a profundity rarely heard in electronic music.

The live show debuted at the Royal Opera House, London, in September 2011 and has since toured the world, performing at Berghain Berlin, STRP Eindhoven, Club Silencio Paris, Liquid Room Tokyo, Ancienne Belgique Brussels, and more. Future dates include headlining at Future Everything in Manchester, the Queen Elizabeth Hall in London, Palais de Tokyo in Paris.

The show explores and questions the life, death, and consumption of the pig. A chef cooking onstage brings the sound and smell of cooking pig, and the performance features a brand new custom instrument – the “Sty Harp”, built and performed by Edinburgh-based artist Yann Seznec. This representation of the pig’s home is used to trigger and control elements of music, forming an integral part of the 5 piece band. The rest of the band is comprised of Sam Beste on keyboards, Tom Skinner on SPDS, Hugh Jones on samplers, and Matthew on various keyboards and samples and things.

Yann explains how the instrument itself is constructed:

In terms of the Sty Harp, the instrument is built using hacked Gametraks, which were a failed proto-motion controller from around 2003. They were sold only in the UK, and worked by using two joysticks with strings attached that you clipped onto your hands. These could then sense the distance and vague location of your hands …a few terrible games were released on PS2, Xbox, and PC for the Gametrak before they were pulled from the market.

In any case, I took apart a whole load of these (I probably have owned more gametraks than anyone in the world, ever) and used their innards for the string/joystick controllers, which are totally great! I built a whole system with Jon (from Lucky Frame) to hook up twelve of these controllers into my computer at once. I’m using an Arduino with a mux shield to handle the 36 analog inputs (x/y/string for 12 controllers) at once, converting them into MIDI and sending them over to Ableton.

In Ableton the controllers are doing a number of different things, slightly different for each song. In the Max patch I made I can send out 5 individual MIDI notes from each string, one for general movement above a threshold, and one each for a push, pull, up, or down movement. These movements are also sending out CC values, as is the pulling of the string. So each string controller is sending a whole pile of MIDI data at all times, and I pick and choose for each song which gestures to use. So in some cases I’m just triggering individual sounds using the strings, but in others I am using some strings to trigger clips, others to control effects on those clips, and still other effects to do master play/stop/effects/etc.

The climax of the Sty Harp happens about 2/3rds of the way through the show, when the whole band joins me in the sty for the symbolic butchering of the pig. For that song each band member controls different strings, building a huge sound wall.

You can read more about my building of the sty harp here: http://theamazingrolo.net/styharp/

We’re playing in Manchester on Friday the 18th, Brighton on Monday the 21st, then in Lisbon on June 29th and Porto on June 30th.

http://www.matthewherbert.com/
Matthew Herbert – One Pig: exclusive album stream [The Guardian]

“On lead synthesizer, a philodendron …” (And the crowd goes wild…)

Vegetation may not be the first association you have when thinking of electronic music. But two new albums, each released via Bandcamp, celebrate biological life of the green, leafy variety. One is a benefit compilation, with proceeds going to help trees and music inspired by that green goodness. The other uses plants as “performers,” generating its form from plant life in an installation and extended “live” release.

It seems a fitting time to think about trees and plants, as those of us in the Northern Hemisphere see the coming of summer. As I write this, outside my home office’s window, everything has become a calming canopy of maple leaves. And so, just as those trees have a chilling, soothing emotional impact, I confess that this is all really enjoyable music, gimmicks aside. The tree-themed compilation is not a bunch of aimless Earthy music; the plants are not, as you might assume, screechy noise. Instead, you get two full-length albums of terrific-quality ambient music.

Each also works to plant something living – literally. “Take to the Trees,” a compilation for Arbor Day, directs proceeds from sales to the Arbor Day Foundation for conservation and education. That means money from the release could protect and plant trees. The Data Garden Quartet is more literal: embracing the idea of “plantable music,” the ephemeral digital download code is printed on paper that can grow. For instance, on the recent “Cheap Dinosaurs” release, you get “hand-made seed paper with screen-printed album art and download code on reverse side.”

Download Cheap Dinosaurs, plant this art under a thin layer of soil in full sun to partial shade and add water. With proper care, blue lobelias will begin sprouting in the first two weeks and finally begin blooming about 4 weeks later.

Released on Sound for Good, a benefit label, “Take to the Trees” gives you four hours of music for a minimum of just US$1. The collection is eclectic, spanning fairly traditional ambient music to beats, breaks, and experiments. Some tracks sound influenced by the cadence of traditional Japanese music or Tibetan meditation. They evoke impressions of trees and forests, but often via electronic (even traditional analog) timbres, recalling the sensation of trees and experience as much as painting those scenes directly. There are epic, sprawling tracks and more compact, rhythmic compositions. Sometimes nature itself sneaks in, in jungles and mountain sojourns. More often, warm, fuzzy electronic pads glow like sunlight. Many, many artists participate, going far beyond the San Francisco scene, including our friend, technologist, blogger, and musician Mark Mosher. Jack Hertz, also a prolific blogger and performer, heads up the comp.

Artists:

John Koch-Northrup, Ian Boddy, Burning Artist, Chromasonic, Crystal Dreams, Todd Fletcher, Groupthink, HG Fortune and Inner Dreamer, inside/ outside, Oskar Menzel, Joe McMahon, Mesawzee Eagle, Mirada, Shane Morris, Mark Mosher, Mystified, redgreenblue, John Sherwood, Symatic Star and Tange.

http://sound4good.bandcamp.com/

If “Take to the Trees” is hours of human playing and human experience recalling the feeling of plant life, “Data Garden Quartet” turns to the plants to “generate” the score, in nearly two hours of extended listening. Blending minimalism and ambience, the product is a wash of sound, with waves of timbres crested by gentle buzzes, glitches, and hums, all in extended rhythms and cycles (sometimes recalling nothing so much as the occasional stroke of a Javanese gong).

The project looks to make natural phenomena audible, “information which we cannot perceive through our biological senses”:

The musical compositions you are about to listen to were generated by the electronic impulses produced by four tropical plants. This data, interpreted by humans with the help of computers, has been employed to organize sound into beauty perceivable by the human ear. While the means of producing this beauty can be described in technical terms, the natural creative force generating this experience is less apparent.

These 116 minutes were recorded during an installation at the Philadelphia Museum of Art in April, in a “quartet” of a philodendron, two schefflera plants, and a snake plant. (Images here are from that exhibition.) The team:

Sam Cusumano: electronics
Joe Patitucci: sound design
Alex Tyson: production, graphic design

More images, though I think my favorite of all is the wonder of the gawking young girl. It’s too easy for us to become jaded, and forget, sometimes, the magic of the things we make.

Quartet: Live at The Philadelphia Museum of Art [datagarden.org]
http://datagarden.org/about/

Data Garden also do an interview with Abigail Bruley for Creators Project:
Interacting With Plants To Create Polyphonic Music

If you’re dreaming of creating your own controller from scratch, there are certain basic elements you’ll need – and a strong case for reusing, not reinventing, the wheel. There are a range of products out there that cater to you DIYers; Livid’s Builder line is certainly one of the most comprehensive. It’s a line of hardware accessories that help you piece together MIDI controllers with all the requisite knobs and buttons and sensors you might like, and its brain just got an upgrade.

The soul of any controller is the electronics and microcontroller that read all of those inputs and let them talk to a computer. And it’s that “brain” that Livid recently upgraded, with their Builder Brain v2. Messages from controls go in, messages to devices like lights go out, all via a connection to your computer that’s USB powered, class-compliant MIDI. (That means you won’t need any drivers – not on Mac, not on Windows, and not on Linux. You could even plug this into one of those Raspberry Pi devices, if you’re lucky enough to have one!) They also operate standalone with a 5V power supply.

The Brain v2 is for some seriously large and complex controllers, with support for up to 64 analog inputs, 128 Buttons, and 192 LEDs. (Fortunately, a companion board called the Omni, and connections via ribbon cables, mean that you won’t create complete spaghetti trying to do that.) In fact, it’s so powerful I’d recommend considering something simpler for less-ambitious projects, but if you’re planning a big controller, it’s tough to beat Livid’s offerings.

New in v2:

• A Bus Board for easier control connections
• LED support up from 48 to 192, extra circuitry for ultra-brights.
• Encoders now work with LED encoder ring support, so you can make a big circle of ultra-bright lights to go around your encoder.
• RGB LED support.
• 5V standalone power is new.

Add those features to cool extras from the original, like accelerometer and velocity-sensitive surface support and programmable MIDI settings.

CDM asks Livid’ Jay Smith to tell us what this is all about.

CDM: Who is this for?

Jay: That’s kind of a loaded question! It’s really for anyone wanting to create a class-complaint MIDI device of their own. An artist, a maker of commercial products, a musician, a visualist? With Brain version 1 we’ve seen a MIDI controlled electric mandolin, Moldover’s Mojo, and The Choppertone to name a few. We’ve also powered some other pretty sophisticated commercial devices for other companies with it, so it’s not just a DIY solution.

With v2 we’ve really expanded the functionality by adding almost any kind of control you’d want to hook up to it, and made the process of doing that much easier. If you are talking about standard MIDI controller type controls, our Omni board support thousands of configurations with just one circuit board. This isn’t just for building “controllers” in terms of software controllers either. We’ve added external power so you can use it to control analog gear and other MIDI controlled devices.

Apart from those examples, what can you build with Builder and the Brain?

Anything that has a button, LEDs, potentiometer, encoder, FSRs, accelerometers, sensors, and more. Single LEDs, RGB LEDs, and “groups” of LEDs of 6,12, or 24 can be created and controlled with one MIDI note or CC or locally controlled with an encoder or pot. As a result, inventive, designs with interesting lighting feedback are possible. VU meters driven by CCs, or a clever array of LEDS that make glyphs or patterns can be arranged with your controls to provide novel, custom feedback that would never make it on Guitar Center’s shelves, but mean something special to you. The omni board provides enough physical limitation that you can think about a “chunk” of a controller and isolates parts of your project into digestible parts, and allows you to sensibly expand and modify your control surface with only 1 brain.

Why would you choose this over another platform?

Frankly there is no other platform for controller building that is this packed with features, well documented and supported, and easy to use. Since the release of Brain v1 three years ago we’ve spent a lot of time listening to our user’s requests, thinking about the features we’d like for our own use, and developing them into a platform for others to use. We didn’t spend much time looking at what else was out there, we looked for what wasn’t and tried to fill in those gaps. When it comes to building your own device, whether for creating music, controlling lights, or something else completely, there are really only other “solutions”, not platforms, which is what we intended to create.

Who is this not for?

If you are looking for an all-in-one solution for your dream controller but don’t want to do any of the labor, this is definitely not for you. We’ve really set out to create the most comprehensive platform that has the smallest learning curve. There are some other great solutions out there, but some of them either have a big learning curve or require programming to achieve results. If you have a smaller project and don’t care about MIDI, the ability to edit, expand, and have a long terms solution, there are certainly cheaper solutions out there. We tried to make the process more streamlined, feature packed, and have taken a lot of the guesswork out of it with Brain v2. With the addition of the Bus Board we’ve added things like resistors, transistors, and chips that make the building process much easier.

Quick start video:

Find out more:
http://lividinstruments.com/hardware_builder.php

“So,” you say, “I’ve got a … and I want to connect it to a … to make music. How do I do that?”

One strong answer to that question, if you’ve got a Mac, is junXion. Developed by the landmark audio research laboratory STEIM – a hotspot in Amsterdam that for years has been imagining new ways of making music by connecting things to other things – it got a big update recently.

It takes lots of the inputs you might imagine (joysticks, mice, touchscreens, MIDI, OpenSoundControl, audio, Arduino-powered hardware and all of its sensors, and video sensing) and connects it to a lot of the outputs you might imagine (using MIDI or OSC). You can set up rules in between the input and output to make that connection musically meaningful.

OSC input and output wasn’t entirely optimal in past versions; a total rewrite now makes it work with useful OSC sources like the iOS TouchOSC and Lemur apps. You get nifty new Actions, like remote mouse control. You can use a Nintendo Wii “Wiimote”‘s infrared-sesnsing capabilities and vibration support. If you’re using video, you can now support multiple “blobs.” And the whole app promises to run faster and look better, with more help tags in the UI, and added stability.

75 € for the full version. You need Mac OS X 10.5 or later, including the latest 10.7 Lion. (Upgrades for version 4 are free; Lite users can upgrade for 60 €.)

http://steim.org/product/junxion/

Of course, talking about this doesn’t really make much sense; it’s better to see it in action. We have a whole bunch of videos from the folks at STEIM showing features like Wii and joystick control and video sensing from a camera – plus a couple of fascinating demo/tutorials submitted by users.

Let’s watch, shall we?

Via https://vimeo.com/steim/videos

Far from the walls of STEIM, though, intrepid users have concocted their own demos. Here’s a look at controlling Reason with a Wiimote:

Here’s a live performance, also controlled by Wiimote, in the modular live environment AudioMulch. The creator writes:

A basic soundscape in AudioMulch controlled by two Wii remotes via JunXion IV.

Buttons in Wii Remotes control: start and stop buttons, presets of the main mixer, transient parameter of the granulator, frequency of the pulsecomb_1 (processing the drum), a junxion-timer controlling the volume of the granulator.

X-Y-Z accelerators control: 10 harmonics of a frequency generator, parameters of the rissettone

And yes, a camera can be a Theremin:

Got your own solution using junXion – or another tool? We’d love to hear about it.

See also two fine Mac-only tools:
Osculator [Much like junXion, supports nearly anything as an input, adds advanced OSC routing]
ControllerMate [not music-specific, but very powerful modular game input utility]

In fact, what’s largely missing is easy solutions on Windows and Linux, though you can roll your own with a free tool like Pd, which also supports HID, Arduino, video, and the like.

What if your musical instrument were gelatinous? Edible?

“Noisy Jelly” is the latest project to imagine that scenario. Thanks to the capacitive quality of gelatin (known to us Americans by the brand name JELL-O and to some simply as “jelly”), you can mix up a set of colored instruments that jiggle when you touch them. Powered by the open hardware platform Arduino to read sensors and Max/MSP to produce sound, it’s the work of a couple of Paris-based students, Raphaël and Marianne Cauvard.

Check out the terrific video featuring wide-eyed children, and specs below.

What makes this more delightful is the possibility that we’ll see orchestras of squishy, organic, edible instruments. NYC Resistor and our friend Ranjit Bhatnagar built their own instrument out of JELL-O (or fruit salad, depending on the iteration). The Gel-tone made a splash (erm, squish) as a more whimsical entry at the Guthman Musical Instrument competition, and was played and eaten at our own Handmade Lounge at Solid Sound Festival in Massachusetts last summer. Hilariously, it debuted at (and was invented for) a JELL-O mold competition. See these couple of videos (Guthman top; Solid Sound bottom) below, and find more information on that instrument:

the resistor jeltone :: an edible toy piano [openMaterials]

How to make your own: The Resistor JelTone (I dearly hope this inspires more copy-cats. Let the gelatinous musical instrument revolution continue!)

More on the Noisy Jelly project:

Note : This project is a fully working prototype made with Arduino and Max/MSP, there are absolut no sound editing in the video…
More picture at this Flickr set
And download the project PDF
Noisy jelly is a game where the player has to cook and shape his own musical material, based on coloured jelly.
With this noisy chemistry lab, the gamer will create his own jelly with water and a few grams of agar agar powder. After added different color, the mix is then pour in the molds. 10 min later, the jelly shape can then be placed on the game board,and by touching the shape, the gamer will activate different sounds.
Technically, the game board is a capacitive sensor, and the variations of the shape and their salt concentration, the distance and the strength of the finger contact are detected and transform into an audio signal.
This object aims to demonstrate that electronic can have a new aesthetic, and be envisaged as a malleable material, which has to be manipulated and experimented.
Author: Raphaël pluvinage (pluvinage.eu and twitter (twitter.com/#!/rpluvina)
& Marianne Cauvard (mariannecauvard.fr)
at L’Ensci Les ateliers (ensci.com)

If you do make your own project, we’d love to see it. Perhaps a gel-orchestra is next.

Several people showed this to me; notably at DE:BUG (Deutsch)
http://de-bug.de/musiktechnik/archives/5820.html

What you’re watching in the video above doesn’t involve cameras or motion sensors. It’s the kind of brain-to-machine, body-to-interaction interface most of us associate with science fiction. And while the technology has made the occasional appearance in unusual, niche commercial applications, it’s poised now to blow wide open for music – open as in free and open source.

Erasing the boundary between contracting a muscle in the bio-physical realm and producing electronic sound in the virtual realm is what Xth Sense is all about. Capturing biological data is all the rage these days, seen primarily in commercial form in products for fitness, but a growing trend in how we might make our computers accessories for our bodies as well as our minds. (Or is that the other way around?) This goes one step further: the biological becomes the interface.

Artist and teacher Marco Donnarumma took first prize with this project in the prestigious Guthman Musical Instrument Competition at Georgia Tech in the US. Born in Italy and based in Edinburgh, Scotland, Marco explains to us how the project works and why he took it up. It should whet your appetite as we await an open release for other musicians and tinkerers to try next month. (By the way, if you’re in the New York City area, Marco will be traveling to the US – a perfect chance to collaborate, meet, or set up a performance or workshop; shout if you’re interested.)

Hypo Chrysos live at Trendelenburg AV Festival, Gijon, Spain, December 2011.

CDM: Tell us a bit about yourself. You’re working across disciplines, so how do you describe what you do?

Marco: People would call me a media and sound artist. I would say what I love is performing, but at the same time, I’m really curious about things. So, most of the time I end up coding my software, developing devices and now even designing wearable tech. Since some years now I work only with free and open source tools and this is naturally reflected in what I do and how I do it. (Or at least I hope so!)

I just got back from Atlanta, US, where the Xth Sense (XS) was awarded the first prize in the Margaret Guthman New Musical Instrument, as what they named the “world’s most innovative new musical instrument.” [See announcement from Georgia Tech.]

It’s an encouraging achievement and I’m still buzzing, specially because the other 20 finalists all presented great ideas. Overall, it has been an inspiring event, and I warmly recommend musicians and inventors to participate next year. My final performance:

Make sure to use a proper soundsystem [when watching the videos]; most of the sound spectrum lives between 20-60Hz.

Music for Flesh II live at Georgia Tech Center for Music Technology, Atlanta, USA, February 2012. Photo courtesy the artist.

You’re clenching your muscles, and something is happening – can you tell us how this XS system works?

Marco: My definition of it goes like “a biophysical framework for musical performance and responsive milieux.” In other words, it is a technology that extends some intrinsic sonic capabilities of the human body through a computer system that senses the physical energy released by muscle tissues.

I started developing it in September 2011 at the SLE, the Sound Lab at the Edinburgh University, and got it ready to go in March 2011. It has evolved a lot in many ways ever since.

The Xth Sense wearable biosensors by Chris Scott.

The XS is composed of custom biophysical sensors and a custom software.

At the onset of a muscle contraction, energy is released in the form of acoustic sound. This is to say, similarly to the chord of a violin, each muscle tissue vibrates at specific frequencies and produces a sound (called Mechanomyographic signal, or MMG). It is not audible to human ear, but it is indeed a soundwave that resonates from the body.

The MMG data is quite different from locative data you can gather with accelerometers and the like; whereas the latter reports the consequence of a movement, the former directly represents the energy impulse that causes that movement. If you add to this a high sampling rate (up to 192.000Hz if your sound card supports it) and very low latency (measured at 2.3ms) you can see why the responsiveness of the XS can be highly expressive.

The XS sensors capture the low-frequency acoustic vibrations produced by a performer’s body and send them to the computer as an audio input. The XS software analyzes the MMG in order to extract the characteristics of the movements, such as dynamics of a single gesture, maximum amplitude of a series of gestures in time, etc.

These are fed to some algorithms that produce the control data (12 discrete and continuous variables for each sensor) to drive the sound processing of the original MMG.

Eventually, the system plays back both the raw muscle sounds (slightly transposed to become better audible, say about 50/60Hz) and the processed muscle sounds.

I like to term this model of performance biophysical music, in contrast with biomusic, which is based on the electrical impulses of muscles and brainwaves.

By differently contracting muscles (which has a different meaning than simply “moving”) one can create and sculpt musical material in real-time. One can design a specific gesture that produces a specific sonic result, what I call a sound-gesture. These can be composed in a score, or improvised, or also improvised on a more or less fixed score.

The XS software has also a sensing sequencing time-line: with a little machine learning (just implemented few days ago) the system understands when you’re still or moving, when you’re being fast or slow, and can use this data to change global parameters, functions or to play with the timing of events. For example, the computer can track your behaviour in time and wait for you to stop whatever you’re doing before switching to a different set of funcions.

The XS sensors are wearable devices, so the computer can be forgotten in a corner of the stage; the performer has complete freedom on stage, and the audience is not exposed to the technology, but rather to the expressivity of the performance. What I like most about the XS is that is a flexible and multi-modal instrument. One can use it to:

• capture and playback acoustic sounds of the body,
• control audio and video software on the computer, or
• capture body sounds and control them through the computer simultaneously.

This opens up an interesting perspective on the applications of the XS to musical performance, dance, theatre and interaction design. The XS can also be used only as a gestural controller, although I never use it exclusively this way. We have thousands of controllers out there.

Besides, I wanted the XS to be accessible, usable, hackable and redistributable. Unfortunately, the commercialized product dealing with biosignals are mostly not cheap and — most importantly — closed to the community. See the Emotiv products (US$299 Neuro Headset, not for developers), or the BioFlex (US$392.73). One could argue that the technology is complex, and that’s why those devices are expensive and closed. This could make sense, but who says we can’t produce new technologies that openly offer similar or new capabilities at a much lower cost?

The formal recognition of the XS as an innovative musical instrument and the growing effort of the community in producing DIY EEG, ECG and Biohacking devices are a clear statement in this sense. I find this movement encouraging and possibly indispensable nowadays, as the information technology industry is increasingly deploying biometric data for adverts and security systems. For the geeky ones there are some examples in a recent paper of mine for the 2012 CHI workshop on Liveness.

For those reasons, the XS hardware design has been implemented in the simplest form I could think of; the parts needed to build an XS sensor cost about £5 altogether and the schematics looks purposely dumb. The sensors can be worn on any parts of the body. I worked with dancers who wore them on the neck and legs, a colleague stuck one to his throat to capture the resonances of his voice, I use them on the arms or to capture the pumping of the blood flow and the heart rate.

The XS software is free, based in Pd, aka Pure Data, and comes with a proper, user-friendly Graphical User Interface (GUI) and its own library, which includes over one hundred objects with help files. It is developed on Linux, and it’s Mac OS X compatible; I’m not developing for Windows, but some people got it working there too. A big thumb up goes to our wonderful Pd Community; if I had not been reading and learning through the Pd mailing list for the past 5 years I would have never been able to code this stuff.

The Xth Sense software Graphical User Interface. Built in Pd.

The public release of the project will be in April. The source code, schematics, tutorials, will be freely available online, and there will be DIY kits for the lazier ones. I’m already collecting orders for the first batch of DIY kits, so if anybody is interested please, get in touch:
http://marcodonnarumma.com/contact

I do hope to see the system hacked and extended, especially because the sensors were initially built with the support of the folks at the Dorkbot ALBA/Edinburgh Hacklab. I’m also grateful to the community around me, friends, musicians, artists devs and researchers for contributing to the success of the project by giving feedback, inspiring and sharing (you know who you are!).

Thanks, Marco! We’ll be watching!

More on the Work

http://marcodonnarumma.com/works/xth-sense/
http://marcodonnarumma.com/works/music-for-flesh-ii/
http://res.marcodonnarumma.com/blog/

And the Edinburgh hack lab:
http://edinburghhacklab.com/

Biological Interfaces for Music

There isn’t space here to recount the various efforts to do this; Marco’s design to me is notable mainly in its simplicity and – hopefully, as we’ll see next month – accessibility to other users. I’ve seen a number of brain interfaces just in the past year, but perhaps someone with more experience on the topic would like to share; that could be a topic for another post.

Entirely unrelated to music, but here’s the oddest demo video I’ve seen of human-computer interfacing, which I happened to see today. (Well, unrelated to music until you come up with something this crazy. Go! I want to see your band playing with interactive animal ears.)

Scientific American’s blog tackles the question this week (bonus 80s sci-fi movie reference):
Brain-Machine Interfaces in Fact and Fiction

I’ve used up my Lawnmower Man reference quota for the month, so tune in in April.

One perhaps unexpected impact of technology has been to change the way we think about ourselves and our experience. Recording equipment – from photography to phonograph – has given us a new sense that memory itself might be fixed, unchanging, an accurate record of an unmoving truth.

Except, of course, neither the recorded object nor the thing it is recording ever quite seems to work out that way. (Ask your local theoretical physicist, or for a more localized, humanized, sociological view, any loved one.)

UNRAVEL is an installation that uses just those sorts of technologies to construct a narrative, and push and tug at that narrative. And if you don’t like it, well, that’ll impact the video, too. (Just complain via Twitter, and you’ll make the narrator “increasingly insecure.” As a blogger, I can relate.)

Combining record playback, a robotic band contributing incidental music, and a set of interactive dials, the installation recounts a story with mechanically-reproduced soundtrack, as the audience adjusts what happens. It’s all clear in the extended video:

More information:

UNRAVEL opens to the public on 20 April – 7 May as part of Glasgow International Festival of Visual Art at Arch 24/ SWG3.

UNRAVEL is a collection of devices making up a gallery-based, reactive sound installation, through which the audience will attempt to unravel the truth about The Narrator’s life by playing records from his collection.

When we tell the story of a memory, how much of it is true and how much is shaped by who we are talking to? Once we’ve told the story many times, how do we even know what is true any more – what is constructed and what actually happened?

The installation is the work of Edinburgh based arts collective / experimental pop band FOUND, whose members include Ziggy Campbell, Simon Kirby and Tommy Perman and Glasgow-based author and musician, Aidan Moffat best known as one half of the band Arab Strap. FOUND and Aidan Moffat are signed to Glasgow record label Chemikal Underground.

At the heart of the installation is a vinyl record player and ten 7” records of familiar singles from pop music’s heyday. Visitors to the gallery are encouraged to select a record from the collection to be played. As soon as they drop the needle on to the record the installation springs to life. The vinyl controls a series of acoustic, self-playing musical instruments positioned throughout the gallery which soundtrack the story as the narrator recounts a memory he associates with that record. Each 7” record represents a different memory, but unlike conventional vinyl recordings they sound different each time they are played.

Just as a real narrator alters the way they tell a story depending on their mood, audience and context, the memories embodied in the installation will distort, evolve and warp depending on external influences: the time of day, the size of #UNRAVEL’s audience, the local weather, and what people are writing about the installation on twitter from moment to moment.

A year in the making, #UNRAVEL is the first collaboration between FOUND and Aidan Moffat and represents a major new body of work for both. The project required Aidan to write 10 short stories with multiple variations of each, to be soundtracked by a total of 160 new musical compositions by FOUND.

With Investment from Creative Scotland’s Vital Spark programme and New Media Scotland‘s Alt-w Fund with the support of the Centre for Design Informatics, Glasgow International Festival of Visual Art, SWG3 and the University of Edinburgh.

Funny side note: I recall some evenings out drinking with Scottish people that also questioned the boundaries of what is real and not real and the imperfection of memory, though more in a performative, real-time sense than in an interactive installation. (I was a willing and active participant, so I’ll not hold this experience against the fine countrymen and women of Scotland. Indeed, I hope to toast with these chaps next time I’m in Glasgow. I, of course, do not condone such behavior, and you will find that by contrast, this particular interactive installation has no ill health effects that I know of.)

For something completely different, here’s a beautiful set of instrument robotic solos incorporating acoustic instruments, plants, and bamboo:

A composition for plants, yangqin, bamboo robot and robotic chimes, Three Pieces is designed as a collaboration between robots, traditional instruments, and living things, housed in Victorian Palm House of the Royal Botanic Garden in Edinburgh. A traditional Chinese dulcimer is played by a robot with many bamboo fingers while the surrounding foliage hides an ensemble of robotic chimes. Despite being separate individuals, the robots communicate and perform together. The robot performers are conducted by all the living things in the Palm House. The moisture content of the soil changes slowly as the plants absorb water, while on a much faster timescale, the temperature changes in the building as animals, including humans, move about. The installation detects this living presence in the Palm House and the music changes accordingly. The robots react to humans, but their mood alters with the plants. For more info visit… foundcollective.com

Previously:

Plant-Reactive Robots Play Bamboo, Chinese Instruments at Royal Botanic Garden, Scotland

Reconceived Acoustic Music on an Interactive Table: Etiquette in Edinburgh

Music, ephemeral and fleeting, to many of us wants tangible embodiment, some physical sense of the tug we feel from its unseen vibrations. We’ve regularly featured the image of the circle as a sequence; even as music software prefers left-to-right piano rolls and scores and tracks, it’s a logical shape. Here, Finnish sound artist Martin Bircher looks to a last-century invention to build a mechanical expression of the sequencer.

From an antique music box, comes MIDI, as in the video above. And if that’s too discordant for you, have a look at the original video below. Even in comparison to our analog electronics, there’s something beautiful about seeing the mechanical inner workings of a musical expression.

Official description:

“Digital Enhancement” is an interactive sound installation consisting of an electrified Symphonion Brevet No. 28, a synthesizer, an amplifier and four headphones. The Symphonion musical box dates back to the beginning of the last century and its mechanical workings are combined with digital technology to convert it into a MIDI sequencer. The original music, embossed on steel plates, can be played on the synthesizer, which is programmed to mimic the sounds of the Symphonion. In order to operate the sequencer, a hand-cranked dynamo serves as a remote control.

And the original Symphonion in action:

Martin tells CDM some more about the music box in question and how he converted it to a new, digital life:

The modified musical box Symphonion Brevet No. 28 was produced in the beginning of the last century. The used hand-cranked Style 28 was the simplest and therefore cheapest available model from a broad product range. It plays steel discs with 14.5 cm (5¾”) diameter.

To convert the musical box to a MIDI sequencer, parts of the Symphonion’s base plate were machined to clear space for the stepper motor, replacing the hand crank. A custom etched and with flexible wires extended contact plate replaced the metal comb, whose 40 teeth were originally plucked to generate the sound.

The conversion of the voltage from the contact plate into MIDI messages is done by a microprocessor. A second circuit is controlling the motors speed. The added control panel holds DC input socket, an input for the remote control or footswitch and the MIDI output. Further there are controls for play/pause, tempo, and gate-time. An antique wooden cassette serves as the new housing of the sequencer.

More information:
Project website: mar.li/digital_enhancement.php
Facebook: facebook.com/Bircher.Martin

In the meanwhile, we have the pleasure of getting to gaze at high-resolution images of the setup, courtesy the artist. (Click for the big versions…)

You know the type. The drummer who, even robbed of drum sticks, is tapping on the walls, the car door, the desk… and maybe you are that person. When rhythms and musical gestures are bouncing around your head, the whole world just feels like something you want to play. It seems as natural as breathing.

So, given your computer can make anything an input, why shouldn’t it let you play like that?

A new controller and software combo seeks to make that possible. The work of one enterprising musician and creator, Stephan Vankov, it includes an affordable accessory with a piezo microphone and companion software to map it your taps to MIDI messages, for use with your favorite software musical instruments. Plug in the mic sensor, and you can tap your desk or slap your laptop or play any other surface.

We’ve seen this idea in various iterations before – most recently, at the party we co-sponsored in Los Angeles last month, we witnessed an entire ensemble using the motion sensors in their laptops. (That tool is available as an open source download, if you fancy hitting your computer.) Until now, though, these piezo controller rigs been a DIY affair. Stephan’s solution includes what appears to be nicely-made hardware — so you can dump it in your carry-on without worry. And the software includes a wide array of settings to map more easily to percussion and melodic instruments. (The software is now available for Mac, but with Windows and Max for Live versions on the way.) I hope to get one to test soon.

Intro pricing begins at US$59.

http://www.pulsecontroller.com

Stephan writes:

I wanted to let you know about a product I’ve been developing – the Pulse Surface Controller. The idea behind Pulse Surface Controller is to liberate computer-based musicians from conventional input devices of predetermined form factor and layout, and allow the user to turn a surface of various size, orientation and material into an expressive, flexible, reconfigurable MIDI controller.

The system includes a wired piezo microphone that can be attached to a surface via the integrated suction cup (or the included velcro strips) and connected to any computer audio input, as well as a standalone software application that converts acoustical impulses from the microphone into velocity-sensitive MIDI data. With the Pulse Surface Controller System, controlling percussive instruments has a more visceral, immediate quality, and via a powerful Melodic Generator that can generate notes in various scales the user can easily extend into the melodic domain to tap into an inspiring world of happy accidents.

I am very excited to share this project with fellow musicians and hope that you find this idea to be worth sharing with the CDM community!

More description:

The idea behind Pulse Controller was born out of the belief that as computer-based musicians and performers we should not feel relegated to a grid of small 1×1″ pads or a keyboard to create our rhythms and provide pulse to our music. Controllers once intended to give us the immediacy of playing an instrument often end up feeling more disconnected and distracting. With the Pulse Surface Controller System, controlling percussive instruments has a more visceral, immediate quality, and via a powerful MIDI generator that generates notes in predefined musical scales the user can easily extend into the melodic domain to tap into an inspiring world of happy accidents. Power to the fingers!

System Features:

+ Piezo microphone and powerful software interface
+ Attaches to any surface via integrated suction cup
(velcro strips also provided)
+ Connects to external audio device or built-in audio inputs
(1/4″ and 1/8″)
+ Velocity-sensitive and highly responsive
+ Low-latency performance
+ Compatible with all software that accepts MIDI Note messages (Cubase, Ableton Live, Pro Tools, VST plug-ins, etc)
+ Generate fixed note or random notes in a selected scale,
with control of octave, octave width, root pitch and 21 Scales
+ Fixed note length and note choke modes
+ Store and recall presets
+ Keyboard shortcuts for quick access to presets and important controls
+ Mac OS 10.5, 10.6, 10.7 compatible (Windows / Ableton Live users, please contact us about M4L version)

Side note: interestingly enough, I got to know Stephan in person at a NAMM afterparty we threw in LA, at which Stephan was playing a Karate Kid AV mashup with friends Shane Hazleton and Momo The Monster. So, nice to see what Stephan has been working on!

Music is deeply tied up with motion; seeing that in a machine is somehow satisfying. Soundmachines, from the enigmatically-titled Berlin studio TheProduct*, is an interactive physical installation made from optical turntables. By moving the “tone arm” – really in this case an optical sensor attached to an extended mount – you can change rhythms and sound sweeps.

We’ve naturally seen many visualizations, tangible and digital, that make loops into wheels. But it’s worth noting the particular connection to a kinetic experiment by The Books’ Nick Zammuto from the film earlier this week. In fact, my one criticism of this piece is that the rhythms are so regular. Some syncopation in a machine like this would be not only pleasing, but immediately visible to the eye and therefore understandable. Perhaps even decoupling the wheels from the motor could allow a user to experiment with sound. That doesn’t mean you have to go from minimal techno to irregular chaos, but there’s quite a lot in between.

That’s not to take away from the impact of this piece, and in particular, the beauty of its installation. The presentation in an iconic object is a message in itself. And the circle remains the ideal design for a looped rhythm, embedded as it is in the repetition we perceive in our world.

http://www.the-product.org/soundmachines

More details:

Three units, which are resembling standard record players, translate concentric visual patterns into control signals for further processing in any music software. The rotation of the discs, each holding three tracks, can be synced to a sequencer.
The Soundmachines premiered on the Volkswagen New Beetle stand at the IAA motor show in late Summer 2011. In cooperation with the sounddesigner/producer Yannick Labbé of TRICKSKI fame, we developed three unique discs, each controlling one track of an Ableton Live Set exclusively made for the Event. The show was supported by a set of realtime generated visuals, running on a 25m wide LED wall.


One/One oneone-studio.com
TheProduct* the-product.org

Client

Volkswagen

Agency

Vok Dams, Hamburg

Sounddesign/Producer IAA
Yannick Labbé yannicklabbe.com

Special Thanks

Matt Karau
 matt.karau.com
Andreas Schmelas invertednothing.com

(See also a compelling-looking visual collage. It’s supposed to be set to John Cage’s “First Interlude,” but because of copyright concerns, is instead (arguably) set to Cage’s 4’33″. Let’s hope they don’t get sued for that.