Continuing our insight into this view into electronic music performance and art through the lens of BodyControlled in Berlin, we’re joined by guest writer Kristin Trethewey. Kristin, a Canadian-born video artist and curator, takes another look at LEAP and BodyControlled, on the eve of its second installment. She gets straight at the question of what “BodyControlled” means, and what it can mean for sonic performance and creation. And I wanted to make sure to subtract myself from this write-up, seeing as I was playing – but see the excellent timelapse of the evening, above. -Ed.

LEAP is one of these spectacular Berlin venues you’ve been hearing so much about. It’s a huge, raw space with a view of Berlin’s landmark TV tower, hosting interesting art events with cheap drinks and the potential for a late-night party. But it’s unique, too, in its focus on electronic arts. And unlike other media arts centers, it’s not filled with computers and half-finished electronic projects. I’ve truly gotten lost trying to find this place (it’s tucked away in a mall), so I would recommend watching the timelapse video LEAP shot that guides you to the entrance before attempting to go there. Tonight is the second edition of BodyControlled, a new bimonthly performance series at the space. This installment, called “matter incompatible,” is held in conjunction with the Transmediale Festival under the satellite program, Vorspiel.

BodyControlled is a series focused on the intersection of performance and electronics. You can expect future programming to focus around ideas of “feedback” and “bio” related electronic performances. In its first installment back in November, a packed LEAP gallery witnessed performances by Robert Henke, Peter Kirn [editor of this site], Stephen Cornford, and Paul Whitty. The event was called “Other Spaces” and took the physical architecture of the gallery as a point of departure. Having the space filled with people made for a secondary concern of space: its use. In a series whose title mentions the body, I witnessed one performance engaging the bodies that were filling the space. Robert Henke’s twelve-hour set activated interactions between the audience, performer, and environment. He moved around, listened and mingled with the audience, even though he had this amazing, souped-up control station complete with ambient lighting.

Other artists put more emphasis on the manipulation and dislocation of space through the use and abuse of electronics. Kirn worked with a custom rig with tablet-controlled original software built in open-source software Pure Data (Pd), controlled by a tablet running Konkreet Performer. Excerpt:

Excerpt – LEAP Gallery Berlin, 26.11 by peterkirn

Whitty and Cornford actively deconstructed electronics in front of the audience:
it pays my way and it corrodes my soul (2011)

Stephen Cornford & Paul Whitty’s performance “it pays my way and it corrodes my soul” seeks out musical material by physically dismembering playback equipment. A reel-to-reel tape recorder is switched on and its mechanism amplified with a variety of microphones while it is taken to pieces. The sounds produced are then fed through an array of pedals: the machine’s belts, gears, switches and casing becoming an instrument subjected to a live audio autopsy

Excerpt:
Excerpt: Stephen Cornford & Paul Whitty, LEAP Berlin, 26 November by cdm

Cornford was also interviewed by LEAP for his installation work, featuring repurposed tape machines:

As João Pais, co-curator of the event with LEAP’s Daniel Franke, puts it:

“BodyControlled means the main direction of the series, to present performance and installation works that have a strong, corporal identity. This can be manifested in many ways, not only implying a “moving performer”. The purpose is to avoid the extreme of abstract performances made by a laptop-er, sitting down as if writing emails. In the first event, this idea was shown by interpreting/filling the space of LEAP through a sound-performance (Kirn, Henke), or an installation (Cornford, Mathy, Oliver).”

See also my write-up for ARTSCARDS from last month:
Other Spaces Generates New Spaces Through Sound at LEAP

The second event, “matter incompatible,” draws reference to the Transmediale theme: In/compatible, acknowledging the less clear, even dark forces at play in the artistic and political climate today. Matter Controlled questions the idea of the object or anti-object within sonification. See CDM’s write-up from yesterday:

Watch Artists Talk About Making Sound From Matter; Thursday Event and Stream in Transmediale Prelude

From the Transmediale podcast, some explanations of the theme of the larger festival:

Jacob Lillemose on the exhibition Dark Drives: Uneasy Energies in Technological Times by transmediale

Kristoffer Gansing elaborates on the festival theme in/compatible, as well as the in/compatible symposium: systems | publics | aesthetics.
Tatiana Bazzichelli is the curator for out new project reSource of transmedial culture and speaks about its concept.
Jacob Lillemose speaks about exhibition Dark Drives: Uneasy Energies in Technological Times which he is curating for transmediale 2012 in/compatible.
Sandra Naumann is the curator for this year’s performance programme The Ghosts in the Maschine, which she explains a bit more in detail.
And Marcel Schwierin tells us about his concept for the video programme he is curating for transmediale 2012 in/compatible.

Performances by Echo Ho, Mario De Vega, Alex Nowitz and Ignaz Schick will investigate this blurry region between the immaterial and material. I am curious to see what objects they will bring to play with. As they potentially seek liberation from the physical objects, by reimagining their sonification, I wonder how they are also reliant and maybe even drawn towards their objectification. Bringing these disparate emotions into play is at the heart of tonights investigation. In today’s climate fractures exist between so many aspects of our lives. These performances seek to bring some of them together, compatible or incompatible as we might discover.

You can watch the proceedings via live Internet stream, for the majority of you not in Berlin for the live show.

www.leapknecht.de

More Photos

About the Author

Kristin Trethewey is a Canadian video artist, cinema performer, and curator. She holds an MFA from Brooklyn College in Performance and Interactive Media. A multi-disciplinary curator and artist for the past ten years, she has recently completed a residency at the Node Center for Curatorial Arts, was co-Director/co-Curator of the INDEX Festival. She currently lives in Berlin.

Alex Nowitz for BodyControlled #2 from CDM on Vimeo.

Electronic media artist Mario de Vega (Mexico City/Berlin) says his work plays with the creation of “unstable systems.” As part of the official Vorspiel, or lead-up, to Berlin’s massive Transmediale festival, here we get to visit two artists working with the materiality of live performance, drawing from the festival theme of “in/compatible.” The sonic environments they create seem poised on the brink of sonic chaos, a dance at the edge of entropy.

CDM will again be editorial co-presenter of BodyControlled; you can see the show for free (donation suggested) in Berlin at LEAP, or tune into the live video stream from anywhere in the world, and we’ll be bringing you details of the artwork. We’re a ticket to Alexanderplatz that’s even cheaper than easyJet, in other words. The performances start at 20h CET Thursday, 26 January. (That’s 2p East Coast time / 11a Pacific, so scare your office mates and turn it up loud.) Full details below.

At top, composer/singer Alex Nowitz demonstrates his gestural performance techniques. I got to see his work for the first time at the Patterns + Pleasure Festival in the fall at Amsterdam’s STEIM research center. While at STEIM, Nowitz built on previous work with the Wii remote, and augmented his gestures with a new instrument, entitled the “Strophonion.” You can see that creation in the video above.

With each contortion of his body, Nowitz rips apart sounds, all while sputtering non-lingual utterances with his gymnastic voice. In the Amsterdam performance, one had the sense of following him into the Schwarzwald (Black Forest), an operatic odyssey echoing with forboding birdsong. But the system can also be dynamic and even, at moments, whimsical.

steim.org/projectblog/?p=3715
nowitz.de/

For his part, Mario de Vega’s “unstable systems” flirt even more with this notion of engineered incompatibility, with sounds that seem like they will explode in an earthquake-like tremor.

Mario de Vega for BodyControlled #2 from CDM on Vimeo.

mariodevega.info/

Films by João Pais, co-curator of the series; edited by CDM.

Also on this program, more works engage the idea of what the curatorial statement terms “hidden acoustics”:

Echo Ho (Canada/Cologne, DE)

Tuned to Site #26012012
This title is from a series of concerts, called “Tuned to Site #…”. As a whole, the series formulates the idea of “musification of urban landscapes”.
In the first performance of this series in 2012 Echo Ho will play a set of instruments: a self-fabricated hybrid semblance of the ancient Qin from China, which combines traditional acoustic and digital interfaces in one unique transparent plexiglas body. Like a sensor box, it will enable Echo Ho to make field recordings of inaudible hidden sounds within
the city environment, such as electro-magnetic fields, variation and wind movements. The performance thus marks the process of generating action by outlining situations in which sounds may occur.

http://www.echoho.net/

Ignaz Schick (DE)
Turntablist, sound artist, performer & composer Schick promises, through motors and objects, genuine accidents:

Site-specific performance with transducers, wireless controllers, feedback systems and back tape
Through accidents and their outcomes, actions, processes and objects that conceptually connect with acoustic information, the work of Mario de Vega researches the value of vulnerability, exploring the causes and effects that determine the construction of realities. In this site-specific performance with transducers, wireless controllers, feedback systems and back tape, de Vega is investigating aesthetic and social realms through a multiplicity of mediums.

http://www.zangimusic.de

Co-curator João Pais tells CDM that this installment, in keeping with Transmediale’s theme, will “give the performers a room where they can show their ways of working with the dissociation of matter (through sound, in this case) and expression.” Pais co-curates the event with Daniel Franke of LEAP.

This episode includes two self-made instruments that expand on existing practice, he says, in the case of Nowitz and Ho, and the hacked and modulated machines of Schick and Vega.

More information; where to see the show

26 January 2012, 20h (free/donation)

Show details

Anywhere in the world – all performances will be available from 20.00 CET via live stream:
http://bit.ly/uXRgyq

Facebook: on.fb.me/AmEtO9

LEAP
Lab for Electronic Arts and Performance
(Berlin Carré, 1. Stock)
Karl-Liebknecht-Str. 13
10178 Berlin

How to find LEAP

When we say “handmade music,” we really mean this sense of crafting something , of touching something – not so much the technique or the technology as the intention behind what you do. In a striking film portrait of Nick Zammuto for nakedmusicians.com, the craft of living is spotlighted as much as the craft of music making.

Nick, is known for his role in duo The Books (with Dutch-born Paul de Jong), and their distinctive, rhythmic, homebrewed-original sound. Here, he covers his manipulations of everything physical and temporal. Sound sampling is a tangible process, the poetry of things put together and assembled in surprising ways. So, too, is his life in music, as he talks about raising kids and literally building a home. They are all of these activities a way of stopping and shaping time, of composing yourself and your loved ones into the future. The resulting sounds and stories might just make you want to move around.

You can learn more about Nick on his site:

http://zammutosound.com/

Burlington, Vermont-based filmmaker Matt Day is responsible for this gem.

And if you’re in the Eastern USA, you can catch Nick live:
FEB 3: Mass Moca, North Adams, MA
FEB 4: 92YTribeca, New York, NY
FEB 6:Brighton Music Hall, Allston, MA

Sounds from his new EP, via SoundCloud:
Zammuto – Idiom Wind EP – Make Mine, London UK by zammuto

I’m saddened to learn of the death of Richard Lainhart, the New York-based composer and artist who has been inseparable from the experimental electronic scene for many years. I knew Richard to be a gentle and imaginative soul, an inventive technologist, someone capable of dreaming up endless soundscapes and auditory worlds. He was also a great contributor to the CDM community, including playing one of the early installments of Handmade Music at Etsy Labs in Brooklyn. (Photo above; full video at bottom.)

I think it’s fitting to illustrate Richard with a terrific self-portrait on Polaroid, one that illustrates his sense of humor and artistic adventurousness:

Richard’s wife Caroline posted a note with the news, which most of us found via Facebook:

Richard Lainhart February 14, 1953 – December 30, 2011

Dear friends of Richard,
It is with a heavy heart that I that I must tell you Richard Lainhart, composer, musician, technologist, filmmaker, and digital artisan died Friday, December 30, 2011.

On December 17, Richard complained of pains in his side and was admitted to the hospital for tests which showed an intestinal cancer. He was operated on on December 21. After the surgery (which showed the cancer had not spread), there were infectious complications which took his life on December 30.

He struggled valiantly to overcome his infection, but it was not to be. We are all in shock and cannot grasp the idea of his not making music, talking music, teaching, posting and playing.

Caroline Meyers
Richard Lainhart’s wife

Richard leaves behind a massive body of work and digital footprints; I’ve selected some of those below, including music, a wonderful set of images working with digital manipulation and Polaroids via Flickr, and his series on creative sound design tutorials.

Playing Messiaen:

Audiovisual work:

Richard’s most recent album, via Bandcamp:

Most recent SoundCloud contributions, including the winds after Tropical Storm Irene (that sound certainly is part of my sonic memory of 2011)

Sounds of my World – Post-Irene Winds 8-28-11 by rlainhart

200e-Continuum Percussive Study 2 by rlainhart

Sounds of my world – Rainforest V, New York Electronic Art Festival, 7-30-11 by rlainhart

I adore his photographic work:

A bio:

Richard Lainhart is an award-winning composer, author, and filmmaker – a digital artisan who works with sonic and visual data. Since childhood, he’s been interested in natural processes such as waves, flames and clouds, in harmonics and harmony, and in creative interactions with machines, using them as compositional methods to present sounds and images that are as beautiful as he can make them.

Lainhart studied composition and electronic music with Joel Chadabe at the State University of New York at Albany. He has composed music for film, television, CD-ROMs, interactive applications, and the Web. His compositions have been performed in the US, England, Sweden, Germany, Australia, and Japan. Recordings of his music have appeared on the Periodic Music, Vacant Lot, XI Records, Airglow Music, Tobira Records, and ExOvo labels. As an active performer, Lainhart has appeared in public approximately 2000 times. Besides performing his own work, he has worked and performed with John Cage, David Tudor, Steve Reich, Phill Niblock, David Berhman, and Jordan Rudess, among many others. He has composed over 100 electronic and acoustic works. In 2008, he was commissioned by the Electronic Music Foundation to contribute a work to New York Soundscape.

Lainhart’s animations and short films have been shown at festivals in the US, the UK, Canada, Germany, and Korea, and online at ResFest, The New Venue, The Bitscreen, and Streaming Cinema 2.0. His film “A Haiku Setting” won awards in several categories at the 2002 International Festival of Cinema and Technology in Toronto. In 2009, he was awarded a Film & Media grant by the New York State Council on the Arts for “No Other Time”, full-length intermedia performance designed for a large reverberant space, combining live analog electronics with four-channel playback, and high-definition computer-animated film projection.

quotes

“Lainhart crafts sounds in a tonal, musical fashion – sustained tones, drones, melodic fragments – and electronically manipulates them into beautiful tapestries of sound.” (Waterfront Week)

[His] “music reflects the spirit of possibility that once defined electronic music, bringing with it a sense of past, present and future that transcends time, technology and cultural assumptions. The spell- binding music seemed to evoke feelings that can’t quite be named, and suggest music I might rather imagine for myself in silence than trust most composers to compose.” (The Village Voice).

“He’s evolved a singular vision as a composer, performer and engineer of darkly seductive minimalism.” (Peter Marsh, BBC)

And here is Richard’s performance for us at Handmade Music on the Buchla 200e synth and Continuum Fingerboard, from 2007:

http://www.otownmedia.com
http://www.vimeo.com/rlainhart
http://www.youtube.com/rlainhart
http://richardlainhart.bandcamp.com/
http://soundcloud.com/rlainhart
http://twitter.com/rlainhart
http://www.facebook.com/rlainhart
http://www.downloadplatform.com/richard_lainhart

Modular music making is a throwback to the early days of electronic music, in which a spaghetti of patch cords is the price of open-ended sound creation. Fairly or unfairly, it has often been viewed as the domain of the eccentric wealthy musician. You needed cash, endless patience, and lots of space – well, unless you happened to be lucky enough to pick up a vintage modular as people were getting rid of them.

But something has happened: modules have become more practical and accessible. Like any music technology, they can become a rabbit hole into which time and money fall and no music escapes. But also like any music technology, there are ways of bending these tools to your will, applying fiscal and creative discipline to make them musically productive.

Enter the “desktop modular” revolution. Modules are cheaper and more usable. It’s easier than ever to assemble a rig of modular that coexists with your digital gear, be it MIDI hardware or computers. That means just a select set of modules within your budget (and available physical space) could find a place. And modules are more innovative and fun than they’ve been in the past, too. They merge digital and analog tech – just as this site has loved doing (despite our name) over the years.

And just as suddenly, that spaghetti entree starts to look delicious.

I can’t say I’ve personally found room for this kind of gear, but I’ve enjoyed watching the evolution of new equipment. And over the past few months, I’ve witnessed a bumper crop of terrific new modules. It’s time to survey some of that fertile landscape, as 2011 winds to a close. Here are a few of my favorites, sure to inspire other nominees from readers. And I imagine this adds fresh cause to venture into the basement stalls of the Winter NAMM music manufacturer trade show in Anaheim next month, where these sorts of less-mainstream devices flourish.

Notably, these modules all work with the ‘small’ Eurorack (A100) format. German maker Doepfer Musikelektronik popularized this format, and it has since taken off. In fact, that puzzled quite a few readers when Moog’s re-entry in modular eschewed that format. (That may be their loss.) But Moog ladder filters aside, there has been plenty of action in the Eurorack space.

Utility: Kenton MIDI-to-CV and More

Kenton’s Modular Solo is about as nice a utility knife as you could add to a modular rig, for integrating lots of different gear. Plug it in via ribbon cable, and you get:

• MIDI in and out
• SYNC 24 (“DIN SYNC” – think 808 and 606 drum machine sync)
• CV analog and gate output
• Two clock outs, four aux outs (think assigning MIDI to filter cutoff, etc., says Kenton)
• And an LFO – triangle, saw up and down, square, S&H pulse width with several fixed widths

£195.00, though all the extras there easily could make it worth it.

Utility: Expert Sleepers ES-4 Modules

Expert Sleepers’ ES-4 is the latest of their modules, turning a standard S/PDIF signal into five channels of control voltage. Coupled with their Silent Way software, you can also use it for MIDI, only with sample-accurate timing. That makes it a sample-accurate MIDI interface, if you like. (See video at top for a MIDI demo.) You can turn three of those five outputs into any signal you like – gate, envelope, LFO, and so on.

Where do you get that S/PDIF output? Well, lots of audio interfaces have them, and many computers – including recent MacBooks – do, as well.

There’s also an ES-4 Gate Expander add-on for additional 8 on/off gates, triggers, clocks, and so on. The unit is £151, or £64 for the Gate Expander, not including VAT.

http://www.expert-sleepers.co.uk/es4.html

More demos:

Sound Sculpting: ADE-10 Reactive Shaper

Justin Owen of Abstract Data sends us this creation. It’s an all-analog waveshaper, wavefolder, feedback unit, with audio to LFO range. That means you can use it as an LFO or design sounds or manipulate synth pads or … any number of things. In fact, it’s nice enough that I could see using it alone, sort of Moogerfooger / stomp style. This is the same nice gentleman who created the Kicker, a synth focused on bass drums.

Loads of sound samples on SoundCloud, in addition to the video tutorial and demo above. It’s yours for £135.00, which I think is quite a bargain.

http://www.abstractdata.biz/ade10/

ADE-10 Reactive Shaper Eurorack Module (2011) by abstractjuz

Synthesis: Monotron in a Eurorack

A bit more left-field, but you can even get Korg’s simple-but-fun Monotron synth in a Eurorack module. Skip ahead in the video below to hear it in action. (Well, unless you prefer field recording crinkly wrapping sounds, in which case the unboxing portion of the video will be your favorite. Toddlers, dogs, and gear lovers agree: unboxing is the best part.)

US$249 puts the Monotron in a rack format. Of course, there, you can do quite a lot more with the Monotron than you can with the original, with both full CV and MIDI control and very, very nice knobs, in place of the awful-feeling (though stunningly inexpensive) controls on the original. All together, that makes a very playable, very fine synth.

http://erthenvar.com/store/monotrone, as seen on Synthtopia

Synthesis: Triangle Core Oscillators

Just when you think you can’t innovate in something as simple as an oscillator — you can.

Synthesist Danjel van Tijn sends news of the Dixie VCO, which, named for its creator, reimagines how to do a triangle oscillator:

It is a triangle core oscillator in Eurorack format that utilises a brand new method of implementing a triangle core oscillator using a design by professor David G. Dixon.

Side note: Trianglecore would make a great genre name.

Professor Dixon co-designed the module and collaborated on its construction. In the video at top, you can see what those waveforms look like. Below, you can see how this might work in a musical context:

Melodic demo of the Dixie VCO. Two Dixies are used (only one at first) along with a Z8000 for sequencing, a uScale for quantizing, uStep for step sequencing and everything is filtered through the new Dr. Octature VCF/VCO.

The uScale is used to help demonstrate the extremely wide and accurate range of tracking of both VCOs. The sequence spans many octaves but the intervals of the two Dixies stay in tune.

PWM, LIN FM and Sync are all played with along with different combinations of waveforms to explore just some of the timbre possibilities.

And here’s what happens when you reverse sync:

We seem to lack purchase info on this particular module for now, but there are loads of other great modules from this Vancouver, Canada-based builder – and yes, they work with Max/MSP and computers, too, not just modules:

http://www.intellijel.com/

Roundup of Other Great Picks

Knowing I could never keep up with all that’s happening on the Eurorack scene, I asked Danjel aka Intellijel to give us some of his picks for some of the coolest modules. He obliged with a drool-worthy – and I dare say genuinely musical – list. Here are his favorites:

There is so much stuff! Eurorack has obviously tried to update or recreate most of the classic synthesis blocks from various manufacturers (Buchla, Moog, Roland etc. etc.) but the past couple of years very interesting developments have been made incoporating brand new designs not found anywhere else. Some of these are completely DSP based, some are hybrids and some like the Dixie VCO are %100 analog.

Other stuff I have put out that is unique (and actually has decent video) would include:

uScale: CV quantizer but it also does intelligent interval generation

Corgasmatron:
This is a dual multimode filter with the same transfer function as classic Korg MS20 but it is a completely new circuit design (nothing related to the original at all) using all modern components.

On the analoghaven page there is a list of about 40 manufacturers each with many modules:
http://www.analoguehaven.com/what/

The Muffwiggler.com forum is extremely active with all things to do with modular synthesis (and synths in general).

Stuff worth noting form other manufacturers (there is so much more from each of these groups):

Cylonix Cyclebox:
FPGA based extremely deep triple VCO with through zero FM and massive amount of synthesis and waveshaping options
http://www.cylonix.com/cyclebox.html

TipTop Audio matrix sequencer:
http://www.tiptopaudio.com/z8k.php?goto=features

Tiptop Audio Z-DSP (user programmable DSP fx processor)
http://www.tiptopaudio.com/zdsp.php?goto=features

Expert Sleepers ES-3 (all their products really) control your analog gear via a plugin in Ableton/DAW and their lightpipe/spdif/db25 connector
http://www.expert-sleepers.co.uk/es3.html

Kilpatrick Audio K4815 Pattern Generator
http://www.kilpatrickaudio.com/?p=K4815

Makenoise Phonogene: digital tape recorder re-visioned
http://www.makenoisemusic.com/Phonogene.html

Makenoise Rene: cartesian sequencer
http://www.makenoisemusic.com/RENE.html

Synthesis Technology Morphing Terrarium: morphing wavetable synthesis
http://www.analoguehaven.com/synthesistechnology/e350/

Synthesis Technology Deflector Shield: thru-zero frequency shifter, phaser and ring mod
http://www.analoguehaven.com/synthesistechnology/e560/

The Harvestman Double Andore: dual a-d envelope generator and 2-channel vca with digital curve shaping and vca law selection
http://www.theharvestman.org/2017.php

The Harvestman Bionic Lester: dual 12db/oct switched capacitor multimode filter with mode selction and clock disruption.
http://www.theharvestman.org/1873.php

Toppobrillo Sport Modulator: Dual VC Lag and CV processor
http://www.analoguehaven.com/toppobrillo/sportmodulator/

Thanks, Danjel! This looks fantastic – plenty to consider as inspiration.

It all makes me wish for a holiday on which some supernatural being, against all rules of material consumption and the conservation of physics, flies around the Earth leaving, for free, the things you desire as gifts. If someone can make this happen, let me know. Also, I’ll need the contract to a flat in which I can house said materializing goods. Until then, I’ll have to hack something together for free in Pd and run it on a netbook.

Dream On: Modular, The Movie, and the Planner

Modular remains such a cultural phenomenon, it has inspired its own movie project, as seen on IndieGogo (trailer above):

I Dream of Wires: The Modular Synthesizer Documentary

If we’ve sold you on this whole idea, Danjel also points us to this:

There is a pretty cool online interactive virtual modular for planning out a system
It contains pretty much every module available.

http://www.modularplanner.co.uk/

More analog…

By the way, if you appreciate this sort of analog coverage and would like a domain at which you can see it, you should complain to Trash Audio. They cheekily registered the createanalogmusic.com domain and redirected it to their site, and they haven’t responded to offers to buy it from them them. I suggest you flood their inbox with complaints until they aquiesce. Alternatively, perhaps you can think of a word that means analog but begins with the letter ‘D,’ as that’d fit nicely with the ‘CDM’ acronym. Or we could come up with something in another language – German, for instance.

I’ve registered createanalogmusic.de for now; I’ll point it at something later this week. And as for how we can get back at TRASH_AUDIO — I’m open to suggestions. Can’t crash their NAMM party; I’ll be on a flight back to Berlin. (Seriously, that crew held a great synth meetup in LA in September I was lucky enough to catch – at least briefly.)

We’ll continue to happily bring you judgment-free electronic music making on a variety of platforms, from the Apple II to a discarded, broken cell phone to analog circuitry you wired up yourself, because that’s how we roll.

Graphics are good. Graphics are shiny. But when it comes to reality-bending, emotionally-immersive, perception-shifting power, look to sound and music.

At least that’s the feeling you could get after playing Dimensions. Following their reactive music tools and Inception dream states for iOS, RjDj have turned their mind-altering sonics to gameplay. As with previous releases, these tools are powered by the open source visual development environment Pure Data. Pd engineering wizardry here meetings the compositional and sound design prowess of Hans Zimmer.

You can see a bit of how the musical world works in the teaser video above, and the music sound design video below.

But we wanted quite a lot more information. So, CDM got RjDJ’s Rob, Joe, and Martin to share some detailed thoughts on how the game experience is put together and how it works.

The App

RjDj Team: Most games require your full attention when you play them. You either live your life or play the game. Dimensions is different. It’s designed to be played in parallel with your normal life.

Gameplay is intertwined deeply into your daily life. Some dimensions unlock if you are physically active and others unlock if you are quiet. The app automatically detects what you are doing and syncs the game to it making use of every possible sensor on the iPhone.

You stay immersed in the game by listening to augmented sound and the voice of Emily from Mission Control. She guides you through many exciting challenges like collecting Artifacts and avoiding the dreaded Nephilim.

With Dimensions we are very interested in creating a gameplay experience which is between the device based focus of a casual game and the passive use of listening to music. Its a game which you play by listening – a game that place in parallel to your everyday life.

The Tech: Reading Files

We built our own version of readsf, rj_readsf, in order to be able to read compressed audio and make the samples available for processing in Pd. One advantage of readsf is that possibly lengthy audio assets do not need to be loaded into memory. If memory is limited, especially when Pd may be running in the background, limiting exposure to system memory warnings helps keep the app running and the music playing. Given that compressed audio is roughly ten times smaller in size than uncompressed audio, and that audio assets make up the majority of the size of the entire app, it is a huge benefit to be able to deliver and read compressed audio assets directly, without the need to decompress in memory or onto disk. Dimensions requires that several dozen such players be open and viable at any time, and special consideration was given to concurrent behaviour. rj_readsf can loop a file when it gets to the end, and it indicates with a bang when a file has been loaded (an asynchronous operation) or the end as been reached (in the non-looping case). rj_readsf is built on iOS standard APIs and can read any file format that iOS can.

Ed.: I’m waiting to hear if rj_readsf will be open-sourced. The issue of reading files is one we’ve had around libpd recently. While their rj_readsf sounds great, my sense is the best long-term solution will be a similar object that is independent of the APIs of any one OS, so this same set of problems may need a different solution for the open source community more generally. (Building such a tool is absolutely possible, though it might require more effort.)

The Music, and How the Music Plays with You

The music of Dimensions uses various different techniques from straight sample playback to audio analysis and synthesis:

Realtime manipulation of audio input from the mic:

This is perhaps the most recognisable technique we use. We process audio from the iPhone microphone live in many different ways. It’s kinda like a feeling of being inside the music.

The key thing we do with effects is attempting to analyse the environment of the player / listener and then making appropriate things happen within the effect. For instance, the Flux Dimension features a filterbank on the mic input. We analyse the incoming audio from the players environment and make the filter frequencies change as events occur ( either due to pitch changes or onsets ) this gives the impression that objects and activity around the player is somehow “playing” the music.

In the Ghost Dimension there is an effect which records audio whenever it detects an event, then scrubs repeatedly forwards and backwards through the sample using granular techniques stretching it out in time. This manipulation accentuates the textural and pitch based qualities of the sample as it repeats and works well with the atmospheric music Hans Zimmer composed.

Dynamically-controlled stems:

All the Dimensions use stems and hits from a conventional sequencer in some way, re-arranged live on the device relative to how the player is interacting. These stems were mainly composed in Cubase and Logic.

For example, in the Kinetic Dimension we feed accelerometer data from the device into Pd and drive the music from that. The player hears more energetic beats when they go for a run, but if they stop at the lights to cross the road, the drums immediately drop away. This was achieved with a large number of hits with all the rhythmic sequencing happening in a hybrid reactive / generative way live on the device.

In the Tranquil Dimension, the music introduces more stems the longer the player is quiet. If they make too much noise the music “shrinks away” from them and becomes quieter. If they stay in a Zen like peaceful state, the music grows into a kind of crescendo of serenity.

Reactive synthesis:

We often control parts of the music by doing a frequency analysis of incoming microphone audio from the device and then using those frequencies to determine the notes synths will play within the music. The Travelling Dream in Inception the App uses this extensively. Tranquil Dimension in Dimensions also uses onset and frequency changes to trigger synth melodies in the music.

The synths we use range in complexity from very simple additive synthesis to some great synth patches from the rjlib by Frank Barknecht and Andy Farnell.

Generative approaches:

There are some sections within Dimensions which are generative. These play back prepared samples as well as triggering onboard synthesis. They also feed the results of this through various live sampling and glitching patches. They are governed by various sets of rules which have various long term parameters, like adjusting to the intensity of the audio environment of the listener, or how dense areas of music have been around the present time.

Sample triggering:

Ghost Dimension uses a simple but effective technique of triggering samples from the music on onsets in the environment. This can cause some real jump out of your skin moments. We combined this section with a randomised very short delay on the mic which acts almost like a resonator, turning the mic sounds into creepy atonal pitched noises.

Sound Design

The main hub section in Dimensions, called the Launch screen, acts as a entry point to your augmented adventures. It also displays all available Dimensions via the floating tile icons.

Visually, these represent a snapshot of your previous experience using your location at that time. Sonically we wanted them to have an aura or energy from the Dimensions themselves.

SoundCloud examples:
Dimensions Sound Design Example by rjdjme

Example of using mixture of synthesis and samples to create user feedback when interacting with Dimension icons in the game.

Map Tile Down: several recordings of a synth in Pure Data that is played when the tiles are touched. Each one is slightly different due using two detuned oscillators.

Map Tile Open Only: a sample from Logic Pro for the woosh sound when showing the information view.

Map Tile Click: a sample from Logic Pro for touch events.

Map Tile Open: recording of how it sounds when put together.

Sound is a mixture of samples and real-time synthesis. The energy sound is made using two oscillators (one detuned) to create some modulation for a glowing effect. Added to some harmonics to make it more of a beam sound and some chorus and reverb. The open tile is made in logic, when closed it’s the same sound but reversed and pitched down in Pd.

We wanted the tiles you tap on to feel like each Dimension has some sort of energy radiating out.

Here’s a sense of how the sound design works in the game:

It’s an ambitious app, and the whole cost is US$2.99. I guarantee it’ll change your world more than a latte. (Well … unless we’re talking a really crazy latte. And that might not be legal.) As sometimes-CDM contributor Jaymis Loveday notes, there are terrific choices in coloring Google Maps, and how modes change based on ambient sound and motion.

Requires an iPhone 3GS or better, or third-generation iPod Touch or better, or an iPad.

Dimensions @ iTunes Store

More reading:
Dimensions Augments Reality Purely Through Sound [Leigh Alexander, one of my favorite game writers, for Gamasutra
The Roundabout Tapes – RjDj now plans to game reality with sound [TCTV] [Techcrunch EU]

Arvo Pärt’s music is always spare and gorgeous, inspired by Medieval counterpoint and voicings, and you’d expect it to be such on any instruments. But here, you get something truly unique: a transcription of the composer’s ‘Fratres,’ normally played on string quartet, on a mixer.

The no-input performance uses exclusively tuned audio feedback to generate sound, creating an almost vocal quality to ringing timbres generates entirely in the mixer.

Details:

Camera : Jimmy Hayes
Console : Christian Carrière
Research residency, Summer 2011
OBORO, Montreal, Canada
oboro.net/

Console : Allen&Heath GL2400-40
Thanks to Claus Frostell of Erikson Pro, who lent me the console, which made this project possible. eriksonpro.com/

The project is the work of experimental musician Christian Carrier, a Montreal-based sound artist and composer.

http://christiancarriere.com/

Thanks to Gregory Taylor and Todd Reynolds, among others, from whom I found this on Facebook.

You’ll find plenty of contact mic tutorials floating around the Web, but bassling (Jason Richardson) – working with a learned technique – has what I think is a really nice example, one that sounds really good. It’s easy to do, but unlike a popular tutorial (and one I’ve tried myself), you won’t wind up dis-assembling a Radio Shack piezo speaker. The result is an inexpensive, versatile microphone that will happily go places your conventional mic won’t, giving you new possibilities for sampling and sound design.

bassling credits his source:

This technique was taught to me by Alan Lamb when we worked together as part of the 2006 Unsound Festival. He’d developed this approach for recording ‘the wires,’ a large-scale aeolian harp modeled on telegraph poles he recorded in Western Australia.

Full tutorial:
How to make contact microphones [Bassling / Selectronica blog]

Here’s what it sounds like:
Piezo contact mic demonstration using a biscuit tin as a hand drum by bassling

I’d love to hear from readers: have you built contact mics? Which technique worked best for you?

And, if you try this one, any suggestions on various suppliers for the piezo crystal part itself? (Particularly in the US, Germany and continental Europe, UK, Japan, other places we have lots of readers.)

More:
Creme Dementia’s handmade bottle cap mics, on GetLoFi
Tutorials on the “Radio Shack” approach (though I like the one above better):
furious contact microphone assembly
Make a DIY Contact Microphone

I tend to tune out when it comes to sample libraries, but here’s one that takes the scripting capabilities of Native Instruments’ Kontakt sampler to extremes. The Grid Machine line developed by Lindon Parker (Channel Robot) and distributed by LoopMasters brings to Kontakt the sort of grid-based, sliced-up sample manipulation we’ve seen in the monome community and in custom tools in environments like Ableton Live and Renoise. Using KSP, the scripting environment in Kontakt, these produce entirely-custom instruments that cut, chop, stutter, reverse, mix, trigger, sub-loop, re-trigger, and modulate. You can change speed, mute, skip, reorder, and play patterns, and even mix between loops.

Even before you get to Kontakt’s effects, this kind of work really challenges the notions of what people imagine a “sampler” or “loop library” to be. And that’s been true of the sample sound design community, generally – they can brew things beyond the expected boundaries of a sample. I could even see this becoming a performance instrument.

Now, for those of us not content to use existing loops, I hope we can somehow convince Lindon to explain how he did the KSP scripting work to make it all happen. Drum ‘n Bass and House libraries are £29.95 each.

Loopmasters: Channel Robot

Some House for those of you who weren’t into the DnB version:

The possibilities of a microphone and the world are limitless, so as this week we looked at a recording of music made with playgrounds, a mic, and Ableton Live, readers responded in kind with a fantastic spectrum of sampling-inspired, real world-produced musical wonder. From comments, a few examples:

Diego Stocco, a favorite sound designer on this site, ventures in his latest installment into a dry cleaner. Clean, wrinkle-free clothes and great music – see, you don’t actually have to choose. See top.

“Vega” by CDM reader Cordovan Music (Gregory Reeves), is an eerily-lovely ambient score made from LA’s freeways – and perhaps an ominous, if beautiful, portent of a lot of us driving on said freeways for NAMM in January.

Vega by Cordovan Music

From the experimental and minimal ambient release “Photic”, “Vega” is made entirely from field recordings taken on Los Angeles freeways.
About the album:
Gregory Reeves is a Los Angeles-based electronic artist, composer, and musician. His work can be heard on A&E, History Channel, FUEL TV, Universal, EA Games and many more. His sound art and installation work includes pieces for the Gaffa Gallery, Sydney, as well as creating a soundscape for the huge geodesic dome at the Peats Ridge festival in Australia, New Years eve. Electronic releases under various aliases have received winning reviews in XLR8R, URB, JazzTimes, and Rolling Stone. Remixes include Bob Marley and the Wailers (“One Love” from “Roots Rock Remixed” on Tuff Gong/Quango), Sarah Vaughan, and others.
“Photic” is a collection of minimal, generative ambient works. “Vega” is made entirely from manipulated field recordings taken on Los Angeles freeways. “Dark Field” uses convolved urban sounds to create a brooding ambient soundscape (the piece was originally composed for the DUOscope multimedia installation in Sydney). “Anemone” was created using undersea video footage to generate musical events, while “Haiku in C” is based on classical Japanese Gagaku music. For fans of Brian Eno, Murcof, and Loscil

Reader Cillian John, in the more pedestrian-friendly city of Stockholm, looked instead to escalators.

On and on by cillianjohn

He writes:

The urban environment is full of inspiring noises. I particularly enjoy the mechanical rhythms you hear all round.
The rhythmic element of this track is a field recording of escalator I recorded while on a trip to Stockholm.

Audiovisual remix superstar Pogo, aka Perth, Australia-based Nick Bertke, is embarking on a mission to “remix the world” as has inspired the headline of this post. Check out the spectacular results, and perhaps even get involved (thanks, BenAlex):

http://www.pogomix.net/remixing-the-world/
Kickstarter on Tibet

(I’m awaiting further details, but I am personally angered by the apparent mistreatment of Bertke which recently resulted in a 10-year deportation from the United States of America – and even that only after seemingly-extreme prison time and detainment that required the intervention of the consulate of New Zealand; you can follow on his blog. I’ve been deeply frustrated by the apparent targeting of artists, whatever the requirements of the law, in the US and Canada. More on that soon; anyone with expertise or experience in these matters, I’d love to hear from you. I feel it’s worth bringing up, as I’m sure that someone would have done so in comments as this story has spread.)

I’m sure there are many, many other examples, but this seems to me a nice place to begin – and fertile ground for inspiration to make something yourself.