Continuing our insight into this view into electronic music performance and art through the lens of BodyControlled in Berlin, we’re joined by guest writer Kristin Trethewey. Kristin, a Canadian-born video artist and curator, takes another look at LEAP and BodyControlled, on the eve of its second installment. She gets straight at the question of what “BodyControlled” means, and what it can mean for sonic performance and creation. And I wanted to make sure to subtract myself from this write-up, seeing as I was playing – but see the excellent timelapse of the evening, above. -Ed.

LEAP is one of these spectacular Berlin venues you’ve been hearing so much about. It’s a huge, raw space with a view of Berlin’s landmark TV tower, hosting interesting art events with cheap drinks and the potential for a late-night party. But it’s unique, too, in its focus on electronic arts. And unlike other media arts centers, it’s not filled with computers and half-finished electronic projects. I’ve truly gotten lost trying to find this place (it’s tucked away in a mall), so I would recommend watching the timelapse video LEAP shot that guides you to the entrance before attempting to go there. Tonight is the second edition of BodyControlled, a new bimonthly performance series at the space. This installment, called “matter incompatible,” is held in conjunction with the Transmediale Festival under the satellite program, Vorspiel.

BodyControlled is a series focused on the intersection of performance and electronics. You can expect future programming to focus around ideas of “feedback” and “bio” related electronic performances. In its first installment back in November, a packed LEAP gallery witnessed performances by Robert Henke, Peter Kirn [editor of this site], Stephen Cornford, and Paul Whitty. The event was called “Other Spaces” and took the physical architecture of the gallery as a point of departure. Having the space filled with people made for a secondary concern of space: its use. In a series whose title mentions the body, I witnessed one performance engaging the bodies that were filling the space. Robert Henke’s twelve-hour set activated interactions between the audience, performer, and environment. He moved around, listened and mingled with the audience, even though he had this amazing, souped-up control station complete with ambient lighting.

Other artists put more emphasis on the manipulation and dislocation of space through the use and abuse of electronics. Kirn worked with a custom rig with tablet-controlled original software built in open-source software Pure Data (Pd), controlled by a tablet running Konkreet Performer. Excerpt:

Excerpt – LEAP Gallery Berlin, 26.11 by peterkirn

Whitty and Cornford actively deconstructed electronics in front of the audience:
it pays my way and it corrodes my soul (2011)

Stephen Cornford & Paul Whitty’s performance “it pays my way and it corrodes my soul” seeks out musical material by physically dismembering playback equipment. A reel-to-reel tape recorder is switched on and its mechanism amplified with a variety of microphones while it is taken to pieces. The sounds produced are then fed through an array of pedals: the machine’s belts, gears, switches and casing becoming an instrument subjected to a live audio autopsy

Excerpt:
Excerpt: Stephen Cornford & Paul Whitty, LEAP Berlin, 26 November by cdm

Cornford was also interviewed by LEAP for his installation work, featuring repurposed tape machines:

As João Pais, co-curator of the event with LEAP’s Daniel Franke, puts it:

“BodyControlled means the main direction of the series, to present performance and installation works that have a strong, corporal identity. This can be manifested in many ways, not only implying a “moving performer”. The purpose is to avoid the extreme of abstract performances made by a laptop-er, sitting down as if writing emails. In the first event, this idea was shown by interpreting/filling the space of LEAP through a sound-performance (Kirn, Henke), or an installation (Cornford, Mathy, Oliver).”

See also my write-up for ARTSCARDS from last month:
Other Spaces Generates New Spaces Through Sound at LEAP

The second event, “matter incompatible,” draws reference to the Transmediale theme: In/compatible, acknowledging the less clear, even dark forces at play in the artistic and political climate today. Matter Controlled questions the idea of the object or anti-object within sonification. See CDM’s write-up from yesterday:

Watch Artists Talk About Making Sound From Matter; Thursday Event and Stream in Transmediale Prelude

From the Transmediale podcast, some explanations of the theme of the larger festival:

Jacob Lillemose on the exhibition Dark Drives: Uneasy Energies in Technological Times by transmediale

Kristoffer Gansing elaborates on the festival theme in/compatible, as well as the in/compatible symposium: systems | publics | aesthetics.
Tatiana Bazzichelli is the curator for out new project reSource of transmedial culture and speaks about its concept.
Jacob Lillemose speaks about exhibition Dark Drives: Uneasy Energies in Technological Times which he is curating for transmediale 2012 in/compatible.
Sandra Naumann is the curator for this year’s performance programme The Ghosts in the Maschine, which she explains a bit more in detail.
And Marcel Schwierin tells us about his concept for the video programme he is curating for transmediale 2012 in/compatible.

Performances by Echo Ho, Mario De Vega, Alex Nowitz and Ignaz Schick will investigate this blurry region between the immaterial and material. I am curious to see what objects they will bring to play with. As they potentially seek liberation from the physical objects, by reimagining their sonification, I wonder how they are also reliant and maybe even drawn towards their objectification. Bringing these disparate emotions into play is at the heart of tonights investigation. In today’s climate fractures exist between so many aspects of our lives. These performances seek to bring some of them together, compatible or incompatible as we might discover.

You can watch the proceedings via live Internet stream, for the majority of you not in Berlin for the live show.

www.leapknecht.de

More Photos

About the Author

Kristin Trethewey is a Canadian video artist, cinema performer, and curator. She holds an MFA from Brooklyn College in Performance and Interactive Media. A multi-disciplinary curator and artist for the past ten years, she has recently completed a residency at the Node Center for Curatorial Arts, was co-Director/co-Curator of the INDEX Festival. She currently lives in Berlin.

Alex Nowitz for BodyControlled #2 from CDM on Vimeo.

Electronic media artist Mario de Vega (Mexico City/Berlin) says his work plays with the creation of “unstable systems.” As part of the official Vorspiel, or lead-up, to Berlin’s massive Transmediale festival, here we get to visit two artists working with the materiality of live performance, drawing from the festival theme of “in/compatible.” The sonic environments they create seem poised on the brink of sonic chaos, a dance at the edge of entropy.

CDM will again be editorial co-presenter of BodyControlled; you can see the show for free (donation suggested) in Berlin at LEAP, or tune into the live video stream from anywhere in the world, and we’ll be bringing you details of the artwork. We’re a ticket to Alexanderplatz that’s even cheaper than easyJet, in other words. The performances start at 20h CET Thursday, 26 January. (That’s 2p East Coast time / 11a Pacific, so scare your office mates and turn it up loud.) Full details below.

At top, composer/singer Alex Nowitz demonstrates his gestural performance techniques. I got to see his work for the first time at the Patterns + Pleasure Festival in the fall at Amsterdam’s STEIM research center. While at STEIM, Nowitz built on previous work with the Wii remote, and augmented his gestures with a new instrument, entitled the “Strophonion.” You can see that creation in the video above.

With each contortion of his body, Nowitz rips apart sounds, all while sputtering non-lingual utterances with his gymnastic voice. In the Amsterdam performance, one had the sense of following him into the Schwarzwald (Black Forest), an operatic odyssey echoing with forboding birdsong. But the system can also be dynamic and even, at moments, whimsical.

steim.org/projectblog/?p=3715
nowitz.de/

For his part, Mario de Vega’s “unstable systems” flirt even more with this notion of engineered incompatibility, with sounds that seem like they will explode in an earthquake-like tremor.

Mario de Vega for BodyControlled #2 from CDM on Vimeo.

mariodevega.info/

Films by João Pais, co-curator of the series; edited by CDM.

Also on this program, more works engage the idea of what the curatorial statement terms “hidden acoustics”:

Echo Ho (Canada/Cologne, DE)

Tuned to Site #26012012
This title is from a series of concerts, called “Tuned to Site #…”. As a whole, the series formulates the idea of “musification of urban landscapes”.
In the first performance of this series in 2012 Echo Ho will play a set of instruments: a self-fabricated hybrid semblance of the ancient Qin from China, which combines traditional acoustic and digital interfaces in one unique transparent plexiglas body. Like a sensor box, it will enable Echo Ho to make field recordings of inaudible hidden sounds within
the city environment, such as electro-magnetic fields, variation and wind movements. The performance thus marks the process of generating action by outlining situations in which sounds may occur.

http://www.echoho.net/

Ignaz Schick (DE)
Turntablist, sound artist, performer & composer Schick promises, through motors and objects, genuine accidents:

Site-specific performance with transducers, wireless controllers, feedback systems and back tape
Through accidents and their outcomes, actions, processes and objects that conceptually connect with acoustic information, the work of Mario de Vega researches the value of vulnerability, exploring the causes and effects that determine the construction of realities. In this site-specific performance with transducers, wireless controllers, feedback systems and back tape, de Vega is investigating aesthetic and social realms through a multiplicity of mediums.

http://www.zangimusic.de

Co-curator João Pais tells CDM that this installment, in keeping with Transmediale’s theme, will “give the performers a room where they can show their ways of working with the dissociation of matter (through sound, in this case) and expression.” Pais co-curates the event with Daniel Franke of LEAP.

This episode includes two self-made instruments that expand on existing practice, he says, in the case of Nowitz and Ho, and the hacked and modulated machines of Schick and Vega.

More information; where to see the show

26 January 2012, 20h (free/donation)

Show details

Anywhere in the world – all performances will be available from 20.00 CET via live stream:
http://bit.ly/uXRgyq

Facebook: on.fb.me/AmEtO9

LEAP
Lab for Electronic Arts and Performance
(Berlin Carré, 1. Stock)
Karl-Liebknecht-Str. 13
10178 Berlin

How to find LEAP

The latest in a long tradition of transforming hand-drawn graphics into music (see, in particular, Iannis Xenakis and UPIC), we see a computer-vision-powered pen-and-paper music generator. Kovacs Balazs writes:

This is a manual sounddrawer. Doesn’t need any sensors, but a camera, paper, colored pens. Doesn’t need sensor glove or reactable as well.

What I love about this, though, is that the resulting sounds are utterly crazy, a big collision of notes and sound.

By the way, UPIC lives on here in a very advanced program descended from the original tool:
http://www.iannix.org/en/index.php

From credits: Magyar Eötvös Ösztöndíj Alapítvány, UCSB-MAT, CSALÁD

More:
http://soundsofpictures.blogspot.com/2012/01/17.html

I’m saddened to learn of the death of Richard Lainhart, the New York-based composer and artist who has been inseparable from the experimental electronic scene for many years. I knew Richard to be a gentle and imaginative soul, an inventive technologist, someone capable of dreaming up endless soundscapes and auditory worlds. He was also a great contributor to the CDM community, including playing one of the early installments of Handmade Music at Etsy Labs in Brooklyn. (Photo above; full video at bottom.)

I think it’s fitting to illustrate Richard with a terrific self-portrait on Polaroid, one that illustrates his sense of humor and artistic adventurousness:

Richard’s wife Caroline posted a note with the news, which most of us found via Facebook:

Richard Lainhart February 14, 1953 – December 30, 2011

Dear friends of Richard,
It is with a heavy heart that I that I must tell you Richard Lainhart, composer, musician, technologist, filmmaker, and digital artisan died Friday, December 30, 2011.

On December 17, Richard complained of pains in his side and was admitted to the hospital for tests which showed an intestinal cancer. He was operated on on December 21. After the surgery (which showed the cancer had not spread), there were infectious complications which took his life on December 30.

He struggled valiantly to overcome his infection, but it was not to be. We are all in shock and cannot grasp the idea of his not making music, talking music, teaching, posting and playing.

Caroline Meyers
Richard Lainhart’s wife

Richard leaves behind a massive body of work and digital footprints; I’ve selected some of those below, including music, a wonderful set of images working with digital manipulation and Polaroids via Flickr, and his series on creative sound design tutorials.

Playing Messiaen:

Audiovisual work:

Richard’s most recent album, via Bandcamp:

Most recent SoundCloud contributions, including the winds after Tropical Storm Irene (that sound certainly is part of my sonic memory of 2011)

Sounds of my World – Post-Irene Winds 8-28-11 by rlainhart

200e-Continuum Percussive Study 2 by rlainhart

Sounds of my world – Rainforest V, New York Electronic Art Festival, 7-30-11 by rlainhart

I adore his photographic work:

A bio:

Richard Lainhart is an award-winning composer, author, and filmmaker – a digital artisan who works with sonic and visual data. Since childhood, he’s been interested in natural processes such as waves, flames and clouds, in harmonics and harmony, and in creative interactions with machines, using them as compositional methods to present sounds and images that are as beautiful as he can make them.

Lainhart studied composition and electronic music with Joel Chadabe at the State University of New York at Albany. He has composed music for film, television, CD-ROMs, interactive applications, and the Web. His compositions have been performed in the US, England, Sweden, Germany, Australia, and Japan. Recordings of his music have appeared on the Periodic Music, Vacant Lot, XI Records, Airglow Music, Tobira Records, and ExOvo labels. As an active performer, Lainhart has appeared in public approximately 2000 times. Besides performing his own work, he has worked and performed with John Cage, David Tudor, Steve Reich, Phill Niblock, David Berhman, and Jordan Rudess, among many others. He has composed over 100 electronic and acoustic works. In 2008, he was commissioned by the Electronic Music Foundation to contribute a work to New York Soundscape.

Lainhart’s animations and short films have been shown at festivals in the US, the UK, Canada, Germany, and Korea, and online at ResFest, The New Venue, The Bitscreen, and Streaming Cinema 2.0. His film “A Haiku Setting” won awards in several categories at the 2002 International Festival of Cinema and Technology in Toronto. In 2009, he was awarded a Film & Media grant by the New York State Council on the Arts for “No Other Time”, full-length intermedia performance designed for a large reverberant space, combining live analog electronics with four-channel playback, and high-definition computer-animated film projection.

quotes

“Lainhart crafts sounds in a tonal, musical fashion – sustained tones, drones, melodic fragments – and electronically manipulates them into beautiful tapestries of sound.” (Waterfront Week)

[His] “music reflects the spirit of possibility that once defined electronic music, bringing with it a sense of past, present and future that transcends time, technology and cultural assumptions. The spell- binding music seemed to evoke feelings that can’t quite be named, and suggest music I might rather imagine for myself in silence than trust most composers to compose.” (The Village Voice).

“He’s evolved a singular vision as a composer, performer and engineer of darkly seductive minimalism.” (Peter Marsh, BBC)

And here is Richard’s performance for us at Handmade Music on the Buchla 200e synth and Continuum Fingerboard, from 2007:

http://www.otownmedia.com
http://www.vimeo.com/rlainhart
http://www.youtube.com/rlainhart
http://richardlainhart.bandcamp.com/
http://soundcloud.com/rlainhart
http://twitter.com/rlainhart
http://www.facebook.com/rlainhart
http://www.downloadplatform.com/richard_lainhart

What an extraordinary thing an interface can be, a map to making music.

A new community-generated album from users of the now-legendary monome grid instrument yields a variety of musical outcomes. The results are instrumental and lovely, breaking off on lots of different stylistic vectors, but glued together by the notion of key and pitch. Let’s let contributor Joshua Saddler explain this – and the holiday album – as well as share some of the music. If you celebrate Orthodox Christmas or more generally the idea of “Holidays” (ahem), or if you just like good music, you can overlook the fact that the latter arrives a bit late on the Western calendar. But both albums are terrific, and I suspect the approach to the music in key, to sharing samples and field recordings, could well be an inspiration in your own music-making endeavors. Sometimes rules are liberating.

If you want to get a jump start on musical New Year’s resolutions, I can think of nothing better. Joshua writes:

The monome community has released not one, but two albums for the holidays. Both are freely available at http://mcrpmusic.bandcamp.com

The first, MCRPv11 (Monome Community Remix Project, volume 11), was released mid-November, five months after the MCRPv10 album (which CDM has previously covered).

http://mcrpmusic.bandcamp.com/album/mcrpv11-all-keyed-up-edition

As with all MCRP albums, there are guidelines and a theme. Participants submitted a field recording and a short instrumental sample in the key of G/E-minor. The participants then chose as many samples as they wished from the shared pool (though they couldn’t use their own samples), and had a couple of weeks to assemble their tracks. Sounds ranged from falling rocks to ocean waves to modular synthesizers to toy ukeleles and dogs barking. From this pool emerged fifteen startlingly diverse tracks.

Have a listen, and head to Bandcamp for downloads in any format you desire:

I appreciate the chance to see Joshua’s process in video:

I’m pretty pleased with how my contribution, “mnml autmn,” turned out:

mnml autmn by ioflow

I sequenced bits and pieces from four samples with Renoise (in some cases using single-cycle waveforms…so it still counts, even if it sounds nothing like the original!), exported sections to loops, and performed them live with rove (http://docs.monome.org/doku.php?id=app:rove) on a monome 128. I recorded and rearranged the resulting segments using Ardour3‘s timeline view. The tracker and the traditional DAW actually worked well together. As I’m the sole Linux musician on the album, composing and arranging takes much longer using free software than more common tools like Ableton Live. Things that took me hours are probably three-click operations in Live. Still, by having to strike out on my own, I learn so many new things each time I sit down to create…it’s worth the occasional frustration at not being able to do things the easy way, using the same process as everyone else.

The second release is the annual Monome Community Christmas Album volume 2, made available on December 21.

http://mcrpmusic.bandcamp.com/album/monome-community-christmas-album-volume-2

This project had much more leeway; no hard-and-fast rules about samples or themes. I ended up forgoing the monome entirely for this album, instead improvising an original acoustic piano piece:

gloria by ioflow

http://soundcloud.com/ioflow/gloria

There were fewer participants for MCXAv2, since it began immediately after MCRPv11, but the quality of the tracks is still extraordinary. Warm neo-retro-loungetronica. I’ll be listening to it year-round, not just in December.

Me, too. And perhaps you, as well:

Thanks, monome-ers!

http://monome.org

Consumption, or creation?

When it comes to notation and musical scores, the iPad (and tablets, generally) has fallen on the side of reading rather than writing, display rather than creation.

Notion for iPad, a mobile version of the desktop notation software, looks poised to change all of that. See video, above, for an overview of the features. Highlights:

• Entry, editing, and playback for notation and guitar tab
• Built-in samples, including keys, guitar and bass, and the London Symphony Orchestra as recorded at Abbey Road Studios
• Enter notes by tapping a keyboard or 24-fret fretboard, or select and drag and drop
• Mixer and effects
• Orchestra and guitar articulations and marks
• Text/lyrics support
• Import MIDI, MusicXML, GuitarPro, and export to PDF, MusicXML, and MIDI
• Look for guitar tab, MIDI, and MusicXML right inside the app – this could be a huge feature

There are also in-app purchases of instruments and effects and so on.

It’s a big deal, I think, and a huge release. Even if you use software other than Notion on desktop, I can see this as – at last – a way for people comfortable with notation to sketch ideas and enter MIDI and scores from a music stand. I look forward to testing it. (Anyone know of any other candidates in this category? Since Sibelius focused on score reading, Notion seems to be the first major release of this kind for a tablet.)

Thanks to everyone who sent this in.

http://www.notionmusic.com/products/notionipad.html

By the way, what’s up with the lines at the end of the video?

You Honor Tradition!
You Defy Genre!
You The Create Future! [sic]

You have come to fight as free men, and free men you are. What would you do without freedom? Will you fight?

They may take our lives, but they will never take our freedom!

(Sorry, I may have broken into the speech from Braveheart there. It could be the London Symphony Orchestra music. Alba gu bra!)

Since today is Beethoven’s 241st birthday, it seems only appropriate to inject a little conventional notation into today’s coverage. And what better way to do that than with an iPad app that promises some musician-friendly reading features.

We’ve already looked a couple of times at Avid’s Sibelius-powered Scorch iPad reader, which features nice output and score integration, and recently added PDF support.

Scorecerer has some unique features – aside from, augh, a somewhat unpronounceable name. It goes further in page turn control, MIDI integration, and DAW integration (through MIDI program changes). A desktop version aids in scanned score management.

And it has two potentially killer features: one is the ability to manage converting your conventional notation to PDF, and the other is – at last – proper markup.

Run-down of features:

• Markup: highlight or add handwritten notes (why every app doesn’t include this, standard, I have no idea – it’s a deal-breaker without it.) See the video for more.
• Meet your MIDI page turner: Load songs, change pages, from any MIDI instrument – or send page turns from a DAW’s sequence playback (via a program change message) for automated page turns.
• Total page layout control: Arrange pages in an arbitrary sequence, so, for instance, repeats and DS al Coda sections simply repeat in front of you instead of requiring you to go back.
• Desktop PDF conversion: Scan images or import PDFs, straighten out crooked scans, remove borders, create lead sheets, all in a batch-conversion desktop management tool.
• Desktop Pro software: Add on this US$39.95 desktop companion, and you additionally get to publish scanned or imported music as a set of images, PDF, Kindle DX, or MusicPad Pro. (The free iPad edition only exports to the iPad.) You can also batch convert a stack of music – like an entire fake book – by splitting it into PDFs.

The emphasis on scanning and importing PDFs is a concession to the likely reality of iPad notation users. Simply put, you’re probably not going to use an iPad for notation unless you can make it useful with all the scores you’ve already got. Now, some of this batch processing I imagine could make publishers very nervous about piracy. But I still imagine that – as we saw with the combination of digital downloads and ripped CDs, only with yet-more-expansive collections – we’ll see a bit of each. (Selling scores online I still think will be a big market for publishers.)

But I just keep coming back to this: you have to have markup. And I look forward to watching tablet apps in general work to provide features that make them more usable to musicians.

More on the app:
http://www.deskew.com/

There’s a free, “Lite” version that you can try out first.

The full version is US$9.95.

Scorcerer @ iTunes App Store

Sound and light artist, guitarist, Max patcher, and all-around sonically-fascinating guy Christopher Willits has opened up his “Tiger Flower Circle Sun” record on Ghostly to remixing. Halfway through the project, we talk to Chris about what’s going on – and what the results so far sound like. And we share, from earlier this fall, a composition in which you can recharge.

The project begins not with stems, but with samples, the raw materials on which the album was based. Christopher walks CDM through the audio highlights, one sample at a time. Along the way – as with all these samples – you begin to appreciate the process by which Christopher makes his decisions, how he moves from samples like pieces of wood to the finished structure. And of course, by opening these up to remixing, you have an opportunity to hear the work differently in his finished, released form, as well as to find your own, distinct decision-making process. It’s perhaps obvious in a remix project, but what this does is to allow the sounds a life separate from the fixed set of decisions that produced the album.

And that can even change Christopher’s own view of the work, he says. He tells us:

I think it’s fun to play the set like an album. I’ve heard these pieces so many times that it’s really refreshing to me to hear them alone. Now I hear the pieces differently.

That was actually one of the thoughts behind sharing all of these sounds, so people can hear the layers, and if they wish, tune their ears to the subtleties and intention I wanted to create in the mixes.

You can find the remix project at:
http://willits-sample-library-vol1.herokuapp.com/

“The stuff i’ve heard so far is AMAZING,” Christopher tells us. “I can’t wait to feature the best of the best. We’ll be releasing a free comp on [Christopher's experimetal label] Overlap and Ghostly will feature my favorite remix on a free comp, too.” Winning remixes get Ableton and SoundCloud prizes.

Let’s hear a few words from Christopher about the sounds he’s produced.

A Tour of the Sounds

A lot of the samples are about variation of common materials, so there’s plenty to explore. Christopher tells us that just one sample – like this guitar solo – can take on very different meanings with different processing, heard in two variations.

Guitar process solo1-Sun Body-Willits-120 by Willits

Guitar process solo2-Sun Body-Willits-120 by Willits

This tone is created from a custom-made Big Muff > BOSS distortion > Fender Twin with a couple power tubes removed for low volume and max distortion. This is a trick that ted from Flipper showed me around that time, and it created the exact orange laser beam i was hearing in my imagination.

Guitar solo long noise-Sun Body-Willits-120 by Willits

Guitar solo-Plant Body-Willits-120 by Willits

The whole piece “Plant Body” came from this guitar improvisation. With releases like “Folding and the Tea” and “Seven Machines for Summer,”

I set the process to be only the guitar recordings. With this release, I gave myself a new set of constraints and permissions, allowing my imagination to add whatever comes up for me. No judgement on which one is better to me, they are just different. There are infinite possibilities within any process I determine, yet discerning the process that resonates with my true intention is what creates the shapes and forms and colors that feel like love.

Guitar process4 fold-Plant Body-Willits-120 by Willits

The drum samples come from:

…my great friend Jeff Pierre – one of the best drummer I’ve ever worked with, and the youngest, as well. All of Jeff’s takes were one take; this sample is shortened from the original length, but you get the idea.

Drum2-The Hands Connect To The Heart-Jeff Pierre-Willits-120 by Willits

Drums distorted1-You Are Always Surrounded By Stars-Jeff Pierre-Willits-120 by Willits

I just love the lightness and feel of this sound — like the funkiest insects in the jungle, getting down.

Perc1-The Hands Connect To The Heart-Willits-120 by Willits

Someone please make a disco track out of this.

Synth arp-The Heart Connects To The Head-Willits-120 by Willits

Me and my friend Reiko were messing with patterns; then we would find a loop. We were laughing so hard as we were playing this stuff.

Perc-Intend-Evolve-Willits-120 by Willits

Check your volume for this one — probably should have exported it at a lower volume for this set! The heat of this, the crushed distortion, is from a technique called input flipping on the SSL. This is an input flip with the preamps cranked, with odd harmonics.

Ryan (Ryan Kleeman) and I just about lost it when we first input flipped like this for a distorted sound. It became a theme in a sense that resonated with this orange laser beam electromagnetic sound that much of the work stems from.

Synth arp noise-The Heart Connects To The Head-Willits-120 by Willits

You can also hear it here- and a few other places on the record, to a less extreme degree. There is something about this texture that has a cleaning function to me. Washes things off, away, cleans the ears out. Resets your space.

Branches Into Flowers-Willits by Willits

“Could hear many more strings and horns in this piece.”

Guitar2-You Are Always Surrounded By Stars-Willits-120 by Willits

“Love this floating feeling.”
Guitar lasers-You Are Always Surrounded By Stars-Willits-120 by Willits

“This pattern makes me want to get down.”
Perc distorted1-You Are Always Surrounded By Stars-Willits-120 by Willits

“Love this kind of generative sound.”
Subconscious Transmission-Willits-120 by Willits

Two samples that were not used in “Light into Branches.” Made the baritone thing in one mode of listening, came back and asked myself, why did I put a baritone guitar solo in the middle of this song? Did I really think that’s what it needed, or did I just want to play my baritone along with this song for fun? The answer was the latter. But here it is anyway.

The ambient layers sample was to create more depth of field in the mix, have it floating behind at a low volume, but it was not doing was I wanted it to, so I cut it out.

Baritone solo unused-Light Into Branches-baritone-Willits-75ish by Willits

Guitar layers unused-Light Into Branches Willits-75ish by Willits

Videos

From the original record release:

More information:
http://ghostly.com/releases/tiger-flower-circle-sun

Soak in a Sound Bath

Another release from this year revealing Willits’ musical approach, “GOLD” is an ambient piece in you can inhabit, in which you can restore yourself, according to its maker:

GOLD is a 24 minute and 17 second sound bath / ambient piece to soak into. Listen, relax and recharge. This harmonic weaving of sound was created with the vibration of affinity, love.

Made with voice, processed guitar, and a low-frequency oscillation out of a Nord Lead synth, Christopher actually encourages people to share how they “used’ the piece and how they made it felt, a kind of design experiment for spiritual being in sound. Have a listen or pay-what-you-will on Bandcamp:

Read up on what he has to say about this release:
New Release – GOLD [Sound + Light - Chris' blog]

Infinite

It seems only appropriate to close with this reflection from Christopher:

After working on this project, I’m realizing so tangibly what I’ve always known — that any mix is a sonic photograph of vibrational affinity, and even with a grounded intention behind any mix, and a very clear outline for a process in which you allow that intention to emerge, there are infinite possibilities of expression. Infinite. It is so beautiful.

Graphics are good. Graphics are shiny. But when it comes to reality-bending, emotionally-immersive, perception-shifting power, look to sound and music.

At least that’s the feeling you could get after playing Dimensions. Following their reactive music tools and Inception dream states for iOS, RjDj have turned their mind-altering sonics to gameplay. As with previous releases, these tools are powered by the open source visual development environment Pure Data. Pd engineering wizardry here meetings the compositional and sound design prowess of Hans Zimmer.

You can see a bit of how the musical world works in the teaser video above, and the music sound design video below.

But we wanted quite a lot more information. So, CDM got RjDJ’s Rob, Joe, and Martin to share some detailed thoughts on how the game experience is put together and how it works.

The App

RjDj Team: Most games require your full attention when you play them. You either live your life or play the game. Dimensions is different. It’s designed to be played in parallel with your normal life.

Gameplay is intertwined deeply into your daily life. Some dimensions unlock if you are physically active and others unlock if you are quiet. The app automatically detects what you are doing and syncs the game to it making use of every possible sensor on the iPhone.

You stay immersed in the game by listening to augmented sound and the voice of Emily from Mission Control. She guides you through many exciting challenges like collecting Artifacts and avoiding the dreaded Nephilim.

With Dimensions we are very interested in creating a gameplay experience which is between the device based focus of a casual game and the passive use of listening to music. Its a game which you play by listening – a game that place in parallel to your everyday life.

The Tech: Reading Files

We built our own version of readsf, rj_readsf, in order to be able to read compressed audio and make the samples available for processing in Pd. One advantage of readsf is that possibly lengthy audio assets do not need to be loaded into memory. If memory is limited, especially when Pd may be running in the background, limiting exposure to system memory warnings helps keep the app running and the music playing. Given that compressed audio is roughly ten times smaller in size than uncompressed audio, and that audio assets make up the majority of the size of the entire app, it is a huge benefit to be able to deliver and read compressed audio assets directly, without the need to decompress in memory or onto disk. Dimensions requires that several dozen such players be open and viable at any time, and special consideration was given to concurrent behaviour. rj_readsf can loop a file when it gets to the end, and it indicates with a bang when a file has been loaded (an asynchronous operation) or the end as been reached (in the non-looping case). rj_readsf is built on iOS standard APIs and can read any file format that iOS can.

Ed.: I’m waiting to hear if rj_readsf will be open-sourced. The issue of reading files is one we’ve had around libpd recently. While their rj_readsf sounds great, my sense is the best long-term solution will be a similar object that is independent of the APIs of any one OS, so this same set of problems may need a different solution for the open source community more generally. (Building such a tool is absolutely possible, though it might require more effort.)

The Music, and How the Music Plays with You

The music of Dimensions uses various different techniques from straight sample playback to audio analysis and synthesis:

Realtime manipulation of audio input from the mic:

This is perhaps the most recognisable technique we use. We process audio from the iPhone microphone live in many different ways. It’s kinda like a feeling of being inside the music.

The key thing we do with effects is attempting to analyse the environment of the player / listener and then making appropriate things happen within the effect. For instance, the Flux Dimension features a filterbank on the mic input. We analyse the incoming audio from the players environment and make the filter frequencies change as events occur ( either due to pitch changes or onsets ) this gives the impression that objects and activity around the player is somehow “playing” the music.

In the Ghost Dimension there is an effect which records audio whenever it detects an event, then scrubs repeatedly forwards and backwards through the sample using granular techniques stretching it out in time. This manipulation accentuates the textural and pitch based qualities of the sample as it repeats and works well with the atmospheric music Hans Zimmer composed.

Dynamically-controlled stems:

All the Dimensions use stems and hits from a conventional sequencer in some way, re-arranged live on the device relative to how the player is interacting. These stems were mainly composed in Cubase and Logic.

For example, in the Kinetic Dimension we feed accelerometer data from the device into Pd and drive the music from that. The player hears more energetic beats when they go for a run, but if they stop at the lights to cross the road, the drums immediately drop away. This was achieved with a large number of hits with all the rhythmic sequencing happening in a hybrid reactive / generative way live on the device.

In the Tranquil Dimension, the music introduces more stems the longer the player is quiet. If they make too much noise the music “shrinks away” from them and becomes quieter. If they stay in a Zen like peaceful state, the music grows into a kind of crescendo of serenity.

Reactive synthesis:

We often control parts of the music by doing a frequency analysis of incoming microphone audio from the device and then using those frequencies to determine the notes synths will play within the music. The Travelling Dream in Inception the App uses this extensively. Tranquil Dimension in Dimensions also uses onset and frequency changes to trigger synth melodies in the music.

The synths we use range in complexity from very simple additive synthesis to some great synth patches from the rjlib by Frank Barknecht and Andy Farnell.

Generative approaches:

There are some sections within Dimensions which are generative. These play back prepared samples as well as triggering onboard synthesis. They also feed the results of this through various live sampling and glitching patches. They are governed by various sets of rules which have various long term parameters, like adjusting to the intensity of the audio environment of the listener, or how dense areas of music have been around the present time.

Sample triggering:

Ghost Dimension uses a simple but effective technique of triggering samples from the music on onsets in the environment. This can cause some real jump out of your skin moments. We combined this section with a randomised very short delay on the mic which acts almost like a resonator, turning the mic sounds into creepy atonal pitched noises.

Sound Design

The main hub section in Dimensions, called the Launch screen, acts as a entry point to your augmented adventures. It also displays all available Dimensions via the floating tile icons.

Visually, these represent a snapshot of your previous experience using your location at that time. Sonically we wanted them to have an aura or energy from the Dimensions themselves.

SoundCloud examples:
Dimensions Sound Design Example by rjdjme

Example of using mixture of synthesis and samples to create user feedback when interacting with Dimension icons in the game.

Map Tile Down: several recordings of a synth in Pure Data that is played when the tiles are touched. Each one is slightly different due using two detuned oscillators.

Map Tile Open Only: a sample from Logic Pro for the woosh sound when showing the information view.

Map Tile Click: a sample from Logic Pro for touch events.

Map Tile Open: recording of how it sounds when put together.

Sound is a mixture of samples and real-time synthesis. The energy sound is made using two oscillators (one detuned) to create some modulation for a glowing effect. Added to some harmonics to make it more of a beam sound and some chorus and reverb. The open tile is made in logic, when closed it’s the same sound but reversed and pitched down in Pd.

We wanted the tiles you tap on to feel like each Dimension has some sort of energy radiating out.

Here’s a sense of how the sound design works in the game:

It’s an ambitious app, and the whole cost is US$2.99. I guarantee it’ll change your world more than a latte. (Well … unless we’re talking a really crazy latte. And that might not be legal.) As sometimes-CDM contributor Jaymis Loveday notes, there are terrific choices in coloring Google Maps, and how modes change based on ambient sound and motion.

Requires an iPhone 3GS or better, or third-generation iPod Touch or better, or an iPad.

Dimensions @ iTunes Store

More reading:
Dimensions Augments Reality Purely Through Sound [Leigh Alexander, one of my favorite game writers, for Gamasutra
The Roundabout Tapes – RjDj now plans to game reality with sound [TCTV] [Techcrunch EU]

Arvo Pärt’s music is always spare and gorgeous, inspired by Medieval counterpoint and voicings, and you’d expect it to be such on any instruments. But here, you get something truly unique: a transcription of the composer’s ‘Fratres,’ normally played on string quartet, on a mixer.

The no-input performance uses exclusively tuned audio feedback to generate sound, creating an almost vocal quality to ringing timbres generates entirely in the mixer.

Details:

Camera : Jimmy Hayes
Console : Christian Carrière
Research residency, Summer 2011
OBORO, Montreal, Canada
oboro.net/

Console : Allen&Heath GL2400-40
Thanks to Claus Frostell of Erikson Pro, who lent me the console, which made this project possible. eriksonpro.com/

The project is the work of experimental musician Christian Carrier, a Montreal-based sound artist and composer.

http://christiancarriere.com/

Thanks to Gregory Taylor and Todd Reynolds, among others, from whom I found this on Facebook.