If you think culture has become too disconnected from the Earth, “Harvest” and the Terrafon instrument surely count as a shock to the system. A traditional ensemble picks up an enormous tone arm and transducer and, through back-breaking labor, drag it across arable fields. It’s part sound art and performance, part agriculture. But it certainly counts as a gramophone – it’s just a really big one that reads the grooves of the earth.

Beat juggling with two of these I’m guessing is largely out of the question.

One half of the artistic creative team, Olle Cornéer, writes with a description:

Harvest (2009) is a new art piece for the new instrument terrafon, traditional ensemble and cropland – by Olle Cornéer and Martin Lübcke.

In this performance Alunda Church Choir, conducted by Cantor Jan Hällgren, plays the soil of northern Uppland (in Sweden) on terrafon. Harvest by Alunda Kyrkokör was exhibited at the Volt Festival in Uppsala the 6th of June 2009. Terrafon is a large agricultural version of the horn gramophone, amplifying the sounds in the track it ploughs.

There is more to come. There are still many croplands still untouched by terrafon. The only thing needed is a powerful local musical ensemble that can sweat it out. This is indeed a demanding piece.

Video illustrates what this all means in practice:

Harvest by Alunda Kyrkokör (2009) from Olle Corneer on Vimeo.

The artistic duo behind the work is a fascinating collaboration. Olle is a producer and musician, while partner-in-crime Martin Lübcke has a PhD in theoretical physics, specializing in superstring theory. That has been the grounds on which their other work, Bacterial Orchestra, explores ideas both of biological epidemics and multi-celled organisms and neural networks. Of course, to make it truly multi-celled, they’ve made the piece an iPhone creation. (I think some folks have found the iPhone phenomenon to be viral as is, so this seems somewhat appropriate.)

Public Epidemic No 1 from Olle Corneer on Vimeo.

Every cell listens to its surroundings and picks up sounds, trying to play together in a musical way. The musical material comes from the background noise, people talking or sounds played by other cells.

Every cell has a unique DNA. Only the ones that are musical fit enough survives. If
the surroundings doesn’t meet up to its conditions – too noisy, too quiet or no distinct
pulse – the cell dies and is reborn with a new, hopefully better, set of DNA.

The result is a musical organism adapting to and changing its environment, growing and evolving with other cells and spectators.

More on that piece:
http://www.bacterialorchestra.com

It’s nice to me that, while these works are both conceptual, you might not guess they came from the same team. I wonder what will come next.

As an addendum to the last story, Ivica Ico Bukvic sends along an example of the [myu] Max/MSP + Unity game engine combination in action. Here’s the surprise: Unity isn’t generating visuals. Instead, Unity simulates ripples created by movement in the space, and builds physical models that are sonified and spatialized by Max/MSP.

Speaking of work involving art museums and the combination of Max and Unity, VJ Anomolee notes in comments his own work with the pairing. Lightbent Synth is an in-progress piece with alternative controllers and sensors that produces sound with a novel visual representation (sound’s very quiet in this preview — more hopefully once it progresses):

Lightbent Synth from VJ Anomolee on Vimeo.

Ivica explains the top work:

This past fall [myu] had seen its first real-world implementation in an exhibit that was a part of the grand opening of the Taubman Museum of Art in Roanoke, VA (http://www.taubmanmuseum.org/). The exhibit utilized [myu] as part of an interactive aural installation titled "elemental." An online tech
demo video of the installation, including written synopsis is available also via Youtube at http://www.youtube.com/watch?v=PA-9BOgc1gk. Below is a brief synopsis of the installation:

"elemental" interactive communal soundscape premiered in November 2008 as part of the Revo:oveR collection commissioned for the grand opening of the Taubman Museum of Art in Roanoke, VA. The Youtube video focuses primarily on the technical aspects of the installation. Using Max/MSP/Jitter, a homebrew IR webcam with fish eye lens and a LED-based IR spotlights, entire 24×36-foot exhibit space is converted into an aural sandbox giving visitors an opportunity to generate and shape the
ensuing soundscape. Positional data of up to 20 visitors is forwarded to Unity3d using [myu] Max-Unity interoperability toolkit developed at DISIS (http://disis.music.vt.edu). Unity is used for physical simulation of ensuing ripples and the resulting data is sent back to Max for spatialization across a 12-channel (4×3) ceiling-mounted speaker array. Driven by communal interaction, virtual ripples refract from each other spawning an algorithmically generated aural fireworks. The exhibit ran non-stop for approximately 5 months until March 2009.

Bonus video below: an early prototype that did include visuals. After days of looking at emulated knobs and faders, it certainly does speak to some of the possibilities for musical interface and expression.

Fractals, those wacky self-similar, rough geometries that resemble so many patterns in nature, were once all the rage. Ravers and digital artists embraced them, only to get bored with them, apparently. To billions of years of evolution and natural phenomena, they’re still cool. And to me, there’s still plenty to talk about when it comes to thinking how fractals might be all the rage.

Composer Terran Olson, a musician with a long resume that includes work with the Ives Quartet and Quartet San Francisco, takes on the idea of fractals in a new article. Writing for our friends at Rain Pro – makers of music and visual pro PC laptops – Terran explores how fractal patterns could be applied to sound.

Exploring Audio Fractals

The results are fascinating: they’re a kind of fractal synthesis. Of course, that gets at the heart of the question: just how do you map a visual pattern like a fractal – or anything else visual – to music? The answers aren’t always intuitive. The biggest question is whether to work at the scale of sound (Terran focuses on individual samples and impulses), or to deal with musical patterns. I knew I had read a fractal article in Electronic Musician; sure enough, in 1999 EM did a story on fractals that focused instead on pitch mappings. (Bonus: Bach even comes up.)

Fractals and Music

Composer Gustavo Diaz-Jerez penned that story, and the results tend toward algorithmic music. Many of the tools are now gone, though some survive (Csound) and other tools (Max/MSP, Pd, SuperCollider, Reaktor, ChucK) could certainly fill in.

And, of course, for a truly high-level musical approach to fractals, skip the individual sounds or individual notes and write a whole song, like Jonathan Coulton’s brilliant fractal ode, “Mandelbrot Set.” (It should also help anyone needing to, erm, brush up on their fractal theory.)

Sadly, neither of these articles is especially useful as how-to – great on theory, but not so practical if you haven’t tried these things before. That begs for a new tutorial. Are you working with fractals these days? I’d love to hear what you’re doing.

Hans writes:

tiction – early prototype 1 from Hans Kuder on Vimeo.

tiction is a sequencing / performance application that tries to bridge generative music with live improvisation. With it you can create looping (or one-shot) sequences whose pitch and controller values change based on screen position. When a node fires its event, subtle or not-so-subtle physical interactions take place, giving life to the system.

Tiction v0.1 is now available as a free download for Mac, Windows, and Linux. I’ll be adding updates over the next couple weeks, but most of the useful features are already in place.

This is just a graphical interface; actual sound happens elsewhere, via MIDI. (Hans includes instructions for inter-app MIDI on Mac. On Windows, you should try MIDI-Yoke or Hubi’s MIDI Loopback.)

The video above is slightly older than the release you get, so there’s an extra reason to go grab it.

Free software + code + description/instructions for Mac, Windows, Linux. Version 0.1; expecting more soon!

Tiction @ Tink Thank Software

Before someone else says it, no, the idea here isn’t entirely new. It’s especially reminiscent of the work done by Toshio Iwai, best known recently for his Tenori-On hardware and ElectroPlankton DS software, who had experimented with similar interfaces — though generally minus some of the physics here. But then, we got a lot of mileage out of simple step sequencers, and they’ve evolved a lot. It’ll be interesting to see what new interfaces people can cook up.

Those of you Processing users, one tip. Hans is using the ProMIDI Java library, but there’s a better library evolving called RWMidi from our friends over at Ruin & Wesen, plus a driver that will fix problems with MIDI support and Java on some Macs — check out OSXMidiSPI for OS X (direct download).

Brilliant work, Hans! Readers with feedback, please pipe up since Hans asked for it; otherwise, I’ll be interested to see how this evolves!

One more video:

tiction – early prototype 2 from Hans Kuder on Vimeo.

Imagine this: you have a real-time interface that must be responsive and satisfying, simple enough to be approachable, but sophisticated enough that you’ll want to finely hone your skills over time. You’ll juggle a variety of elements to control with split-second accuracy, but even with elaborate mechanics under the hood, the whole thing, above all, has to be fun.

Sound familiar? It’s a description that’s equally apt for traditional music instruments and modern music software, as much as it is for games. The fact that, once they’re done, a game is often very not like familiar music software and instruments suggests the range of possible solutions to these design challenges. And suddenly, after years in which the games industry clung conservatively to tied and tested models, indie game designers with oddball game designs are grabbing the headlines. Some continue to tackle the meeting point of game and music making. Others offer inspiration for what futuristic 3D musical interfaces might look like.

I unfortunately didn’t make it to the game developer pow-wow that is GDC, but our friend Josh Randall at Harmonix tipped us off with these top picks. Given the blog buzz they’re earning, you may have seen some already, proving great independent game design may not be constrained to obscurity any longer.

Some games are playable on Windows now; Mac users may want to hit up Boot Camp, or watch for release on a console near you. (The pattern seems to be, prototype on PC but ship on consoles where better money can be made.)

Fez, pictured above, is here for two reasons. One, it promises some brilliant game mechanics. The Wii addition to the Paper Mario series from Nintendo suggested some of the game play mechanics of switching from 2D to 3D. Most of the actual execution only hinted at the possibilities. Fez goes further, with mind-bending shifts from two to three dimensions. Rather than see the lack of depth perception in imagined game worlds as a limitation, it makes it part of the game play — and reminds us of the gap in perception in 2D and 3D worlds, something that should raise the attention of anyone doing interface design (musical, sonic, or otherwise). The second reason is simple — the retro-tinged music score, apparently from producer/musician Jason DeGroot, sounds brilliant. Follow the game’s development at Kokoromi’s site:

Fez @ Kokoromi

Audiosurf perhaps got the most attention in the music games category. Pop in music from your collection, and race through a score generated by the music. It’s tough to resist this one at US$9.95 from Steam, especially for game music fans — the soundtrack from The Orange Box is included. The game is described thusly:

Audiosurf is a music-adapting puzzle racer where you use your own music to create your own experience. The shape, the speed, and the mood of each ride is determined by the song you choose. You earn points for clustering together blocks of the same color on the highway, and compete with others on the internet for the high score on your favorite songs.

And it’s got lots of extras: characters, strategy, and Steam Acheivements support. My only disappointment in this game is that the actual gameplay mechanic doesn’t deviate much from games we’ve already seen — though, then again, if you miss the design of Harmonix’s earlier Amplitude or Frequency from the days before Guitar Hero and Rock Band, this brings back the fun “interactive racer.” But I do hope that as indie developers come up with a truly interactive music remixer for the age of Ableton Live — and perhaps some fly mechanics that don’t come straight out of Wipeout XL. Not that either of those is likely to stop me from playing with Audiosurf, mind you.

Audiosurf @ Steam

PS – Audiosurf wins major extra points for being available now, which a lot of this other, tantalizing stuff is not.

With so many games focusing on making music into games, Fret Nice takes a different approach: it’s a platformer that allows you to play the game “as if it was a rock song.” Currently in prototype phase, it already looks terrific visually. Unlike Nintendo’s somewhat flawed attempt to do platformers with its bongo controller, the physical movement looks satisfying. And back to what this could mean for musicians, it is evocative of what could be possible with futuristic, interactive music scores.

Fret Nice

Available now in an early-ish build for Windows, the frenetic Synesthete is perhaps the most ambitious of the games here as far as mechanics. Yes, some of the conventions of rhythmic music games are there — synchronized motions and falling bricks. But rather than resist that convention, Synesthete explodes it onto an isometric-projection gameboard, with power-ups and magical charm blasts and … well, have a look at the video. It looks as though you’ve jacked into the brain-powered computer system in Ghost in the Shell.

Synesthete

Crayon Physics is not a music game, but I’ll close on it because, like Fez, it’s notable for its soundtrack and its gameplay / interface design. The design has you solving puzzles by drawing physics-driven illustrations, as the name suggests — if you enjoyed our look at new music interfaces built in Processing, you’ll draw (ahem, sorry) plenty of inspiration from this. And, of course, it’s very possible to do stuff like this in Processing, Flash, and the like, and make a game that’s a musical or sonic interface. The music in question in this game demonstrates the potential of Creative Commons music, making use of a non-commercial license for the lovely Lullaby by _ghost on open music site ccMixter. Think that’s just giving your money away? Think again: many bands actually pay for exposure in big-budget games. In this case, the artist just got a load of publicity along with the game — and since it’s a non-commercial license, such things could lead to commercial collaborations in the future.

Oh, and most importantly, the game is fun. (The prototype is available, but a higher-quality game is forthcoming)

Crayon Physics @ Kloonigames (original prototype)

Crayon Physics Deluxe (the version shown at the Independent Game Festival)

Got some indie — or vintage, or otherwise — games that inspire you musically / interactively? Let us know.

It’s the music of the spheres. Or at least, the music of the various, floating geometric shapes, bouncing around a virtual galaxy with gravity simulation. Kepler’s Orrery is a (newly) open-sourced generative music maker, based on a gravity simulation algorithm. As bodies collide, they make sound; it’s a bit like what would happen if you crossed a music box with a snow globe. Different worlds represent different songs. You can reach in and grab some of the objects, so it’s possible to “perform” with the project.

The application runs directly in a web browser (assuming your Java is up to date), and since it’s open source, digging around in the code could inspire your own Java-based musical environment.

Kepler’s Orrery Project Page, with notes, source code, and a live applet
Creator Simran Gleason Talks About the Project on java.net in a podcast (MP3)

And yes, there are some similarities here to the generative music of Brian Eno (soon to be heard in the upcoming Will Wright game Spore) and sound artist/composer Toshio Iwai’s ElectroPlankton game. Perhaps we have a whole genre of musical creation in the works here.

Related:

• Flash-Powered, Animated Musical Painting: Visual Acoustics
• NuSofting’s Collide and Play plug-in uses a similar, physics-inspired interface
• Videos and more featuring Nintendo ElectroPlankton and Tenori-On creator Toshio Iwai
• Why ElectroPlankton is wonderful — but falls short of being the music tool it could have been
• Brian Eno, with Will Wright on Spore and Generative Systems, Sound, and Paintings

In celebration, go check out the excellent Wikipedia page on the Doppler Effect, including one of my favorite Physics equations (while I wasn’t failing.) And if the idea isn’t sinking in, there are plenty of online demonstrations of why this effect occurs. (Science aside, I also recommend celebrating by imitating the sound of an English police car driving by in a movie. It works best if you simultaneously run by your significant other at high speeds.)

Because light can be a wave as well as a particle, the Doppler effect applies to light as well as sound. An increase in the observed wavelength of light emanating from a star is called a redshift. The principle is the same: as the source gets further from you, the wavelength (what it sound we perceive as pitch) shifts; in the case of a star, that translates to observed color.

Here’s the mind-bending caveat: there’s a misconception that Doppler-like redshifts are what allow astrophysicists to measure the expansion of the universe. Wrong! Why? Because it’s not the stars moving away from you (a la the Doppler ambulance); it’s the intervening space stretching, as per the understanding of General Relativity. There you go; if that hasn’t convinced you to go have a drink in honor of Christian Doppler, nothing will. (Heck, it’d probably convince him to have a few drinks, were he alive.)

Back to digital audio: If you want to reproduce the Doppler effect accurately, GRM Tools Classic has one of the best Doppler plug-ins I know of, available for both Pro Tools (RTAS/TDM) and VST. See the detailed review from Electronic Musician of a few years ago. GRM Tools is a great collection of plug-ins, but if you’re on Windows you can also opt for the much-cheaper GBP 15 a la carte option, Spacestation (VST). (Thanks, Afro!)

Or just go have that Dopplertini. (Anyone got a good recipe? I think it involves throwing the drink at high velocity . . .)

I asked readers to brag about their work, and, wow, does Cynthia Bruyns have amazing things to brag about:

She’s a DJ — check out her mixes

She’s working part-time with Apple’s Interactive Media group

She’s involved with a really cool electronic record label

She’s been busy modeling instruments in 3D

The Vibration Lab is a sophisticated 3D modeling app for the Mac that accurately models percussive sounds. (Digitally-modeled cowbell? Not so far-fetched, after all!) See the project page for audio samples. She presented the work as part of a three-member team at SIGGRAPH and recently completed her Master’s thesis on new instruments. And yes, she’s looking at commercializing the technology.

Still more information:

Lab Notes: Modeling the Sound of Music [Research from Berkeley Engineering]

Vibration Lab Models Music [Daily Californian; though see her site for corrections]

Thanks, Cynthia. Now . . . uh . . . I’ll have whatever coffee you’re having.

Rope and Sound is an installation that uses rope tension to control sound. Pull on a cord, and the change in tension triggers electronic thuds and mellow chimes. The trick is conductive fibers braided into the rope; as the tension changes, the conduction of the rope changes, as well.

I got a chance to try out the installation at New York’s Cooper-Hewitt National Design Museum. The show is up through October 30 and well worth a visit if you’re passing through town. The installation is beautiful and the concept brilliant, but the sound aspect was somewhat disappointing. The sounds themselves were compelling, but the ropes act like simple buttons: sounds are triggered as you cross a set threshold. If the whole point is the ability to monitor stress, why doesn’t that translate into sound? A velocity-sensitive keyboard is more expressive. That said, I think the underlying concept is terrific, so expect to see more use of conductive fibers in new sound interfaces.

If you’re near Emoryville, California, you can meet up with the Squid Labs folks who built this and other projects. (via O’Reilly Radar) And you can even one-up them by showing your own project. If you go, let me know what goes down!

[UPDATE:] I went to the source and asked Ben Recht (MIT Media Lab) about why the strings weren’t sensitive. In fact, they were! The reason they modulated timbre and not velocity was that he felt velocity was too hard to calibrate for different visitors. (And, obviously calibration is an issue, since I didn’t notice the timbre modulation.) This certainly demonstrates the challenges in designing new interfaces. And it also suggests that even with new designs, you need musicians to become adept at using the interface expressively.