For the last few decades, generally speaking, we’ve had computers, and we’ve had physical, modular, analog gear. Computers are endlessly patchable, but not using physical cords. Modulars use physical cords, but they lack the flexibility (and affordability) of a computer.

Now, US$25 and an Arduino can change that.

rePatcher is a simple, tangible modular interface for computers. It could work with any software, but right out of the gate it already works with two popular (virtual) patching environments, Max/MSP and the free and open source Pure Data (Pd). You use physical patch cords to make connections, and those connections are reflected in the patch you see on the screen. The patch cords are coupled with requisite encoders for dialing in additional parameter changes. (Reason comes up as a possible candidate for additional compatibility, which would, of course, be really sweet.)

rePatcher is built as a shield for Arduino, so you’ll need one of those, but that still keeps the price low enough to say I absolutely have to have one of these right now.

It’s not the first attempt to do something like this, but it might be the most accessible and affordable – and interesting. And while those cute little patch cords are fun, there’s nothing stopping someone from building on this idea and going to bigger cords and something more extensive than this 6×6 matrix.

Best of all: the magic happens entirely over USB, so if you want to make this work with something else – say, your favorite VJ software – you can do so with anything that can communicate over serial.

More information:
http://www.openmusiclabs.com/projects/repatcher/

Continuing our insight into this view into electronic music performance and art through the lens of BodyControlled in Berlin, we’re joined by guest writer Kristin Trethewey. Kristin, a Canadian-born video artist and curator, takes another look at LEAP and BodyControlled, on the eve of its second installment. She gets straight at the question of what “BodyControlled” means, and what it can mean for sonic performance and creation. And I wanted to make sure to subtract myself from this write-up, seeing as I was playing – but see the excellent timelapse of the evening, above. -Ed.

LEAP is one of these spectacular Berlin venues you’ve been hearing so much about. It’s a huge, raw space with a view of Berlin’s landmark TV tower, hosting interesting art events with cheap drinks and the potential for a late-night party. But it’s unique, too, in its focus on electronic arts. And unlike other media arts centers, it’s not filled with computers and half-finished electronic projects. I’ve truly gotten lost trying to find this place (it’s tucked away in a mall), so I would recommend watching the timelapse video LEAP shot that guides you to the entrance before attempting to go there. Tonight is the second edition of BodyControlled, a new bimonthly performance series at the space. This installment, called “matter incompatible,” is held in conjunction with the Transmediale Festival under the satellite program, Vorspiel.

BodyControlled is a series focused on the intersection of performance and electronics. You can expect future programming to focus around ideas of “feedback” and “bio” related electronic performances. In its first installment back in November, a packed LEAP gallery witnessed performances by Robert Henke, Peter Kirn [editor of this site], Stephen Cornford, and Paul Whitty. The event was called “Other Spaces” and took the physical architecture of the gallery as a point of departure. Having the space filled with people made for a secondary concern of space: its use. In a series whose title mentions the body, I witnessed one performance engaging the bodies that were filling the space. Robert Henke’s twelve-hour set activated interactions between the audience, performer, and environment. He moved around, listened and mingled with the audience, even though he had this amazing, souped-up control station complete with ambient lighting.

Other artists put more emphasis on the manipulation and dislocation of space through the use and abuse of electronics. Kirn worked with a custom rig with tablet-controlled original software built in open-source software Pure Data (Pd), controlled by a tablet running Konkreet Performer. Excerpt:

Excerpt – LEAP Gallery Berlin, 26.11 by peterkirn

Whitty and Cornford actively deconstructed electronics in front of the audience:
it pays my way and it corrodes my soul (2011)

Stephen Cornford & Paul Whitty’s performance “it pays my way and it corrodes my soul” seeks out musical material by physically dismembering playback equipment. A reel-to-reel tape recorder is switched on and its mechanism amplified with a variety of microphones while it is taken to pieces. The sounds produced are then fed through an array of pedals: the machine’s belts, gears, switches and casing becoming an instrument subjected to a live audio autopsy

Excerpt:
Excerpt: Stephen Cornford & Paul Whitty, LEAP Berlin, 26 November by cdm

Cornford was also interviewed by LEAP for his installation work, featuring repurposed tape machines:

As João Pais, co-curator of the event with LEAP’s Daniel Franke, puts it:

“BodyControlled means the main direction of the series, to present performance and installation works that have a strong, corporal identity. This can be manifested in many ways, not only implying a “moving performer”. The purpose is to avoid the extreme of abstract performances made by a laptop-er, sitting down as if writing emails. In the first event, this idea was shown by interpreting/filling the space of LEAP through a sound-performance (Kirn, Henke), or an installation (Cornford, Mathy, Oliver).”

See also my write-up for ARTSCARDS from last month:
Other Spaces Generates New Spaces Through Sound at LEAP

The second event, “matter incompatible,” draws reference to the Transmediale theme: In/compatible, acknowledging the less clear, even dark forces at play in the artistic and political climate today. Matter Controlled questions the idea of the object or anti-object within sonification. See CDM’s write-up from yesterday:

Watch Artists Talk About Making Sound From Matter; Thursday Event and Stream in Transmediale Prelude

From the Transmediale podcast, some explanations of the theme of the larger festival:

Jacob Lillemose on the exhibition Dark Drives: Uneasy Energies in Technological Times by transmediale

Kristoffer Gansing elaborates on the festival theme in/compatible, as well as the in/compatible symposium: systems | publics | aesthetics.
Tatiana Bazzichelli is the curator for out new project reSource of transmedial culture and speaks about its concept.
Jacob Lillemose speaks about exhibition Dark Drives: Uneasy Energies in Technological Times which he is curating for transmediale 2012 in/compatible.
Sandra Naumann is the curator for this year’s performance programme The Ghosts in the Maschine, which she explains a bit more in detail.
And Marcel Schwierin tells us about his concept for the video programme he is curating for transmediale 2012 in/compatible.

Performances by Echo Ho, Mario De Vega, Alex Nowitz and Ignaz Schick will investigate this blurry region between the immaterial and material. I am curious to see what objects they will bring to play with. As they potentially seek liberation from the physical objects, by reimagining their sonification, I wonder how they are also reliant and maybe even drawn towards their objectification. Bringing these disparate emotions into play is at the heart of tonights investigation. In today’s climate fractures exist between so many aspects of our lives. These performances seek to bring some of them together, compatible or incompatible as we might discover.

You can watch the proceedings via live Internet stream, for the majority of you not in Berlin for the live show.

www.leapknecht.de

More Photos

About the Author

Kristin Trethewey is a Canadian video artist, cinema performer, and curator. She holds an MFA from Brooklyn College in Performance and Interactive Media. A multi-disciplinary curator and artist for the past ten years, she has recently completed a residency at the Node Center for Curatorial Arts, was co-Director/co-Curator of the INDEX Festival. She currently lives in Berlin.

Truly generative musical scores in games have been few and far between, and “music games” has traditionally meant arcade-style rhythm games in which you repeat phrases or whole songs as accurately as possible. Pugs Luv Beats breaks those molds. Part of a vanguard of new gaming creations that generate dynamic music on the fly, it marries grid-based sequencing and resource-gathering gaming, as music making and gameplay blur together. The interactively-produced music could itself become a new way of delivering a musical signature with sound packs.

And beneath it all lurks a free and open source library, libpd – the embeddable version of tried-and-true free graphical music environment Pure Data. (That library is now on GitHub, and vastly updated, by the way, and we’re expecting a book soon from the library’s principle author Peter Brinkmann.)

Oh, yeah, and don’t forget about some seriously addictive gameplay and adorable pugs. I’m suddenly not concerned about the 15 hours Europe-to-North-America travel I’m doing tomorrow.

Here’s what the gameplay looks like, since it’s much easier to see:

Pugs Luv Beats was just approved on the iTunes App Store for iPhone and iPad.

Co-creator Yann Seznec (The Amazing Rolo) is a terrific musician; I just caught up with him in Edinburgh and Berlin and watched him play a homebrewed pig gut instrument with Matthew Herbert for the performance piece “One Pig,” on tour at Berghain. Working with Pd allowed Yann to focus on those musical impulses and not just engineering, and to let him try things he otherwise would never have imagined on a mobile title. So I asked Yann to walk us through how the project was built. He responded with an exhaustively-detailed examination of the evolution of this title, right down to the Pd patches. (Click through for high-res versions.) If your New Year’s Resolution is doing something with patching, you might want to hang onto these answers. Here’s Yann:

The origins of Pugs Luv Beats date back about two years. After making [musical iPhone game] Mujik, Jon (Jonathan Brodsky, aka jonbro) and I were trying to think of other approaches to music mobile app design, and we started thinking more and more about games. Music games, as a whole, are an oddly passive and traditionalist experience – you play along with a premade track, and you are judged on your accuracy and flair (which is strangely reminiscent of music conservatory mindset…). Obviously there are exceptions (RjDj’s Dimensions, Elektroplankton, etc.), but there you go.

Particularly interesting to me was the idea that game mechanics are often very similar to compositional techniques. So for example, when Sonic runs at a normal speed he collects rings at one rate. However when he powers up and goes super fast, he collects rings at a much higher rate. This could be compared to introducing a melody and then speeding it up – and when there are two players, doing this with two melodies. Instant fugue!

We started looking at how we could make a music game where the music and the game elements were fully intertwined and augmented by each other. So Jon prototyped a space shooter drum machine. It was awesome.

To make a (very very very long and boring) story short, our idea and prototype landed us some funding from Channel 4 and Creative Scotland to work on games that focus on musical creativity and composition.

For various reasons, we decided to put aside the space shooter drum machine for a while, and start from scratch. After going through several full prototyping iterations we eventually settled on a core game mechanic that turned out to be in many ways similar to a Tenori-on [Yamaha grid instrument]/Boiingg-style [monome hardware patch] music generation system – in our final prototype, you controlled a series of little dots that moved around the screen, creating loops. This is super fun from a musical perspective because it’s easy and rewarding within a few seconds, and when you have several loops going it can gain some pretty serious rhythmic and melodic depth.

The key from there for us was turning this into a game. We had been using free Internet graphics packs up until then (we hadn’t hired our artist Sean yet) which featured a ladybug, so we had been referring to the main characters as ‘bugs’. During some discussion one of us accidentally said ‘pugs’, and the game idea was born. We constructed a story about pugs and their love for beets (like the vegetables) which create beats (ha!), and how their love turned into greed and got out of control, destroying their world. The game, therefore, is about helping the pugs rebuild their lost civilization by guiding them to create beats. You grow your galaxy by collecting beats, which you do most efficiently when you dress your pugs up in costumes. What’s not to like?

To get to the part that I imagine CDM readers are most interested in, the app development was done by Jon using openFrameworks, [lightweight language] Lua, our own game engine called Blud, and the audio is all done in Pure Data using libpd (through ofxPd). In hindsight we started using libpd really late in the game, just at the very end of the prototyping stage, which was rather silly. Our adoption of libpd basically made our dev cycle about a million times more efficient. My background is as a musician and sound designer, and I have very little coding knowledge. I do, however, have lots of knowledge of Max/MSP, so picking up Pure Data was pretty easy. This allowed Jon to completely pass off all the audio processing (not to mention aesthetic sound design choices) to me, saving him loads of time, giving me direct control over the sound, and letting me test and prototype different approaches to audio within an environment that I knew would be recreated in the game. Also, as Jon mentioned to me recently, by using PD we are able to take advantage of 20 years of audio DSP research and development. Pretty amazing.

How it all works:

The entire audio engine is contained within this patch. Pardon the messiness.

The simplest part of the patch is the “sounds” section, which is used to playback simple sound effects, for the most part linked with interface actions in the game. I did this by creating a very simple patch which plays a sound when it receives a bang. Which sound it plays is dictated by the argument (in this case, the sound of discovering a new capsule). The process for adding a new sound, then, is as simple as adding the sound file to the /assets/sounds/ folder, and making a new instance of “sounds.pd” and naming it the same as the new sound. Jon, in the project code, created a list called “sounds” which is sent into Pure Data. When that list contains “capsule”, a bang is sent into that subpatch, and the sound is played.

A more complex version of what could be done with this type of data is seen in the voice of Mr Puggles, who helps you learn how to play the game. Mr Puggles pops on and off the screen to guide you through the first few worlds, and when he does he send Pure Data a “puggleShow” and “puggleHide” signal. I wanted to give Puggles a funny synthesizer voice that was different every time – dead simple in PD. To do that, I take the puggleShow bang and use it to trigger five more bangs, spaced out over a second. Each of these bangs triggers a random number which is translated into a MIDI note. This note controls the pitch of two oscillators (a sine and a sawtooth), one of which is slightly modified to make them slightly different pitches. These are played through a short volume envelope and a filter which is also controlled by a random number generator. Result? Hilarious beeping boopy Mr Puggles voice, all coming from one bang.

Every time a player buys or selects a planet, a short list is sent to Pure Data comprised of the planet BPM and a random number seed. The BPM is used to calculate delay times and such, and the random number seed is used to create a sort of musical identity for the planet. This is done by choosing a “beat library” and a musical mode.

The mode is created by building a lookup table that chooses the notes from a chromatic scale that would be used in a particular mode. For example, a major scale (ionian mode) uses notes 1, 3, 5, 6, 8, 10, and 12. Each melodic sound library I used is comprised of a full chromatic octave, and the notes that are played on any given planet are controlled by this table. This ensures not only that all of the different sound libraries being played on a planet will be in the same key, but also that a planet will have a strong melodic identity.

The sound libraries in the game are all controlled by the pugs on the planets. As they run around, each time they land they will trigger a sound. The type of sound is dependent on what terrain they are on – thus, if they run through the snow they play a toy piano, if they run through lava a distorted guitar, etc. There are two states of playing the sound, one if the player deliberately tells the pug to go to that tile, and the second if the pug is traveling over that tile to get somewhere else. It’s super easy to do that kind of thing in Pd; just set up two different ‘play sound’ envelopes, maybe a little extra delay or reverb, and you’re done!

The final piece of the puzzle for making the pugs running around into music is to make each tile be a different note. The terrain of each planet is created by making a sort of height map, where different heights correspond with different terrain types (grass, water, snow, etc). This also means that each tile has a unique number between 0 and 1. When the player buys or selects a planet, a giant random number table is generated in Pure Data which creates a number between 1 and 13 for each possible value between 0 and 1. That value is what is used to pick the note of the mode. This somewhat convoluted approach again lets us make sure that each planet will have a unique, but fully reproducible, musical character.

The actual playing of the sounds is probably the messiest part of the patch structure. Purists look away now.

I wanted to make sure this part of the patch was as flexible as possible, so I ended up using the soundfiler and tabread~ objects, rather than tabplay~, which is great in practice though does look rather uncouth. Additionally, I had some limitations imposed upon the structure of the patch – namely, I had to keep the number of tables down as much as possible, to save on memory. So each sound bank has two voice polyphony – there are many sound banks, and the beats and sound effects aren’t counted in this, so that limitation is not really heard in the final product at all. It did mean I had to work out a decent voice allocation system though!

I think my memory issues were probably my only problem with using PD in this project – though only indirectly. As I mentioned, they were hardly a problem artistically, however it took me a while to get used to the idea that not everything I patched on a computer would work on an iPhone. Similarly, I had to be very careful about things like relative volumes. In a generative music game like Pugs Luv Beats, the player could quite easily send 15 pugs running around making sound, which mounts up pretty quickly. It means that all of the patches and sound need to be designed to withstand lots of triggering without distorting. None of these things are problems, really, all they require is regular testing on devices and simulators – something that every mobile developer is already used to.

That’s the Pure Data audio engine in a nutshell. The end result is a flexible and powerful audio engine that sounds really great and is fully integrated into Pugs Luv Beats. The game is a great combination of music, silliness, and strategy – there’s a bit of something in there for everyone. You can definitely just play with the game to make beats, or you can try and collect all of the costumes, or you can try and make the most efficient planet ever. You can also explore the galaxies being made by your Game Center friends, to hear what they’re up to.

The background story:

And, just for fun, a silly promo featuring real pugs. Anyone traumatized by the sight of Pd patches, these should relax you.

More information at the developer site:
http://luckyframe.co.uk/pugsluvbeats/game.html

Graphics are good. Graphics are shiny. But when it comes to reality-bending, emotionally-immersive, perception-shifting power, look to sound and music.

At least that’s the feeling you could get after playing Dimensions. Following their reactive music tools and Inception dream states for iOS, RjDj have turned their mind-altering sonics to gameplay. As with previous releases, these tools are powered by the open source visual development environment Pure Data. Pd engineering wizardry here meetings the compositional and sound design prowess of Hans Zimmer.

You can see a bit of how the musical world works in the teaser video above, and the music sound design video below.

But we wanted quite a lot more information. So, CDM got RjDJ’s Rob, Joe, and Martin to share some detailed thoughts on how the game experience is put together and how it works.

The App

RjDj Team: Most games require your full attention when you play them. You either live your life or play the game. Dimensions is different. It’s designed to be played in parallel with your normal life.

Gameplay is intertwined deeply into your daily life. Some dimensions unlock if you are physically active and others unlock if you are quiet. The app automatically detects what you are doing and syncs the game to it making use of every possible sensor on the iPhone.

You stay immersed in the game by listening to augmented sound and the voice of Emily from Mission Control. She guides you through many exciting challenges like collecting Artifacts and avoiding the dreaded Nephilim.

With Dimensions we are very interested in creating a gameplay experience which is between the device based focus of a casual game and the passive use of listening to music. Its a game which you play by listening – a game that place in parallel to your everyday life.

The Tech: Reading Files

We built our own version of readsf, rj_readsf, in order to be able to read compressed audio and make the samples available for processing in Pd. One advantage of readsf is that possibly lengthy audio assets do not need to be loaded into memory. If memory is limited, especially when Pd may be running in the background, limiting exposure to system memory warnings helps keep the app running and the music playing. Given that compressed audio is roughly ten times smaller in size than uncompressed audio, and that audio assets make up the majority of the size of the entire app, it is a huge benefit to be able to deliver and read compressed audio assets directly, without the need to decompress in memory or onto disk. Dimensions requires that several dozen such players be open and viable at any time, and special consideration was given to concurrent behaviour. rj_readsf can loop a file when it gets to the end, and it indicates with a bang when a file has been loaded (an asynchronous operation) or the end as been reached (in the non-looping case). rj_readsf is built on iOS standard APIs and can read any file format that iOS can.

Ed.: I’m waiting to hear if rj_readsf will be open-sourced. The issue of reading files is one we’ve had around libpd recently. While their rj_readsf sounds great, my sense is the best long-term solution will be a similar object that is independent of the APIs of any one OS, so this same set of problems may need a different solution for the open source community more generally. (Building such a tool is absolutely possible, though it might require more effort.)

The Music, and How the Music Plays with You

The music of Dimensions uses various different techniques from straight sample playback to audio analysis and synthesis:

Realtime manipulation of audio input from the mic:

This is perhaps the most recognisable technique we use. We process audio from the iPhone microphone live in many different ways. It’s kinda like a feeling of being inside the music.

The key thing we do with effects is attempting to analyse the environment of the player / listener and then making appropriate things happen within the effect. For instance, the Flux Dimension features a filterbank on the mic input. We analyse the incoming audio from the players environment and make the filter frequencies change as events occur ( either due to pitch changes or onsets ) this gives the impression that objects and activity around the player is somehow “playing” the music.

In the Ghost Dimension there is an effect which records audio whenever it detects an event, then scrubs repeatedly forwards and backwards through the sample using granular techniques stretching it out in time. This manipulation accentuates the textural and pitch based qualities of the sample as it repeats and works well with the atmospheric music Hans Zimmer composed.

Dynamically-controlled stems:

All the Dimensions use stems and hits from a conventional sequencer in some way, re-arranged live on the device relative to how the player is interacting. These stems were mainly composed in Cubase and Logic.

For example, in the Kinetic Dimension we feed accelerometer data from the device into Pd and drive the music from that. The player hears more energetic beats when they go for a run, but if they stop at the lights to cross the road, the drums immediately drop away. This was achieved with a large number of hits with all the rhythmic sequencing happening in a hybrid reactive / generative way live on the device.

In the Tranquil Dimension, the music introduces more stems the longer the player is quiet. If they make too much noise the music “shrinks away” from them and becomes quieter. If they stay in a Zen like peaceful state, the music grows into a kind of crescendo of serenity.

Reactive synthesis:

We often control parts of the music by doing a frequency analysis of incoming microphone audio from the device and then using those frequencies to determine the notes synths will play within the music. The Travelling Dream in Inception the App uses this extensively. Tranquil Dimension in Dimensions also uses onset and frequency changes to trigger synth melodies in the music.

The synths we use range in complexity from very simple additive synthesis to some great synth patches from the rjlib by Frank Barknecht and Andy Farnell.

Generative approaches:

There are some sections within Dimensions which are generative. These play back prepared samples as well as triggering onboard synthesis. They also feed the results of this through various live sampling and glitching patches. They are governed by various sets of rules which have various long term parameters, like adjusting to the intensity of the audio environment of the listener, or how dense areas of music have been around the present time.

Sample triggering:

Ghost Dimension uses a simple but effective technique of triggering samples from the music on onsets in the environment. This can cause some real jump out of your skin moments. We combined this section with a randomised very short delay on the mic which acts almost like a resonator, turning the mic sounds into creepy atonal pitched noises.

Sound Design

The main hub section in Dimensions, called the Launch screen, acts as a entry point to your augmented adventures. It also displays all available Dimensions via the floating tile icons.

Visually, these represent a snapshot of your previous experience using your location at that time. Sonically we wanted them to have an aura or energy from the Dimensions themselves.

SoundCloud examples:
Dimensions Sound Design Example by rjdjme

Example of using mixture of synthesis and samples to create user feedback when interacting with Dimension icons in the game.

Map Tile Down: several recordings of a synth in Pure Data that is played when the tiles are touched. Each one is slightly different due using two detuned oscillators.

Map Tile Open Only: a sample from Logic Pro for the woosh sound when showing the information view.

Map Tile Click: a sample from Logic Pro for touch events.

Map Tile Open: recording of how it sounds when put together.

Sound is a mixture of samples and real-time synthesis. The energy sound is made using two oscillators (one detuned) to create some modulation for a glowing effect. Added to some harmonics to make it more of a beam sound and some chorus and reverb. The open tile is made in logic, when closed it’s the same sound but reversed and pitched down in Pd.

We wanted the tiles you tap on to feel like each Dimension has some sort of energy radiating out.

Here’s a sense of how the sound design works in the game:

It’s an ambitious app, and the whole cost is US$2.99. I guarantee it’ll change your world more than a latte. (Well … unless we’re talking a really crazy latte. And that might not be legal.) As sometimes-CDM contributor Jaymis Loveday notes, there are terrific choices in coloring Google Maps, and how modes change based on ambient sound and motion.

Requires an iPhone 3GS or better, or third-generation iPod Touch or better, or an iPad.

Dimensions @ iTunes Store

More reading:
Dimensions Augments Reality Purely Through Sound [Leigh Alexander, one of my favorite game writers, for Gamasutra
The Roundabout Tapes – RjDj now plans to game reality with sound [TCTV] [Techcrunch EU]

When we last saw Onyx Ashanti, he was speaking of a grand vision to remake himself into a music-performing Tron. Now, the elements of that vision are coming together, with a crowd-sourced funding campaign that ends today, Friday. Update: Apparently after seeing this story, IndieGogo extended the funding deadline for five days, with the new deadline Thursday, December 1.

I knew Onyx back when he was playing more conventional wind controllers. Now, that fingering arrangement is freed from the virtual wind instrument, handheld and movable through space. Because of the plans to open source everything he’s making, you might yourself pick up that hand controller – or, if you’re like Onyx, go full-tilt with physical training to make your body do new things and a carbon fire, full-body prosthetic transformation.

Onyx has been at auditions for the main TED (the big one, not TEDx), experimenting with a beatbox configuration, and honing alien-like futuristic human reinvention with the help of artist Christopher Logan, aka Loganic. Loganic makes the art, then prosthetic engineer Uli Maier – with doses of carbon fiber – translates those notions into physical form. And the whole thing is mobile; Onyx draws on his busking background to take this thing wherever he goes.

Initially built as an open/proprietary hybrid, the new system is increasingly open source from the ground up, from customized Linux-based software to Pure Data (Pd) patches to open source designs for the molds. The wearable system can be 3D printed. Plans for the system also were featured in Make Magazine.

It’s actually quite a lot to digest, but Onyx has been posting videos, the most recent and illustrative of which I’ve included here. And because there’s a lot to do physically, from personal training to buying clay to engineering the prosthetics, Onyx is relying on crowd-sourced funding. In place of Kickstarter, which has specific requirements for minimum funding and other restrictions and requires US-based banking, he’s opted for IndieGogo.

If you invest just a few dollars, you at least get music; with successively larger donations, Onyx throws in his software, custom artwork and posters, t-shirts, or starting at US$500, the custom hardware itself for your use.

The IndieGogo campaign ends Thursday, December 1:
IndieGogo: Beatjazz System

– but we’ll be in touch with Onyx on an ongoing basis, so let me know if you have questions for him or want to watch this continue to evolve.

Videos showing the making of the elements of the system:

Above: New visualizations in 3D have vastly expanded the now-Pure-Data-based audio system with heads-up displays worthy of the spacesuit. Below: Some of the beautiful concept artwork produced for the project.

IndieGogo Campaign

Previously: Onyx Wants to Make Himself Into Helmeted, Wearable-Music-Tech Tron, With Your Help

NodeBeat is the kind of experimental music application that’s thriving in the age of the multi-touch tablet. Its dynamic interface and sound are built on the foundation of free and open source software tools regularly covered here on CDMusic and Motion. OpenFrameworks, the Processing-like C++ library, handles the UI, as libpd, the embeddable version of graphical media environment Pure Data, manages the sound.

What you get is an open-ended plane on which you can graphically array sequences, far away from the standard grid, for generative and sequenced music. It’s good fun, which made it a hit on iOS. Developer Seth Sandler, working with Justin Windle, did a brilliant job. Then, earlier this month, NodeBeat made the jump to Android, with additional porting work by Laurence Muller. Android has been getting tablets that can hold their own — I’ve enjoyed my Samsung Galaxy Tab 10.1, for instance. But the platform has remained severely starved of applications in contrast to iOS, but at least in place of quantity, there’s some quality: this application being one, tools like Mikrosonic’s RD3 or Reactable orControl or Nanoloop qualifying, too. (I’m not delusional; this does not make it at this point any serious competition for iOS, but it does demonstrate potential for developers. And I’ve already had the chance to use Reactable and Control in live performance, personally.)

That is, NodeBeat was temporarily available on Google’s Android Market. Then, without warning, Google suspended developer Seth Sandler’s seller account. This led to an extended discussion with Seth, other developers, and myself as we watched events unfold, ironically on Google’s own Google+. (Yes, that Google product works, despite what you’ve heard.)

It’s back now, so please, go buy and review it if you get the chance. If you’ve got a compatible Android, you’ve got truly no excuse as it’s a delightful app, and it holds up even in the crowded iOS platform:
NodeBeat @ Android Market
http://nodebeat.com/ (iOS and all versions; there’s even a free, desktop version with source code!)

Okay? Bought it? Good. Now it’s time to talk about how bad this is for a developer.

The account suspension on the Market represents a series of obvious flaws. First, of course, it shouldn’t have happened in the first place – Google support eventually acknowledged the suspension was entirely random, “incorrectly suspended” in the words of support, with no other explanation.

Second, support was largely nonexistent. Days passed during which Seth was left without any information. (Amidst discussions of how “evil” or “open” Google is, I’d sometimes be happy just to see them seem something other than desperately rushed. And that seems to be the primary “Apple-fication” of the market – the company’s rivals now are so rushed to try to compete that they screw things up constantly. “Don’t be crappy.”)

Third, and most bizarre, the application stayed available but payment was impossible, leaving customers confused and unable to buy the app.

Now, horror stories like this weren’t unheard of in the early days of the Apple App Store, and I still hear – with, happily, much less frequency – complaints from developers about Apple’s store and approval process. Apple deserves credit for ironing out those flaws, but from the skeptical perspective of a developer, It’s hard not to draw the conclusion that you may want to consider distributing your software via more than one means. Even as Apple fails to allow that on their mobile devices, that means considering going cross-platform. That’s not a philosophical claim; from the perspective of a developer, you don’t want to be dependent on only one company. Feel free to disagree, but my experience has shown otherwise as I’ve watched developers get burned. (And it’s worth noting that while Google couldn’t sell Seth’s app, Apple could.) Technically, via Android, developers are free on the vast majority of devices to sell direct or sell via alternative stores; unsurprisingly, Seth submitted his app to the competing Amazon App Store and is awaiting approval there.

None of this, of course, excuses Google from a big customer failure on Android Market. And whereas Apple’s earlier hiccups occurred as it was the only game in town, Google is making an uphill battle even worse. With Amazon’s Fire on the horizon, there are two questions to watch: one, can Amazon deliver enough tablets to create the tablet market Android has thus far lacked, and two, will their store deliver a better experience? Meanwhile, Google continues to promise a better Market; it’s all I hear about at developer events, largely because it’s the primary complaint from developers. As tech pundits make largely-unsupported claims like “Android users don’t like to buy software,” as if they’re a bunch of degenerate freeloaders, I’d point to the often-inferior Market and frustrating hardware experiences.

But, let’s put it this way: in addition to the obvious range of iOS choice, yes, there are superb applications beginning to appear on Android. For that, I credit developers like Seth and his collaborators. Even as we push for better audio performance, some of those applications are already running exceptionally well on new tablets and higher-end phones. If you have one of these devices, you can fire these up and enjoy making some sounds. And because you can’t always rely on another vendor to get things right, having cross-platform, free and open source tools behind these applications means developers have the flexibility to adapt to a changing market, and to focus on creative design and not constantly reinventing the wheel.

Here are some notes on NodeBeat’s creation on our forums.

And let us know what you think of NodeBeat, or if you do have an Android device you’re using for music (or a Fire on pre-order, for that matter).

Sonaur is a US$1.99 ambient toy for Android mobile devices, with on-screen creatures you can manipulate to generate sound. It’s notable not only for being a fun toy – and on a platform that hasn’t had as many fun toys – but because the tools used to create it are also highly accessible and free.

I’ve taught Processing, a code environment popular among artists and designers to people who never before imagined they could be coders. Pd (Pure Data), here in the form of libpd, is a free graphical patching cousin of Max/MSP. You can check out libpd, which allows Pd to run on Android, at our Pd Everywhere group.

Developer Miles describes the app thusly:

I wanted to create an app that lay somewhere between an ecosystem and a musical instrument. The hope is that sonaur requires less attention both, and still provides a reasonable amount of intrigue.

Sonaur contains three distinct lifeforms. You can interact with them individually, or together; creating new sounds and visual patterns for your enjoyment.

I was also curious if he had advice for people exploring this area.

Miles tells us that he found making both the art and sound generative – rather than pre-drawn and pre-recorded – made a big difference. He also suggests reading Andy Farnell’s book Designing Sound (now on MIT Press) as a way of learning both Pd and sound design, saying it “helped me a lot to create the sound of the flying insects.” Another tip: using vectors and not hard-coded pixel values makes your work adaptable to different devices. And, “Matt Pearson’s book Generative Art talks a lot about this but I’ve found too that randomness is great in controlled amounts.” I couldn’t agree more.

It’s really great work, Miles. And by the way, readers should never be ashamed of plugging their work, individual or group, free or for-sale. We love hearing about it, even if we can’t cover it all.

Find this at:
http://app.net/sonaur

Via discussion on Noisepages.

Also on Creative Applications Network, run by our friend Filip, which covers all sorts of these kinds of creations.

Imagine Pd everywhere. Pure Data, a free tool for constructing music and media by creating graphical code, is spotted this week hacked to run on a lowly Nook tablet and interfacing with the powerful Kinect camera system. A community in Los Angeles and Southern California is growing around the idea of the “patching circle,” in which users of various tools (Processing, Max for Live welcome, too) gather to share the process of making, like knitting circles of yore. (Yeah, okay, I made up the term, so you can take it up with me if you don’t like it.)

LA is launching a whole effort to build this community on the West Coast. If you’re in the neighborhood, you’ll want to clear your schedule; if not, this could inspire similar events in your neck of the woods. Los Angeles joins a larger worldwide movement around this tool as a kind of lingua franca for DIY software. (Pd everywhere is therefore the moniker I slapped on our Noisepages group for embeddable libpd; hope you’ll join us.)

Pd this week in LA is in the hands of advanced users — Pd and Max/MSP creator Miller Puckette is on-hand — and non-programmer, first-timer, curious musicians, too. You can learn beginning or advanced skills and meet other folks interested in exploring.

The shindig has already met up at University of California San Diego and Long Beach’s Boys and Girls Club. Now, it procedes to Culver City’s CRASHspace hackerspace.

Tonight, 7:30-10:30 PM, Hans-Christoph Steiner offers up a master class with patching, which I believe will either cover audiovisual work or extracting data from audio signals for triggering.

Friday, Chris McCormick offers a more advanced look at making Pd an embeddable audio engine with libpd – something that could empower everything from interactive music for games to new mobile tools for Android and iOS.

Saturday, the pd-la Patching Circle has its first meeting and the party gets started. Patch noon-2p, take an intro Pd workshop at 2p, and then spend Saturday night with discussions, demos, performances, and a patching party.

Sunday, Pd/Max creator Miller and Natacha Diehls will be performing at The Wulf downtown.

I raise all of this in the hopes that some intrepid CDM reader will go and be a great investigative reporter, talk to people there and find out what they’re doing, and share some info with the rest of us. (I’ll be here in NYC.)

More info:
http://pd-la.info/
http://pd-la.info/pd-launch-schedule/

From an eBay-purchased Atari ST to your phone, you really can make electronic music however you like, wherever you like. Generally, I’ve therefore been skeptical of gimmicks like all-iPad albums, particularly as it seems fairly obvious that such things should be possible. On the other hand, albums produced entirely with less-obvious, less-popular options may lead to more unexpected solutions. And they can both prove my ultimate thesis: you should use whatever makes you happy. If a few extra tools help with that, superb.

Plus, who am I to walk away from potential flame bait?

In this case, an all-Android album from Philadelphia DJ/MC COOLOUT aka Christopher Davis carries another surprise: it’s a damn solid hip-hop album. Some quirky flare from COOLOUT is amplified by the lo-fi aesthetic of the recording technique, making use of the internal mic on an Android phone. With creative sound design, it’s firmly rooted in hip hop, but takes a nicely experimental direction.

I find that it’s fun listening, and whether it’s your musical taste or not, the listof apps the artist has compiled will be a godsend to anyone who’s got an Android phone and is looking for ways to make it more musical.

The album is free, and a no-brainer download – it’s some really good stuff. (See also a non-Android remix of music from the excellent label Stones Throw.

There’s some musical thinking behind these choices here – Android becomes a return to what the artist loved about simple digital samplers of yore. COOLOUT tells CDM:

I used a couple of different workflows. The cool thing about Android is that most of the audio apps aren’t as feature-heavy as iOS. Coming from the days of using mono 12-bit samplers with no effects, it was easy to use all the techniques of layering and chopping I’ve known for years. Most times, the instrumental track was completed fully on the phone and I then tracked the vocals in a standard DAW later using the Android device as a microphone. There were no outside instruments used and I tried to stay away from standard plug-ins. It was hard resisting the temptation, but I wanted to represent the sound of Android as much as possible. I only used outside compression on the vocals, all the other effects like delay and filters were from Android apps. If Froyo didn’t have such huge audio latency I probably could have tracked the vocals all on the device.

Another great thing about recording using an Android device is that I was able to write all my lyrics in Google Docs (shout out to Count Bass D for putting me up on that) and have them directly in front of me while recording vocals.

Technical note – it’s not so much Froyo (the Android OS release) that adds latency as a lack of low-latency performance from handsets. The API also lacks the structure you might like for low-latency applications, though if you’re a developer, check out the AndroidWrapper class Peter Brinkmann wrote for libpd for Android, which presents a useful workaround for any audio app.

COOLOUT music is good stuff; see the full site (including the Android album, via Bandcamp):
http://cooloutmusic.com/

The apps (with Android Market links, though there are other ways of getting to them, too):

Virtual Amp
MusicGrid
Electrum Drum Machine
Jasuto Modular
Ethereal Dialpad [see CDM coverage]
MicDroid
PureData/RjDj
Guitar: Solo Lite
Chordbot
VirtualSynthesizer
Brainwave Tuner
Musical Bubbles
Silicon Oxide [retro virtual analog drum machine]
Buddhist Instruments, Tone Dialer (I think that’s this one)
PP-Electone

A look at some of those apps…

Brainwave Tuner:

Electrum Drum Machine:

Chordbot:

Silicon Drum Machine:

Our previous round-up of Android apps – well worth doing, I thought, because these apps have been harder to track down than those for iOS:
Useful Music Tools for Your Android Phone, and a New Sketchpad Joins Groovebox

…and earlier this month, a Game Boy (and iOS) favorite making its way to an all-Android release:
Nanoloop Comes to Android, with its Lovely, Minimal Music Idea-Making Interface

And, of course, if it is iOS you’re interested in (or you swing both ways), you can find all our coverage:
http://createdigitalmusic.com/tag/ios/

Or for all things music mobile – regardless of platform, don’t miss the exceptional, 24/7 online news channel for mobile music apps, the fire hose of news for this growing genre:
http://the-palm-sound.blogspot.com/

Tired of top 40 hits? Pooped on podcasts? Sapped on streams?

What if your radio could generative music that was never-before — and never-again — heard, all from dynamic, algorithmic software?

PatchWork Radio does that with Pd patches. It’s not a new idea, but the radio station here, at least, is modular – not just one patch but any number of patches can be transformed into radio, thanks to some Python scripting. Creator David Guy John notes:

I’ve recently just started up an internet radio station using PureData to stream generative music. The system will load and unload randomly chosen PD patches, synthesize all the audio in real time and then stream the results out.

You can listen to the stream at http://radio.rumblesan.com and more info is available at http://www.rumblesan.com/?p=265

I’m hoping to try and recruit some help to build patches for it as it’s a bit of a daunting task to do just on my own so if you could let people know about it I’d be really grateful.

So, who’s in – does this generate (ahem) some interest or ideas, and might you want to contribute?

It seems fitting that the kind of musical worlds imagined by artists like Brian Eno now can be deployed anywhere in the world, not just generated in one iteration, but in endlessly-transformable versions.

(But can you dance to it?)