Here’s someone who really, really loves Native Instruments’ B4 (II) software rendition of the Hammond B3 organ. The work of Markus Berger, this dead-ringer for a real B3 is actually a carefully crafted replica with elaborate MIDI control inside. The body is built by hand from cherry wood. Electronics were prototyped with the open source Arduino platform and implemented with electronics from Doepfer, then finished with manuals (that’s “keys” for you non-organists) from Fatar (as seen in Nord’s organs). Authentic-style drawbars finish the project. Correction: I got my wires crossed and originally claimed this had Fatar drawbars, but it’s Fatar manuals. Thanks to comments for spotting that.

The integration of the hardware design with the B4 is extraordinary: the creator notes that every single function is perfectly replicated, so you never have to touch a mouse or look at a screen. Of course, you can then make meticulous models tweaked on the B4 software that wouldn’t have been possible on the original hardware – and this hardware, while substantial, should be dramatically lighter.

More on those custom electronics:

The main controller electronics were actually custom developed and prototyped with Arduino. They were complemented by electronics from Doepfer for the two manuals.

Most of the electronics had to be custom developed as there was and still is nothing available to cover all the functionality of a classic Hammond B3 with the full drawbars set, preset keys and all the switches.

And yes, the bottom line is that this puts every controller for everything I’ve ever seen to shame. Thanks to Germany-based Twitter reader tillephone for sending this my way.

B4 Controller Project Page

I hesitate to even suggest this, but – is a Leslie cabinet next?

More photos after the jump:

For everyone who thought Twitter was just about “i m eating a ham sandwich lolz,” the desire to use connectivity to actually be connected continues to win out in unexpected ways. So far this month, we already saw the use of Max/MSP. Now, Twitter is showing up in the geeky, open source sound tool SuperCollider and in DJ sets in Traktor by Richie Hawtin.

Tweet a Sound, to the Max

First, some updates on Tweet a Sound, the sound design tool in Max that lets you share synth presets.

Creator Andrew Spitz has an updated story on adding a cleaned-up subpatch to Max/MSP. It uses the Ruby programming language to access the Twitter API. (You should be able to port to Pd, too – I have to look closer at this.) Correction: Ruby is implemented as JRuby, so it runs on the Java virtual machine – and there is a Java implementation for both Max (mxj) and Pd (pdj)

This means, if you’ve got a Mac or Windows copy of Max/MSP, you can now send Tweets from your patches. And that should open up still more possibilities when Max for Live becomes available, for Ableton fans.

How To Send A Tweet From Max/MSP { sound + tutorial }

Even if you’re skeptical about Twitter per se, if you’re interested in using Ruby and Max, this should be a good starting place for other APIs, too.

Friends of mine like Francis Preve have gone utterly nuts for this.

SuperCollider

SuperCollider is an elegant, free, cross-platform synthesis language that expresses sound and sequencers as code. Since, unlike Max, its language is text, no conversion is necessary: savvy SuperCollider sonic programmers are simply copying and pasting code directly into Twitter.

You can get a feel for something of what’s happening here:

http://search.twitter.com/search?q=%23supercollider

It’s an interesting exercise. As people have done with Processing for Twitter-coded graphics, the tiny 140-character limit means the challenge of trying to do more with less.

Unsatisfied with picking these up manually, SuperCollider Charles Céleste Hutchins has built his own bash script, connected to Yahoo Pipes, for fetching the resulting SC sound creations:

Twitter Supercollider App [les said, the better]

You’ll also see in the search, in addition to code there are lots of casual exchanges of tips and advice.

I’m not sure anything can cure me of my own sprawling code, but there’s something soothing about everyone else’s little code snippets appear.

Richie Hawtin + Traktor

Here’s the biggest twist yet: Native Instruments’ Traktor Pro is now Twitter-enabled. Richie Hawtin’s label Minus has developed a custom Twitter application that uploads song metadata, using the Internet broadcasting functions built into Traktor Pro. (I’d love to see this using OpenSoundControl, though I think in this case it doesn’t.)

What this doesn’t mean: no, Richie Hawtin is not tapping away on a cell phone while he plays, and if we see any of you Twittering onstage, we will call in the Dead Acts police.

What it does mean: you can keep track of track listings by tuning in on Richie’s Twitter feed. Updates happen every 30 seconds.

http://twitter.com/rhawtin

Now, generally, the mention of the words “Richie” and “Hawtin” seem to trigger some sort of irrational torrent of Internet hate in comments, so I’m hoping that doesn’t happen here. Personally, I think there’s some interesting potential to all of this – imagine if people who heard your live set could then go check out album versions of your songs the next day, and discover that some of you really are doing live PA stuff and not just straight DJing, too.

Also, Minus promises they’ll release the software to other Traktor users in the near future.

It’s something of a contrast with the Max users who may actually broadcast the patches and presets they’re using while playing, but that’s what makes all of this so intriguing.

Updated:

Via Twitter, Giles notes that Beatportal responds to the announcement:

How Twitter tracklist app will change everything [Beatportal]

I agree with many of the points here on some level, but author Christen Reutens at Beatportal seems to be getting a little carried away. Online radio playlists were also supposed to change “everything” – and then didn’t. For one thing, the ability to purchase played tracks, while something that still has potential, hasn’t yet taken off in a big way. For another, legal questions have come into play. In the case of radio stations, publishing playlists in the US can make a radio station into a “jukebox” and become subject to greater licensing fees. I’m not sure what licensing considerations the DJ playlist could prompt – in the best case scenario, it could mean payments for artists; in the worst case, it might turn venues off from allowing DJs to publish playlists.

Also, as far as mystique, this is an entirely opt-in service. And many of the changes Christen describes have already happened because of digital files and Internet communication – with or without Twitter playlists.

Of course, feel free to disagree.

I have a simpler view, I guess. Publishing playlists is a cool idea for those who want to do it. It’s likely to be used primarily by really big fans of certain DJs. The problem with Twitter is, that information could get stuck on Twitter. Smart DJs will use RSS to pull the information into their blog and give some of that context back. And as for DJs who have hidden behind producers’ tracks while creating a false sense of mystique – well, uh, some of us who are greater fans of live PA won’t be shedding any tears. Those who are intelligently warping tracks so they’re barely recognizable, requiring a Twitter feed to follow what’s going on, we salute you.

I’m not sure I’d want to be glued to a Twitter feed while in a club, with all the other Tweets happening, but it’s interesting. Perhaps more interesting than the features for fans is that Hawtin and company propose to get producers paid some royalties when their tracks get played, by using this feature for more accurate tracking – see James Holden on comments here.

And there’s nothing stopping the smart-a** music enthusiasts from going to sets without this feature, tapping away on their cell phone to prove they actually know what they’re hearing. We might even follow you.

But is There Another Way?

This is all very interesting, but I have to wonder if we should all take the next step and start thinking about open ways of connecting software. Of course, it makes sense to use Twitter for quick snippets and Twitter-style communication, because people are there. (Not to mention, I like the idea of freaking out your Twitter followers with unreadable code gibberish.) Likewise, it makes sense for software makers to do some of their own online integration, as Ableton has done with Share – a feature we’ll be examining in more depth.

But Twitter itself, while an interesting novelty, is not ideal, because of its data limits and the proprietary, crash-prone system behind it. Here are a couple of alternatives. XMPP is a standards-based protocol, built on XML, for bi-directional communication. For chat-style, real-time communication, XMPP – the basis of Jabber and Google Talk – makes much more sense. And there are existing, open source libraries out there with XMPP support, meaning it’s not tough to build upon. It’d be great to use XMPP to allow artists to communicate about what they’re doing in real-time.

For collaborating on shared projects, version control is a great way to go. Previously the domain of programmers, version control is catching on with all sorts of people, because it makes collaboration easier by tracking changes. Subversion remains the most popular way of doing this, even as Git gains some traction. And Sourceforge has beefed up its own functionality lately, while Sun’s Project Kenai is developing nicely, too.

See, previously:

Version Control and Sharing for Patching: Keep Those Max, Pd Patches in Order with Git

In other words, I hope this is all the tip of the iceberg. Ideas?

As an addendum to the last story, Ivica Ico Bukvic sends along an example of the [myu] Max/MSP + Unity game engine combination in action. Here’s the surprise: Unity isn’t generating visuals. Instead, Unity simulates ripples created by movement in the space, and builds physical models that are sonified and spatialized by Max/MSP.

Speaking of work involving art museums and the combination of Max and Unity, VJ Anomolee notes in comments his own work with the pairing. Lightbent Synth is an in-progress piece with alternative controllers and sensors that produces sound with a novel visual representation (sound’s very quiet in this preview — more hopefully once it progresses):

Lightbent Synth from VJ Anomolee on Vimeo.

Ivica explains the top work:

This past fall [myu] had seen its first real-world implementation in an exhibit that was a part of the grand opening of the Taubman Museum of Art in Roanoke, VA (http://www.taubmanmuseum.org/). The exhibit utilized [myu] as part of an interactive aural installation titled "elemental." An online tech
demo video of the installation, including written synopsis is available also via Youtube at http://www.youtube.com/watch?v=PA-9BOgc1gk. Below is a brief synopsis of the installation:

"elemental" interactive communal soundscape premiered in November 2008 as part of the Revo:oveR collection commissioned for the grand opening of the Taubman Museum of Art in Roanoke, VA. The Youtube video focuses primarily on the technical aspects of the installation. Using Max/MSP/Jitter, a homebrew IR webcam with fish eye lens and a LED-based IR spotlights, entire 24×36-foot exhibit space is converted into an aural sandbox giving visitors an opportunity to generate and shape the
ensuing soundscape. Positional data of up to 20 visitors is forwarded to Unity3d using [myu] Max-Unity interoperability toolkit developed at DISIS (http://disis.music.vt.edu). Unity is used for physical simulation of ensuing ripples and the resulting data is sent back to Max for spatialization across a 12-channel (4×3) ceiling-mounted speaker array. Driven by communal interaction, virtual ripples refract from each other spawning an algorithmically generated aural fireworks. The exhibit ran non-stop for approximately 5 months until March 2009.

Bonus video below: an early prototype that did include visuals. After days of looking at emulated knobs and faders, it certainly does speak to some of the possibilities for musical interface and expression.

Take a powerful game engine (for animation, 2D and 3D graphics, physics, and on-screen interaction). Add the flexibility of a visual development environment for programming with virtual patch cords, for rich sonic and musical capabilities plus easy interaction with data and input. That’s the idea of combining something like Unity 3D with Max/MSP. In the example from earlier today, the solution simply routed basic data from a Unity-based game to a responsive music engine in Max.

In the case of [myu] – the Max Unity Interoperability Toolkit – that integration goes further still. Developed at the DISIS (Digital Interactive Sound & Intermedia Studio) at Virginia Tech, [myu] allows bi-directional integration of the Unity engine with Max or Pd. The two tools use netsend/netreceive to send data via TCP and glue the two together.

For visualists using Jitter, you can even exchange texture data, which offers some mind-blowing powers for live visuals.

Download at Virginia Tech — bonus, an extension of the aka.wiiremote object so you can use the lovely Wii Fit controller, among various other projects
Discussion on the Unity Community Forums
Discussion on the Cycling ’74 forum
Virginia Tech DISIS

As an interactive prototyping tool, this should have a lot of potential for lovers of patch-style programming.

Thanks to Dr. Ivica Ico Bukvic, DISIS Director and researcher, for sending in his project. I’ll be curious to see what other people might do with this.

Game Audio: Selected Student Works from Matt Ganucheau on Vimeo.

In the early days of game sound, musical soundtracks were all largely adaptive and interactive, fused with the sound effects of the game and the logic of gameplay. Scores were less Alfred Newman or John Williams, more Spike Jones. Today, game music has the potential to reinvent composition itself, to help us reimagine what makes a musical score as on-screen user action drives musical ideas. But with a few, notable exceptions, most modern titles have opted for big, Hollywood-style soundtracks – and the linear composition that goes with them, as though someone just took a film score CD and hit play.

It’s one thing to talk about that in theory. Better yet: give it a shot yourself. So why not teach game music as its own discipline?

Matt Ganucheau, a composer, sound designer, and interactive developer/artist, is teaching just that, working with students at Expression College in Emeryville, California. The accelerated course works with the elegant Unity game engine and a clone of the legendary Space Invaders arcade game, adding music built in Max/MSP. If Max seems an unlikely choice, its open source cousin Pure Data (Pd) is actually integrated with the game engine for Electronic Arts’ Spore, with music by Brian Eno working with EA’s Kent Jolly and contributor Aaron McLeran. So, this could be the wave of the future. The first problem: figuring out how to actually compose.

The results are astonishing, given that the students were just learning Max and had extremely limited amounts of time. I asked Matt to write up for CDM how the coursework evolved; he shares his process and what he learned as a teacher. We’re also working on open sourcing the coursework content and the patches, which we’ll soon provide both for Pd and Max/MSP. I’m doing some work on the game side so that you can play with game mechanics in Processing. Stay tuned for more on that.

We spoke a bit about this process – and interactive music in general – with Xeni Jardin and Boing Boing in their Game Developer Conference livecast a week ago Friday. Edited video of that coming soon.

Here’s Matt on the coursework itself:

When faced with the challenge of updating our Game Audio course at Expression College, we wanted to create a course that reflected the increase of interest in adaptive and interactive audio in the current game industry. To do this successfully, we had to make sure our students had an understanding of how audio engines have evolved in the past eight years. Since our terms are only five weeks and our student body is comprised of non-programmers, this seemed like quite a daunting task. But having carefully fine-tuned the details, we feel we have a good recipe.

First, we begin by having the students build simple environments and place audio emitters inside the Unreal 2k environment. This shows them the restrictions of audio functionality in a proprietary engine. After a few labs with Unreal, the students are then introduced to the concepts of a middleware platform, using Audiokinetic’s WWise connected to the game Cube. Here, they are able to explore more interactive audio such as real-time control parameters and dynamic music changes. Finally, the students are introduced to Max/MSP. Lead through labs comprised of synthesis, sampling, basic programming concepts and sound design, we are able to arm the students will all of the information needed to create their own generative audio engine inside Max/MSP. By hacking away at a recreation of Space Invaders posted to the Unity3d forums (thank you, Eric Haines), we are able to pipe all of the real-time game data to Max/MSP via the UDP transport (with help from Bjerre).

Inside Max/MSP, the game data is received in our Unity2Max patch. With this initial infrastructure in place, the students are able to use the real-time events to remix the classic arcade game with their own audio engine. Piece by piece, we recreate the original audio engine through tasks such as creating the alternating pitched footsteps for the invaders, and a UFO spaceship noise with a flanger and a sine-wave, as well as mapping invader’s proximity to the music’s speed. For their final project, the students are allowed to use these tools to go in any stylistic direction they wish, as long as the music is adaptive.

We did not give students access to all of the game events because we didn’t want them to become overwhelmed with options. To our surprise, these restrictions created the opposite reaction. Students were frustrated by not having a message saying that the “UFO was destroyed”, so they hacked their own ways to find this out by deducing the change in points. In another example a student wanted the missile explosion to sound when the bunker was hit, so he placed a threshold on the missile flight time to be able to see if a bunker was hit. Hacks like these began to appear all over the students projects. This may seem like basic programming techniques to some, but to see this development come from a class of audio engineers is quite amazing.

Although this new course design has only been active for 4 months, we have seen a dramatic increase of interest from our students. Once a cultural standard like Space Invaders is deconstructed, the students become extremely excited to explore a new direction for the classic game. It still amazes me just how far students can go with only 3 weeks of Max/MSP instruction.

Unity Game Engine (recently updated to 2.5, and now both on Mac and Windows)

Cycling ’74, Makers of Max/MSP

Expression College for Digital Arts

And the bits for this game, specifically:

Unity Invaders on the Unity Community Forum (the Space Invaders game used in the class)
Unity Invaders Site with downloadable, playable versions of the game
Discussion of UDP communication between Max and Unity, with the patch solution by Bjerre

Also, don’t miss the fantastic Pd-based book Designing Sound (well worth a read for Max users, as well). It’s an entire textbook built on the idea of doing interactive sound design in Pd, useful for games but other live and interactive sound, too – and while the emphasis is sound design rather than music per se, it remains a great reference on learning to patch and learning about audio synthesis.

Andy Farnell

I ask you: what is the foundation for rhythmic electronic music? I suggest that the humble step-sequencer is the backbone of many of today’s musical genres and memetic evolutions. To have electronic rhythm, you need to start with a clock and go from there, dividing it into fractions and multiples. Then start assigning sounds to those divisions and you’re pretty much there- techno is happening.

I’ve been working on prototyping a sequencer-synth and in doing research, I’ve come across numerous projects that tackle this idea with great enthusiasm. Because a sequencer can drive any type of electronics, projects tend to fall into two categories: audio, or visual. Additionally, I’m seeing two main drivers for the sequence itself: the nimble arduino, and the CMOS 4017 Decade counter IC. I’ll survey here some of the finished projects to give an idea of what’s possible. Come with me, won’t you, on an exploration of the world of DIY sequencers.

First up, a few excellent audio sequencers:

basic arduino sequencer from nikolaosh on Vimeo.

This “basic arduino sequencer” by Nikolaosh is undeniably fun. Looks like four potentiometers controlling software synth parameters, with the Arduino doing the sequencing as well. Basic, but effective nonetheless. You can see more details and grab the code here.

BeatSequencer 1.0 from Kamil Garbacz on Vimeo.

This “Beatsequencer” by Kamil Garbacz also uses Arduino to drive a matrix of LEDs. Looks like the top row indicates the position of the step, while the bottom 3 rows indicate on/off status for the beep assigned to that row. A matrix of switches turns each step on and off, 808-style. It’s a very compact design with a minimal interface, but it seems to work.

cigarduino punk console from frogstar on Vimeo.

This “Cigarduino Punk Console” from frogstar has a lot of great elements- nice pulsewave synthesis from the Arduino and a fun cigar-box case. It’s a little light on the LEDs though- don’t we all like our sequencers to have big banks of LEDs pusling through their paces?

In the 4017 category, we’ve got this nice little box from Note!. It nicely marries the Atari Punk console to the 4017 running as a 4-step sequencer. Good glitchy tones get put through their paces.

This sequencer from 9volts really opens up the possibilities here- he’s using the 4017 synched to a drum sampler, triggering circuit-bent devices and controlling gating and filtering. That’s what I’m talkin’ about right there.

Visual sequences:

PAN PC + 555 + 4017 from h.cosas on Vimeo.

This experiment from h.cosas uses the 4017 to drive an LCD display with interesting results. Dig those color bars!

This LED pattern sequencer by WootsPC is very nice to look at- this should give you an idea of what can be done with a basic sequencer, some LEDs, and an eye for animation.

What I take away from all of these projects is the idea that a sequencer can drive pretty much anything, and the most fun and interesting projects lie not in the sequencer itself, but in what is driven by the sequencer.

I’d really like to see someone who combines these LED animations with a good sounding, nicely-interfaced sequenced synth that’s syncable to MIDI clock input, but I think I might have to build that one myself- I’m working on my own like-minded project, and I’ve realized I’ve got a ways to go before I’ll be satisfied with the results. In case you’re curious, here’s my little project as of two weeks ago. I’ve made some modifications since then, but you get the basic idea.

Is anyone else working on a sequencer project? Please post it in the comments and tell us what how it’s coming along.

Our friend and interactive hero Gustavo Bravetti must have been inspired by all the talk of hexagonal sequencers, because he’s come through with a brilliant prototype of a new interactive sequencer design. He writes:

I just wanna share mi first very unfinished and at ultra alpha stage, hexagonal sequencer prototype!

Between many things, I have planed to include many automatic scale definition tools, follow actions, you’ll can easily change the hexagon density, and multi-touch support via IR (wiimote or cams) is planned also.
This is just a sneak peak.

For an “alpha” version, as you can see, there’s already a lot of goodness going on. The visuals and interaction are powered by vvvv, the free-for-non-commercial use (and otherwise affordable) Windows-only patching language. Max is great, but vvvv is capable of some very powerful features of its own, including particularly nice hooks into Windows’ DirectX rendering engine.

vvvv Site + Wiki + Community

More on vvvv at Create Digital Motion, as it’s most often used on the visual side:
http://createdigitalmotion.com/tag/vvvv

As with so many of these things, vvvv’s community is more valuable than even the tool itself; we’re seeing lots of work on doing clever things with the environment. And vvvv has gotten some powerful music features like VST plug-in support, meaning you could build your sequencer in vvvv and skip something like Live altogether.

Previously on this topic:
Music on the Game Grid: Interactive Arpeggiators Al-Jazari, reacTogon
Alternative Sequencers: Elysium Generative Mac App and the Joy of Hex

And for more of the Awesomeness of Gustavo (pay close attention to that interview, especially):
Live + FM8 = Drum Kit Love: Free FM8 Drum Kit Download
Weekend Inspiration: Ableton Live Follow Actions, Dummy Clips, Making Snares
Interview: Gustavo Bravetti, Playing Music with Light and Interactive Gloves

I want to highlight two sequencers that you play as if they’re games. (Just don’t play a Vulcan – they always win.)

Robots on a Grid

Al-Jazari is named for a 13th-Century scholar and musician who apparently invented an entire band of water-powered hydraulic robotic musicians with more than fifty facial and body movements per song. (Okay, that clearly deserves a separate post later. So, our Western education is so eager to avoid the achievements of Arabs that we skipped over the fact that he basically invented Disneyland in the Middle Ages.)

Al-Jazari in the 21st Century iteration takes the idea of robotic agents and builds a sequencer around them. Creator Dave built a grid on which you can give the robots symbolic instructions (like up, right, down, left), selected from a gamepad. Each grid square represents a note, with pitch modulated by moving bricks up and down. Like Elysium, the music is generated as events are triggered on the grid. And like Microsoft Research’s (non-musical) game Kodu, the gamepad and a set of symbols make what is essentially scripting easy and transparent. (Few would likely call this “programming” because it doesn’t look scary, but that’s what it actually is.)

Al-Jazari is open source, built in the elegant coding language Scheme (a Lisp dialect) atop a game engine called Fluxus. Dave has extensive documentation on its development, and not only the code but even the textures and models. You can use this yourself on Mac and Linux, but it’ll require some messy compiling. (Thanks for this link, MattH – this is layered with things that blow my mind!)

Al Jazari [pawful.org]

reacTogon

Mark Burton’s reacTogon was the influence for Elysium. It’s a “chain reactive performance arpeggiator” – that is, it takes the usual, static, repeating patterns of an arpeggiator and turns them into something altogether different, by allowing events to transform dynamically in two dimensions across a hexagonal grid. The interface is a multi-touch controller with physical objects, so there’s a tangible element, as well.

Looking at reacTogon alongside Al-Jazari really demonstrates some of the advantages of a hexagonal grid versus the more traditional square grid. (And if you think about most musical applications, most of what we have is relatively non-dynamic right-angle grids. There’s movement, but only left to right, with start/stop or loop points. One exception: Follow Actions in Ableton Live.)

Al-Jazari requires movement only to tiles with adjacent edges. reacTogon, since it tiles hexagons, has six adjacent tiles instead of four. It can also map a harmonic table, as other musical hexagonal grids do. Now, that’s not to say reacTogon is better than the other – on the contrary, it demonstrates that just one choice – a grid of squares or a grid of hexagons – can create very different musical possibilities. So even if you’re not musically impressed by these examples just yet, think about the possibilities here. We’re still early in software design and musical interface, so early that something as simple as a simple geometric pattern can become an entire composition.

That’s something to ponder on the eve of the music manufacturers’ trade show.

(If anyone has more documentation on Mark or his creation, let me know.)

Switching tools isn’t a panacea, but it can inspire new ideas, by changing the way you structure your music. Elysium is a powerful new sequencer in development for the Mac the creates generative patterns on a beehive-shaped hexagonal grid. For the hardcore, you can even extend the tool with Ruby and JavaScript.

Elysium is a MIDI sequencer only: it has no sound generation facility of its own. But that makes it an ideal complement to your existing tools and favorite synths; the creator shows it off with Apple Logic Studio (Sculpture physical modeling, anyone?) and Native Instruments Kore.

Elysium [Mac-only public beta, PPC/Intel; 10.5 required]

Most sequencers work like a variation on a score: you compose events in time and it renders those events in precisely the same order each time. Elysium is generative: instead of creating a score, you create a system, and events are determined by the rules of the system. That means the exact deployment of events in time is variable, and things may not sound the same way – or over the same span of time – twice.

To do this, Elysium employs layers, cells, tokens, and callbacks. Huh?

• Layers are roughly equivalent to a track in a traditional sequencer; it’s a single grid of cells, each containing a note, transmitted on one MIDI channel. That means, most likely, you’ll use a different layer for each sound you want to generate in your synth or host.
• Cells are arrayed in a 17×12 honeycomb (a hexagonal grid), each transmitting one MIDI note. They’re organized in a harmonic table – the three adjacent hexagons around a single vertex, for instance, form a triad.
• Tokens are the things that actually do stuff – they’re what make Elysium generative and interactive. Functions currently include Start/Stop, Note (plays an actual note), Rebound (changes direction), Absorb, Split, and Spin (impact movement). Arrange these on the grid, and instead of playing left-to-right as a traditional sequencer would, playback will navigate the spaces on the grid – potentially in unusual and interesting ways. To edit tokens, Elysium uses floating inspector palettes for setting parameters.
• Callbacks give you the power to define your own musical behaviors by scripting them, making your musical world more variable. Elysium uses the same JavaScript interpreter as the Safari/WebKit browser, so you can code in JavaScript. Ruby lovers can even work in MacRuby. These code snippets don’t have to be complex: on the contrary, they’re quite simple and friendly to non-programmers, tantamount to saying “Hey, sequencer, I command you to do THIS!”

Side note: I love the idea of scripting engines. Back in the day, HyperCard’s HyperTalk had simple, scriptable events that even kids could learn. There’s some real potential there, as we’ve seen in Native Instruments’ Kontakt sampler. If you’re afraid of code, don’t be. Even if you do nothing but copy and paste some useful code borrowed from someone else, you can benefit from a scripting engine. Change one variable to suit your purposes – even one number in that code – and you’ve just become a programmer. (Ableton? Ableton Live scripting? Please?)

Anyway, the resulting sequencer navigates through musical materials interactively. Add some layers, and you can create something quite dynamic. If that sounds as though it could become monotonous, consider this: you could use Elysium to trigger a sampler as well as notes on a synth, and you could modulate a synth’s timbres while Elysium drives notes. There’s some serious potential.

Musical Applications

Elysium: Probabilistic Arp from giles goat boy on Vimeo.

Giles Bowkett has a fantastic hands-on feature where he couple Elysium with some hardware sound sources:

Driving Korg Hardware With Elysium [Giles Bowkett Blog]

He also makes note of the similarity to the wonderful-looking reactOgon interface, which took this concept to a tangible table. That means that the actions were actually physical objects placed on the grid that controlled movement – brilliant, though apparently no one knows what happened to the project. (Too bad. I can imagine people playing Warhammer and performing music at the same time.)

There’s a separate hands-on employing Ableton Live, by mmi.

If you want to try this yourself, visit the Elysium project site and be sure to try the:

Introductory screencast

Going Hexagonal

All of this brings us to the question of why hexagonal grids are so cool. It’s been on my mind lately as I just read a fantastic chapter in the book Game Programming Gems 7, a book that could easily be titled “A Collection of Really Cool Ideas from Game Programmers.” Check out the chapter “For Bees and Gamers: How to Handle Hexagonal Tiles.” Basically, the advantages of a hexagonal grid as opposed to our usual square one:

• It’s the most efficient regular tessellation – it has the highest packing density and uses the least perimeter, making for an elegant, organic pattern
• Adjacent tiles can be described as defining a vertex (a point) or a whole edge, and you still get the same number of tiles – six. On a grid of squares, there are only four squares that are adjacent based on side (the ones above, to the right, to the left, an below), but eight squares sharing a vertex (the ones on the diagonal). That makes navigation through the grid somewhat confusing – though it does enable the games of chess and checkers.
• The distance from one tile to an adjacent tile is the same, whichever direction you go.

This comes up in game design because hexagonal grids work well for mapping movements of … well, little dudes fighting in strategy games. The advantage is the inverse of what you get in checkers and chess: you can define one kind of movement from a tile to an adjacent tile.

You can perhaps already see what this means for music. It means hex grids are efficient, they allow unambiguous movement to adjacent tiles, and they form neat little triads and dyads that can make sense harmonically when we’re talking pitch.

At the same time, these seem advantages pose some challenges. The hex grid is so regular, it’s a little hard to look at. There’s a reason pianos use keys of different sizes and colors. It would be possible to use clever coloring schemes to help with this, though the shape would remain regular (and thus a little hard to look at). Elysium does have a color scheme applied, but it certainly requires some adjustment; perhaps the ability to shift on-the-fly to see pitch relationships could help.

I do also wonder if there aren’t ways of using these kinds of grids aside from just putting a note on each tile. Elysium does have more going on, but you can’t see it. It’s all hidden behind the tiles in scripts and slightly hard-to-recognize icons. It’d be great to see more visual representation of movement and interaction. This app is new, so perhaps there’s still time.

That said, I think the capabilities here are already amazing. I was a skeptics of hexagonal grids when I first saw them, feeling as though I’d just been dropped on an alien starship. (Greetings, fellow Cardassians!) But there is something behind the geometries we use. And I have no doubt that a lot of future experimentation with sequencers will involve more than just grids that read, as piano rolls and notation once did, in linear fashion from left to right.

Related

Giles Bowkett also investigates the Erratic probabilistic VST drum machine for Windows, which he says is better suited to drum parts than Elysium is. (Erratic is the plug-in’s name – not that I haven’t occasionally encountered an erratic plug-in.)

Nodal, like Elysium, is Mac only, free, and uses a graphical interface to create interactive rules. Interestingly, it uses square grids to Elysium’s hex grid and provides schematic-like flow diagrams of movement. Each approach, I think, has some advantages and tradeoffs.

Kodu by Microsoft Research uses interactive rules for game design, not music, but I can see the interface working well for musical applications, too. What really makes it work is that you have immediate visual feedback as to what you’ve created, which makes the kid doing the driving very pleased, indeed.

Intermorphic’s own generative suite draws upon a lineage that includes Eno’s landmark Ambient Music I. It’s far less graphical,but can be used to create sophisticated systems, interfaces with mobile devices, and provides deployment options (so other people can hear your generative work and not just a recorded take).

And be sure to check out the generative tag on CDM.

For a hardware device using this scheme (and with a nice solution to the color / mapping challenges), check out the C-THRU Axis.

The AXiS-64 pro MIDI controller [Product Page @ C-THRU MUSIC]

Zillion-Keyed Keyboards, New Musical Layouts, and Microtonal Gadgets [CDM, on NAMM 07]

(thanks, MattH, for the reminder to get this bit in, too!)

Auditorium is a fascinating free Flash game that turns interactive music arrangement into a series of puzzles. The center of the game is what the creators call “flow” – a visual stream of particles that can be directed to audio “containers” to create sound. The user places circles with icons signifying direction in the stream to redirect the particles where desired. As the stream hits the containers, it produces musical patterns. The results aren’t entirely open-ended – that is, there is a fairly fun puzzle game here, in that you can only “clear” a level by directing the flow of particles through all the objects. But the creators do claim that:

Auditorium is about the process of discovery and play. There are no right or wrong answers; there are many ways to solve every puzzle. To get started, fill up the first audio level.

playauditorium.com

The game so far is just a “demo”; the goal is to flesh out the game and deliver a more fully-functioning version. There’s a precedent for that: games like N+ (formerly N), Crayon Physics, World of Goo (formerly Tower of Goo), fl0w, and Da Blob – even the prototype for breakout hit Portal – began their life as free games or research prototypes before becoming officially-published titles, just to name a few. In fact, a significant chunk of what’s happening in game design these days is beginning its life in research and indie projects. That’s likely because hardcore and casual gamers alike are hungry for new concepts, and A-list developers are saddled with epic projects and bone-crunchingly huge ambitions and budgets. I’m not certain Auditorium will be the next big hit, but this kind of model could generate the interactive music games that future-minded music lovers have been anticipating.

My only criticism here, as with many similar games, is that the actual music content is fairly static. It’s a good prototype, but it’d be great if these particles had more influence on music. That creates a new problem for game designers: the music itself is really part of the game mechanics. Part of the fault here is Flash, whose sonic capabilities are fairly limited without a significant investment of effort. I’d love to see a game environment in which it’s easier to prototype musical ideas, with live-generated musical materials and synthesis.

The prototype here is promising, though. Found other interactive music games out there you like? Do let us know!

(Thanks, Brent!)