Didgeridoo from bar|none on Vimeo.

You can’t quite dance to it, but bar|none has a beautifully-shot video of a strange, invented instrument constructed with some of the technologies we saw last week. As noted then, new support for OSC in the powerful Kyma sound system means the ability to control imagined instruments in more sophisticated, higher-resolution ways. Just days later, bar|none responded to my post with one of his first experiments. It’s just the beginning of his work, so judge it accordingly – think of the first emanations of a newly-created musical instrument – but it’s a reminder that far-out ideas are possible when you combine custom soundmakers with expressive control.

The controller is Jeff Snyder’s Manta, a touch-sensitive controller with velocity sensitivity and a 6×8 array of hexagons. Jeff showed off his instrument at Handmade Music Monday night here in New York; I hope to follow up with a closer look at the Manta soon. Notably, the Manta is not an OSC device; it’s an HID USB device, just as a typical mouse or keyboard is. HID, the standard drivers for which are included in every desktop OS, also supports high-resolution data, so it’s a second alternative to MIDI for input.

My first Kyma X patch for the Pacarana. Kyma is unreal and let’s you do almost anything in Sound Design. I took a concept of a didgeridoo patch on my modular and built it back in Kyma but with even more expression. This is still a work in progress.

The touchplate is a Snyderphonics MANTA. I spent some time coding some algorithms in MAX to enhance the performance control of the patch using velocity, aftertouch and polyphonic aftertouch + controls using OSC to Kyma.

The Manta is a fantastically wonderful controller. It shows it’s [sic] flexibility and feel here.

The patch is microtonal meaning pitches are in divisions of the western concept of half and whole tones.

Since that video, he’s been trying more sonic ideas:

Been messing with this sound and here’s a version where the didgeri is resonating as if it were a metalic vibrating tube as well. This is just trying to see the kind of sounds I can get out of the patch.

soundcloud.com/barnone/karplusdigeri

This makes me wish I could afford this setup, but if, like me, you’re on a tighter budget, the ideas here could easily be applied to other rigs. Keep the experiments coming!

Updated: bar|none aka Chris Lloyd shares his camera of choice: it’s a Canon 7D with a 50mm 1.4 lens for the “Bokeh blur effect,” a tip from stretta.

Hexagons are the new squares.

After years of square grids, music is discovering the hexagon in a big way. Hexagonal lattices have advantages of their own, in terms of how efficiently they pack space and the way adjacent sides align. Don’t believe your local mathematician? Ask your local bee.

What’s interesting is that, as musicians experiment with interfaces and structures, they may wind up with either a wild, experimental music synthesizer, or a fun game.

On the game side, at top, we have a trailer for the upcoming “Fractal.” It appears to match the productivity-annihilating addictiveness of puzzle games with reactive music. As the creators put it, it’s “a fierce intersection of fractal gameplay, dynamic audio, and kaleidoscopic visuals” and “a new ambient music puzzler experience. Combo, Chain, and Cascade your way through a pulsing technicolor dreamscape that reacts to your every move, while manipulating Fractals, creating Blooms, and expanding your consciousness at 130 BPM.” They cite Andre Michelle’s ToneMatrix, a Tenori-On-like Flash app (see videos), as a major influence, in addition to games like Lumines.

It could also be that the developers have been reading CDM and decided to engineer the perfect solution to permanently steal your lives, oh reactive music-loving, gaming nerdsters.

The game is from the creators of Auditorium, a beautiful puzzler that simultaneously involved arranging ambient music. I couldn’t get entirely sucked into Auditorium’s gameplay, but now, if CDM’s blog posts suddenly disappear for a few days when this comes out, I may realize that was a good thing. For more:

Cipher Games Lifts the Veil on Synaesthetic Puzzler Fractal [Bytejacker]
playfractal.com

If you’re wondering if these same sorts of structures could be transformed from game rules to musical rules, you’ll like the next project. Paris-based Composer René Micout has built an elaborate musical application inspired by the Reactogon music sequencer / “chain reactive performance arpeggiator.”

If you’re comfortable with French, there’s an extensive three-part demo on YouTube.

Part 2
Part 3 (if you want to skip to the end and just watch the resulting demos)

As in other similar nodal and hexagonal sequencers, Rene’s work applies interactive musical events to spots on the grid. Different modules control the flow of events from one space to another, transposition, tempo, and other events.

It’s an experimental project at the moment, and not necessarily one he may distribute, but as a way to see some ideas, it’s fantastic. Rene tells us he built this application using RunRev, a rapid-prototyping development environment and spiritual successor to the legendary HyperCard. Unfortunately, that tool lacks strong music and sound components, so he actually had to hack it in, using AppleScript events to control the built-in Mac QuickTime synthesizer.

He’s got other projects on the way, too, including a “Stocastofon, Stocastovox, Ritmofon, Rizomofon, Acordofon.” Excellent!

So, keeping score, a few of our previous views of hexagons:

Music on the Game Grid: Interactive Arpeggiators Al-Jazari, reacTogon
Alternative Sequencers: Elysium Generative Mac App and the Joy of Hex

And I think it’s time for me to go visit some of these hexagonal controller manufacturers at NAMM next week.

Your help wanted: The hexagon deserves its own master list of hardware, software, iPhone applications, experimental installations, etc. Nominees? Links I may have missed? Anyone doing turn-based strategy role-play games that are also musical sequencers? (Now that I’d like to see: Machinedrum Fantasy Tactics.)

Dream Theater keyboardist Jordan Rudess and noise.io developer Amidio have made a crazy-looking hexagonal sequencer for the iPhone. It comes with plenty of samples and factory sessions if you just want to play around, but I imagine the greatest draw for CDM readers is that it allows exporting your own files via a WiFi server application.

(Ahem… cough… Google Android and others don’t require any special app just to get files onto your mobile device. Sorry, something got stuck in my throat. Cough… ahem… can we have a real, live audio system in Android now, please? Whoops, throat thing happened again.)

This application also works with Beatmaker, so you now have a pretty nice studio of mobile apps on the iPhone and iPod touch. If your arms have been cramped whipping out your laptop on the Chinatown bus to Boston (now with 6″ of legroom), this could be a huge help.

More features:

• Stutter, chorus, and bit-distortion effects
• Seamless loop creation you can use with Beatmaker or your own favorite audio production tool
• Cell randomization

JR Hexatone Pro is US$9.99.

JR Hexatone Pro Site @ Amidio
Via the ever-up-to-date, ever green-on-black Matrixsynth

Now, this isn’t the only way to get your hexagon on with music sequencing. See previously:
Hexagonal Sequencer with vvvv, MIDI, Ableton, and Soon Wii, Camera Input
Music on the Game Grid: Interactive Arpeggiators Al-Jazari, reacTogon
Code Your Own Sequencer? Archaeopteryx Generates MIDI with Ruby

Here are the developer’s videos:

…including some preset examples:

Lastly, from Jordan himself, here’s a tutorial on sound programming with the tool:

I want to highlight two sequencers that you play as if they’re games. (Just don’t play a Vulcan – they always win.)

Robots on a Grid

Al-Jazari is named for a 13th-Century scholar and musician who apparently invented an entire band of water-powered hydraulic robotic musicians with more than fifty facial and body movements per song. (Okay, that clearly deserves a separate post later. So, our Western education is so eager to avoid the achievements of Arabs that we skipped over the fact that he basically invented Disneyland in the Middle Ages.)

Al-Jazari in the 21st Century iteration takes the idea of robotic agents and builds a sequencer around them. Creator Dave built a grid on which you can give the robots symbolic instructions (like up, right, down, left), selected from a gamepad. Each grid square represents a note, with pitch modulated by moving bricks up and down. Like Elysium, the music is generated as events are triggered on the grid. And like Microsoft Research’s (non-musical) game Kodu, the gamepad and a set of symbols make what is essentially scripting easy and transparent. (Few would likely call this “programming” because it doesn’t look scary, but that’s what it actually is.)

Al-Jazari is open source, built in the elegant coding language Scheme (a Lisp dialect) atop a game engine called Fluxus. Dave has extensive documentation on its development, and not only the code but even the textures and models. You can use this yourself on Mac and Linux, but it’ll require some messy compiling. (Thanks for this link, MattH – this is layered with things that blow my mind!)

Al Jazari [pawful.org]

reacTogon

Mark Burton’s reacTogon was the influence for Elysium. It’s a “chain reactive performance arpeggiator” – that is, it takes the usual, static, repeating patterns of an arpeggiator and turns them into something altogether different, by allowing events to transform dynamically in two dimensions across a hexagonal grid. The interface is a multi-touch controller with physical objects, so there’s a tangible element, as well.

Looking at reacTogon alongside Al-Jazari really demonstrates some of the advantages of a hexagonal grid versus the more traditional square grid. (And if you think about most musical applications, most of what we have is relatively non-dynamic right-angle grids. There’s movement, but only left to right, with start/stop or loop points. One exception: Follow Actions in Ableton Live.)

Al-Jazari requires movement only to tiles with adjacent edges. reacTogon, since it tiles hexagons, has six adjacent tiles instead of four. It can also map a harmonic table, as other musical hexagonal grids do. Now, that’s not to say reacTogon is better than the other – on the contrary, it demonstrates that just one choice – a grid of squares or a grid of hexagons – can create very different musical possibilities. So even if you’re not musically impressed by these examples just yet, think about the possibilities here. We’re still early in software design and musical interface, so early that something as simple as a simple geometric pattern can become an entire composition.

That’s something to ponder on the eve of the music manufacturers’ trade show.

(If anyone has more documentation on Mark or his creation, let me know.)

Switching tools isn’t a panacea, but it can inspire new ideas, by changing the way you structure your music. Elysium is a powerful new sequencer in development for the Mac the creates generative patterns on a beehive-shaped hexagonal grid. For the hardcore, you can even extend the tool with Ruby and JavaScript.

Elysium is a MIDI sequencer only: it has no sound generation facility of its own. But that makes it an ideal complement to your existing tools and favorite synths; the creator shows it off with Apple Logic Studio (Sculpture physical modeling, anyone?) and Native Instruments Kore.

Elysium [Mac-only public beta, PPC/Intel; 10.5 required]

Most sequencers work like a variation on a score: you compose events in time and it renders those events in precisely the same order each time. Elysium is generative: instead of creating a score, you create a system, and events are determined by the rules of the system. That means the exact deployment of events in time is variable, and things may not sound the same way – or over the same span of time – twice.

To do this, Elysium employs layers, cells, tokens, and callbacks. Huh?

• Layers are roughly equivalent to a track in a traditional sequencer; it’s a single grid of cells, each containing a note, transmitted on one MIDI channel. That means, most likely, you’ll use a different layer for each sound you want to generate in your synth or host.
• Cells are arrayed in a 17×12 honeycomb (a hexagonal grid), each transmitting one MIDI note. They’re organized in a harmonic table – the three adjacent hexagons around a single vertex, for instance, form a triad.
• Tokens are the things that actually do stuff – they’re what make Elysium generative and interactive. Functions currently include Start/Stop, Note (plays an actual note), Rebound (changes direction), Absorb, Split, and Spin (impact movement). Arrange these on the grid, and instead of playing left-to-right as a traditional sequencer would, playback will navigate the spaces on the grid – potentially in unusual and interesting ways. To edit tokens, Elysium uses floating inspector palettes for setting parameters.
• Callbacks give you the power to define your own musical behaviors by scripting them, making your musical world more variable. Elysium uses the same JavaScript interpreter as the Safari/WebKit browser, so you can code in JavaScript. Ruby lovers can even work in MacRuby. These code snippets don’t have to be complex: on the contrary, they’re quite simple and friendly to non-programmers, tantamount to saying “Hey, sequencer, I command you to do THIS!”

Side note: I love the idea of scripting engines. Back in the day, HyperCard’s HyperTalk had simple, scriptable events that even kids could learn. There’s some real potential there, as we’ve seen in Native Instruments’ Kontakt sampler. If you’re afraid of code, don’t be. Even if you do nothing but copy and paste some useful code borrowed from someone else, you can benefit from a scripting engine. Change one variable to suit your purposes – even one number in that code – and you’ve just become a programmer. (Ableton? Ableton Live scripting? Please?)

Anyway, the resulting sequencer navigates through musical materials interactively. Add some layers, and you can create something quite dynamic. If that sounds as though it could become monotonous, consider this: you could use Elysium to trigger a sampler as well as notes on a synth, and you could modulate a synth’s timbres while Elysium drives notes. There’s some serious potential.

Musical Applications

Elysium: Probabilistic Arp from giles goat boy on Vimeo.

Giles Bowkett has a fantastic hands-on feature where he couple Elysium with some hardware sound sources:

Driving Korg Hardware With Elysium [Giles Bowkett Blog]

He also makes note of the similarity to the wonderful-looking reactOgon interface, which took this concept to a tangible table. That means that the actions were actually physical objects placed on the grid that controlled movement – brilliant, though apparently no one knows what happened to the project. (Too bad. I can imagine people playing Warhammer and performing music at the same time.)

There’s a separate hands-on employing Ableton Live, by mmi.

If you want to try this yourself, visit the Elysium project site and be sure to try the:

Introductory screencast

Going Hexagonal

All of this brings us to the question of why hexagonal grids are so cool. It’s been on my mind lately as I just read a fantastic chapter in the book Game Programming Gems 7, a book that could easily be titled “A Collection of Really Cool Ideas from Game Programmers.” Check out the chapter “For Bees and Gamers: How to Handle Hexagonal Tiles.” Basically, the advantages of a hexagonal grid as opposed to our usual square one:

• It’s the most efficient regular tessellation – it has the highest packing density and uses the least perimeter, making for an elegant, organic pattern
• Adjacent tiles can be described as defining a vertex (a point) or a whole edge, and you still get the same number of tiles – six. On a grid of squares, there are only four squares that are adjacent based on side (the ones above, to the right, to the left, an below), but eight squares sharing a vertex (the ones on the diagonal). That makes navigation through the grid somewhat confusing – though it does enable the games of chess and checkers.
• The distance from one tile to an adjacent tile is the same, whichever direction you go.

This comes up in game design because hexagonal grids work well for mapping movements of … well, little dudes fighting in strategy games. The advantage is the inverse of what you get in checkers and chess: you can define one kind of movement from a tile to an adjacent tile.

You can perhaps already see what this means for music. It means hex grids are efficient, they allow unambiguous movement to adjacent tiles, and they form neat little triads and dyads that can make sense harmonically when we’re talking pitch.

At the same time, these seem advantages pose some challenges. The hex grid is so regular, it’s a little hard to look at. There’s a reason pianos use keys of different sizes and colors. It would be possible to use clever coloring schemes to help with this, though the shape would remain regular (and thus a little hard to look at). Elysium does have a color scheme applied, but it certainly requires some adjustment; perhaps the ability to shift on-the-fly to see pitch relationships could help.

I do also wonder if there aren’t ways of using these kinds of grids aside from just putting a note on each tile. Elysium does have more going on, but you can’t see it. It’s all hidden behind the tiles in scripts and slightly hard-to-recognize icons. It’d be great to see more visual representation of movement and interaction. This app is new, so perhaps there’s still time.

That said, I think the capabilities here are already amazing. I was a skeptics of hexagonal grids when I first saw them, feeling as though I’d just been dropped on an alien starship. (Greetings, fellow Cardassians!) But there is something behind the geometries we use. And I have no doubt that a lot of future experimentation with sequencers will involve more than just grids that read, as piano rolls and notation once did, in linear fashion from left to right.

Related

Giles Bowkett also investigates the Erratic probabilistic VST drum machine for Windows, which he says is better suited to drum parts than Elysium is. (Erratic is the plug-in’s name – not that I haven’t occasionally encountered an erratic plug-in.)

Nodal, like Elysium, is Mac only, free, and uses a graphical interface to create interactive rules. Interestingly, it uses square grids to Elysium’s hex grid and provides schematic-like flow diagrams of movement. Each approach, I think, has some advantages and tradeoffs.

Kodu by Microsoft Research uses interactive rules for game design, not music, but I can see the interface working well for musical applications, too. What really makes it work is that you have immediate visual feedback as to what you’ve created, which makes the kid doing the driving very pleased, indeed.

Intermorphic’s own generative suite draws upon a lineage that includes Eno’s landmark Ambient Music I. It’s far less graphical,but can be used to create sophisticated systems, interfaces with mobile devices, and provides deployment options (so other people can hear your generative work and not just a recorded take).

And be sure to check out the generative tag on CDM.

For a hardware device using this scheme (and with a nice solution to the color / mapping challenges), check out the C-THRU Axis.

The AXiS-64 pro MIDI controller [Product Page @ C-THRU MUSIC]

Zillion-Keyed Keyboards, New Musical Layouts, and Microtonal Gadgets [CDM, on NAMM 07]

(thanks, MattH, for the reminder to get this bit in, too!)