Imagine drawing an interface on paper, then being able to use it as a musical interface. Or, heck, don’t imagine it – do it. Unfortunately, the kinds of intelligence necessary to make the music video in yesterday’s post just aren’t practical yet. (That is, you could draw a picture of a keyboard, and even use the picture as a music controller, but while you or I could recognize a keyboard from a drum pad and know that line is a fader, a computer would need some sort of advance structure for any recognition to work.) But you can do some really clever things, as folks have shared in comments.

And using some basic paper interfaces, you can make entire instruments for just a few dollars.

Of course, the awesomest way to do anything is with LAZORS. Greg Kellum and Alain Crevoisier presented a paper at last year’s NIME (a conference for new interface designs for music) proposing a system for making any surface a control surface. Like the music video yesterday, you can configure your surface to function however you like – even dividing it up into pads and faders.

By now, you’e likely seen plenty of multi-touch interfaces or means of tracking hands. But, to paraphrase the NIME paper, these either require a special surface (or transparent surface), or they can’t actually detect when you’re touching. You can even use multiple cameras or an IR beam, but there are limitations to accuracy and the size of the usable surface that would result. Kellum and Crevoisier use an infrared camera and two illuminators, each built by pointing a laser at a mirrors.

Yawn, you say, been there, done that, seen Jeff Han’s video… The advantage of this system is that you can use any surface, like your dining room table. And you can configure that surface however you like. There’s even a freely-downloadable Surface Editor you can extend in Java and Processing. The creators claim they can even get input latency down to a reasonable 10 ms using high-speed cameras.

Transforming Ordinary Surfaces into Multi-touch Controllers [PDF paper, NIME 2008]
Future Instruments > Projects
Thanks, Randy Jones!

db3ll has created a keyboard out of paper, and of course it works better than those flimsy rubber “roll-up” pianos you see for sale. “Conductive ink is what I used,” he says, “painted on as traces on the non-printed side of the paper.” That’s the twist – I had assumed you’d use the top of the paper, but the trick is to use the reverse side to provide the “wiring.” He also offers advice for making a fader:

You can make a paper thin fader in much the same way, but it requires a magnet. Cut a slot in a piece of paper, color around the slot with conductive ink (I use the “trace repair” pens sold at electronics supply places… it has a very fine tip), and glue some SVHS tape (resistive side up) under it. Put a thin piece of metal beneath the SHVS tape & use a magnet to conduct between the SVHS tape & the conductive ink. The magnet will stay in position due to the metal (I use package banding) under it, and aside from the magnet, it is roughly the thickness of a couple sheets of paper.

Simon Lacelle is also working on a project I’m eager to see:

In a pad controller I’m making using a HUGE Staples calculator, I’m using strips of aluminium foil separated by a sheet of paper with holes at each button as switches merely a milimeter thick, and these are quite responsive.

A YouTube uploader by the name of DJ Mocap appeared briefly online with a project that seems to show him controlling Traktor with a drawing. There’s a camera and some sort of analog input being fed into a circuit board, but I’m not entirely sure what’s going on – though I can think of a couple of ways to make this work. It stumped DJ Tech Tools’ readers, but I have a feeling it can’t stump CDM readers, so have at it.

UPDATED – FAKE (but possible) Okay, so this turns out to be a Stanton touch controller hiding underneath a piece of paper. Of course, that’s itself not such a terrible idea – by having a drawn overlay, you have visual feedback for specific positions on the controller. But furthermore, while this is fake, the idea remains possible – and more cheaply than buying a piece of Stanton gear to toss under your piece of paper. So I call this “fake but potentially inspiring.”

Thanks to Gizmo from Scratchworx. Now, show Gizmo and Mocap by making a real version of this!

Just to consider moving in the opposite direction, I have to point to Amit Pitaru’s Sonic Wire Sculptor, an interface for drawing virtually and digitally. Because it’s digital, you can draw in 3D, do something you can’t with real-world markers. Here it is in a Tokyo gallery installation version; see more information (or try it yourself online) at Amit’s site.

And back to the realm of the imaginary – could MPCs of the future be made out of cardboard? (Oh, how I love reading YouTube comments. “Doesn’t look too sturdy.” “Why do you have your MPC in a box?” Apparently some people thought this was somehow insulting hip-hop. YouTube comments – pushing the very frontier of stupidity.)

Thanks to dyscode on comments — brilliant.

The cardboard MPC comes from theycontrol.us and our friend Elijah Torn, as seen previously on CDM.

Doing it Yourself

If you’re interested in entering the world of paper, drawing, and controllers, there are two directions I’d suggest.

One way to go is to simply start thinking about drawing as an interface. The creator of Tablet 2 MIDI, a MIDI-graphics tablet interface, suggests that using the pen you can draw any interface you like, then map it to tablet input. That concept could certainly be applied more broadly.

As far as using paper and a conductive pen to doodle your own musical creations, it turns out this is one of the easiest ways to learn about resistance in electronics.

PAiA 2 Transistor “Ribbon” Kit from Create Digital Media on Vimeo.

Learn Musical Electronics, No Soldering: Free PAiA Ribbon Controller Kit for CDM Readers

This project, which we covered at the end of 2007 and featured at our Handmade Music event, is ideal for giving young people (or the solder-phobic) their first step into electronics. The whole kit fits on a business card; you just need speakers to which you can connect.

The Drawdio project uses the same basic circuit and principle, but attaches it to a pen, making the rig a little more portable and allowing other fascinating experiments. It’s also available for purchase.

http://web.media.mit.edu/~silver/drawdio/

You’ll find countless variations of the basic circuit, because it’s so simple, and it’d be a great way to get into the more sophisticated (or at least more complex) ideas here.

Other ideas? Questions? Stuff I’ve left out? Let me know, and I’ll update the story.

“It comes from tomorrow …but it’s here today.”

Well, now it is tomorrow. And yesterday’s tomorrow still looks futuristic. Try this test: show someone the video above for the Millioniser 2000, a MIDI harmonica designed by Ronald Schlimmer. Tell them this is a 2009 video designed to go viral, a fakery of 80s cheese. After all, the instrument itself looks impossibly futuristic. Surely this wasn’t really designed in 1979. Surely the close up thigh shots of the backup singer girls in the back are tongue-in-cheek parody.

Your friends will believe you. Of course, you’ll be lying.

It did indeed come from tomorrow – and speaking from tomorrow, I’d like my instrument back. The MIDI harmonica has sophisticated breath control, a compact form factor, clever controls for adjusting pitch, and — well, you know, all the goodness of the harmonica but with an easier pitch layout to figure out. From comments, we see that it does go well with our futuristic instruments, meaning you don’t have to get retro-sounding synths – you could get something more 2009-appropriate.

Rock Erickson -The first American called to Europe to play and record with Walter Mueller’s Millioniser 2000. Harmonica like in principal giving the end user complete control over synthesizer and midi functions with the sensitivity of your own breath. This instrument is a one of a kind powerhouse. The video starts off by showing the functions of Millioniser 2000 and then merges into the on stage video which was shot in London. Rick Fenn of “Lie For A Lie” Sony Music was the music director and lead guitarist along with Charlie Barret from The FIXX on bass. The Millioniser Breath Controller units that I’m currently using in the studio are breathing new life (literally) thru their capability to dynamically control some of the most popular software and rack synths ( Garritan Personal Orchestra, Roland Sound Canvas, Yamaha VL70 ect ) and samplers like SampleTank & Tascam Giga Studio ) in both the mono and polyphonic arena. If you have comments or questions please post here or email rock@millioniser.com

Oh yeah – and this all looks strikingly similar to the (less sophisticated) iPhone apps from Smule, featured in today’s interview.

All I know is, I desperately want one. And you might even be able to build one — the microcontroller inside, a Moto 68705, is the equivalent of what you can get very cheaply now.

Who were these forward-looking folk? According to Wim Dijkgraaf’s history of the instrument, you can thank Swiss harmonica player Walter Muller (”Walt Miller”), Ronald Schlimmer of SM Elektronik (that name should be familiar – think a lot of the sensors used in music projects now), and the good folks of Acorn Computers for assembly, who in turn had their own ahead-of-its-time products like the BBC Micro and the self-named Acorn. (The Acorn drove the original version of the Sibelius notation product now owned by Digidesign/Avid. Sibelius engineers swore they never got the performance out of Windows and Mac OS that they once had on the Acorn.)

Via our friend Elijah B. Torn and Matrixsynth.

Anyone out there who knows how to get this, yes, I want one. I’ll start working out and seeing if I can make my physique transparent, as that’ll help.

Lesson learned: tomorrow is yesterday.

Via comments: RA has more links, plus promising news that there may be indeed be a modern update of this instrument.

http://www.musicweb.ch/millioniser_2000.asp (long demo)
http://www.musicweb.ch/millioniser_geschichte.asp (sound demos and great pics)

Performance with Cubie from sadmb on Vimeo.

Music sequencing as a Rubik’s Cube-style game, or hypnotic, kinetic rotating wheels – your piano roll won’t know what hit it. New musical art is set to be performed in Argentina, but you can download both tools, free.

Computer interfaces for music date back decades now, but with ingrained notions of hardware sound sequencers, linear media like tape, and hundreds of years of notation in staves and bars, old habits can be hard to kick. Yet it seems that suddenly, a younger generation of audiovisual composers is exploding notions of how musical interface and sequence could work, fully embracing a virtual space in which they themselves have come of age.

Next month’s spectacular-looking 404 Festival could make anyone want to book a flight to Argentina. Two highlighted artists from this festival for me really embody the possibilities of new sequencing metaphors. Both are built in Java.

At top, Cubie by Sadam Fujioka of Japan is free, downloadable software that combines audiovisual performance and game in a rotating cube.

Cubie is a software instrument which provides innovative idea of musical performance, differs from existing musical performance system such as musical notation, DJ systems, DAW systems, etc… It has a novel concept incorporating a new interactive technique based on puzzle games. Music is represented from highly saturated colored letters on a 3D cube. Almost unlimited number of melodies and rhythms can be created from a combination of those letters, and it can be changed on real-time by operations based on puzzle game. Those playful operations push a performer to play repeatedly and get the skill of performing with Cubie. Cubie is free software and you can play just like sadmb do.

More information in both Japanese and English at sadmb site (with lots of other software, as well). Built in Java with the use of JSyn for synthesis.

http://sadmb.com/

If these cubes feel overly rigid to you, though, and you don’t like the mechanical repetition of these lines, enter the crazy, spinning world of Hiroshi Matoba.

Hiroshi Matoba: OVERBUG from antjeverena on Vimeo.

Overbug is a music-performance tool designed to compose Minimal and Dance Music.

Through looping and newly arranging sound patterns, called ‘Bugsounds’, the program creates complex, polyrhythmic sounds. Overbug differs from conventional linear controlled music sequencers, which arrange the sound into a linear timeline from left to right. In Overbug the sound arrangement of the repeating music loops is equal to the visual abstraction of circular actions which built the interface through circles.

I showed a very early sketch I was working on last year of a circle-based sequencer, also built in Processing, though (cough) my chops are nowhere near Hiroshi’s. I was more interested in using the circles to subdivide cycles, as in Indonesian music. Seeing this piece is a major kick in my pants to try to work on my project a bit more and go a different direction.

Here’s a demo video explaining how this works:

More information + free download (just updated this month):
http://www.dominofactory.net/Overbug/

If You’re in Argentina

Don’t miss a terrific-looking exhibition of Japanese works and the rest of the
http://www.404festival.com/
(info in Spanish + English)

These two works clearly belonged together, but I feel bad for not featuring any Latin American (or Argentinian, specifically) work — those of you associated with 404, if you’ve got hot tips, send them in.

Software doesn’t have to mean virtualizing everything and letting go of physical objects. On the contrary, it can create all sots of imaginative, new ways of mapping musical ideas to the physical world. And that’s how we wind up with a walnut drum sequencer.

There’s something about virtual drum machines and snacks. We’ve seen bubblegum and Skittles, beer bottle caps, soda bottles, and now walnuts. Don’t stop now: someone has to do Cheetos, even if it means dealing with orange stuff all over your fingers.

That said, it’s not walnuts that make d-touch an important project. Built by Enrico Costanza back in 2003, the project is now available for free download as an open source library, a server (in case you don’t want to get into the C++ code but might want to use this in your own projects), a free, usable drum machine, and a set of documentation that can help you make your own stuff easily. Enrico worked on the original reacTable prototype and has done some really important work in this field. Right now, Enrico and co are looking for feedback, but if you’re ready to just be a tester and play with this – and see what you can do musically – now’s your chance.

d-touch also combines high levels of computer readability for accurate tracking with the ability to make your own tags. Instead of using ugly-looking glyphs, you can make patterns that make sense to human beings as well as computers. Oh, yeah – and mobile fans, this runs at a full 14 fps even on S60 phones.

For more, check out the d-touch site:
http://d-touch.org/ [Register first to make the download available]
and follow them on Twitter:
http://twitter.com/audiodtouch

Thanks to Martin (of reacTable, which is moving toward a commercial product) for sending this our way. Thanks, too, to Ben, who’s working on tangible interfaces with special needs students. I really look forward to hearing how that’s going.

Digital technology has made music oddly invisible, virtualized somewhere inside a screen – but it also allows music to be mapped more literally to the physical world than ever before. Some of these experiments may even be silly, but they suggest a lot of possibilities.

From Poland, BeatMachine is a project that sequences beats in a step sequencer using discarded beer bottle caps. Would-be Internet haters, I suggest you count the number of beer bottle caps on the table, and start drinking that number while watching. I guarantee eventually it’ll seem like a brilliant idea.

Make sure you keep watching to the clever-looking software they’ve evidently developed for the task.

http://mw.boo.pl/beatmachine/

If this seems familiar, it was in fact inspired by the Bubblegum Sequencer featured here previously, and its rival I Eat Beats. Through the power of the Internet, iterating and improving ideas isn’t just something you do for yourself alone – it’s something you can share with others. That’s the idea behind our own tangible interface hackday coming up on Saturday:

http://hackday.noisepages.com

Thanks to Artur Nowak for the tip. I know we have a number of readers in Poland, so is there anyone who could help with a quick translation?

(Oh, and Poland, by the way – my book was actually translated into your language!)

For that reason, you may be intrigued to see this video of Zen Piano, a demo app for the iPhone and iPod touch. The idea: respond not only to the position of your finger taps, but also to how hard you’re tapping the phone That promises “velocity-sensitive” tapping, which would make touchscreen interfaces more powerful.

Here’s the somewhat overheated description by GreatApps, who say their “patent-pending,” “cutting-edge” technology is the result of “having gone through the research and development phases.”

TapForce^TM has been developed from the ground up to provide a completely intuitive way of interaction for users. It can detect more than a hundred different levels of force, and has an accuracy that has to be seen to be believed. And all this can now be done in software, no hardware modifications are necessary. Hundreds of millions of devices currently on the market can make use of the TapForce^TM technology today.

A whole new range of games and apps has just been made possible.

http://greatapps.co.uk/technologies/

Okay, so what is it doing, exactly?

Most likely, it’s simply reading data from the accelerometer. Hit the device harder, and the accelerometer will respond to more force. That’s actually a fairly clever combination of two sensors – it’s just not the sort of stuff you’d necessarily want to trademark or try to get patented, at least, not if you’re a normal person. (TapForce creators, feel free to explain to us that you’re doing something fancier and I’ll eat my words.)

In fact, part of the reason I suspect that’s how they’re doing this is I’ve been tipped off by a developer who’s already implemented just this. He even uses a piano-style keyboard to show it off.

Sadly, that developer and application is Memo and his MSA Remote application, which was inexplicably blocked from the iTunes store – I think because whoever would have understood the app was on a lunch break or something. See, previously:

MSA Remote for iPhone

Apple Rejects Free iPhone Tool For Artists Because of “Minimal User Functionality”

But as it happens, this is something any mobile device can do that has an accelerometer. I may try something like this on the Android app I’m developing. (No one can reject that, because Google allows any application package to be installed on the device should the user chose to do so. Perish the thought.) Accelerometer data alone is usually not very useful, but combined with touch, it could start to make more sense.

It’s another reason to look forward to MSA Remote, and I do still think that the snafu with Apple will get cleared up at some point. (Unfortunately, what we had on CDM were a lot of rants – perhaps even justified rants – but not necessarily the best way to make the argument to Apple’s store.)

Sound is a wonderful, if invisible thing. To work with these tiny fluctuations in air pressure that make up what we hear, we always work with some sort of software metaphor. So why not make that metaphor pixels – and why not manipulate the visual element directly?

Translating between sound and image is not a new concept in music software. The deepest tool for these functions is unquestionably the Mac-only classic MetaSynth, which sprang from the imagination of Bryce creator and graphic designer Eric Wenger. To me, one of the most appealing features of MetaSynth has always been its filter tool, the one component that allows you to work directly with sound using imagery and painting tools. The core of the tool, however, turns images into a score for synthesis, which opens up powerful features for microtones and the like but can conversely make simply designing sounds more challenging. (Side note: Leopard users, read this re: MetaSynth.)

Photosounder looks like MetaSynth, but it more directly translates between sound and image. It also has a uniquely straightforward interface for precisely adjusting controls and mappings. Put these together, and you can really use Photosounder as an audio tool. That opens up not only experimental techniques, but even makes conventional tasks more accessible.

Photosounder is also under very active development, with recent additions like a lossless mode for better sound fidelity and loop modes. The result is a really compelling looking tool for audio manipulation.

What can you do with these pixel powers over sound? Users have been experimenting and posting some pretty impressive stuff:

• Isolating and removing individual instruments – making this an ideal remixing and sampling tool – using Photoshop
• Making entire tracks from photographs (which, again, was possible with MetaSynth as infamously employed by Aphex Twin, but sounds very different here)
• Processing using Photoshop filters
• Making beats by drawing
• Extreme time processing

Photosounder is currently Windows-only, but Linux and Mac versions are promised. (By the way, I think that’s going to become more commonplace as savvy developers take up cross-platform development tools, toolchains, and frameworks.)

It’s cheap enough to impulse-buy, too, at EUR25 non-commercial or EUR99 commercial.

http://photosounder.com/

Photosounder examples (with video)

I hope to get my hands on Photosounder and show off some features with this soon. Thanks to everyone who sent this in! (And yeah, after four or five people I finally get around to mentioning it!)

The best way to see what’s possible: check out the videos. Here’s a selection of my favorites:

Imagine friendly creation of custom synths and sounds by dragging visual nodes. Now imagine you can do that on a mobile device and your computer – and eventually combine the two. That’s the vision of Jasuto, and while it’s not quite there yet, it’s incredibly promising.

The laws of combinatorics predict that, on a regular basis, you’ll see countless soft synths that are slight variations of one another. With the iPhone/iPod touch gold rush in full swing, we’re starting to see the pattern repeat itself, just as it did in Windows and Mac plug-ins. Some are brilliant; others are just the usual variations on a theme.

Of course, even better is the ability to build exactly what you want out of the same buildings blocks. Powerful toolkits like Max/MSP, Pd, Reaktor, SuperCollider, SynthMaker and the like let you do this, but they qualify as the more-sophisticated Erector Set of synthesis. Sometimes you just want some simple, LEGO-style building blocks that cover the basics.

That’s why Jasuto looks so promising. It’s actually two pieces of software – a plug-in for Mac and Windows VST. Combine basic modules, and you get some powerful features, even on the iPhone:

• Multiple synthesis methods: additive, subtractive, FM/PM/AM, hard-sync synthesis
• Basic math functions: add/subtract/delta/constant values
• Filters: LP, HP, BP, and a Moog emulation
• Signal tools: envelopes, dynamics processors, and an envelope follower
• Effects: Delay, reverb, saturation, digital distortion
• iPhone hardware features: Accelerator and mic access (and of course mic access on your computer, too)
• 16-step sequencer with looping, pattern manipulation
• Performance options: a tappable keyboard, glide functions, and so on

That’s just the specs, though. To me, the most interesting thing is the zoomable, nodal design, reminiscent of the reactable. There’s also the ability to record “motion” anywhere in the app, and to modulate everything with everything else. And I especially like the idea that “patches” and “synths” are one and the same: just as on an early modular, creating a new “patch” really is about connecting modules into something unique.

I can’t imagine it being the last computer instrument you need, but if successful, it could well be the last iPhone synth you need. I like the idea of

It’s under “heavy development,” so expect some bugs. The software can be yours for all of US$1.00 on iPhone. The PC/Mac VST looks a little rougher, but it’s available for free download.

Jasuto Site

VST Plug-in

iTunes Link

Thanks to sublamp for turning us on to this via comments.

Switching tools isn’t a panacea, but it can inspire new ideas, by changing the way you structure your music. Elysium is a powerful new sequencer in development for the Mac the creates generative patterns on a beehive-shaped hexagonal grid. For the hardcore, you can even extend the tool with Ruby and JavaScript.

Elysium is a MIDI sequencer only: it has no sound generation facility of its own. But that makes it an ideal complement to your existing tools and favorite synths; the creator shows it off with Apple Logic Studio (Sculpture physical modeling, anyone?) and Native Instruments Kore.

Elysium [Mac-only public beta, PPC/Intel; 10.5 required]

Most sequencers work like a variation on a score: you compose events in time and it renders those events in precisely the same order each time. Elysium is generative: instead of creating a score, you create a system, and events are determined by the rules of the system. That means the exact deployment of events in time is variable, and things may not sound the same way – or over the same span of time – twice.

To do this, Elysium employs layers, cells, tokens, and callbacks. Huh?

• Layers are roughly equivalent to a track in a traditional sequencer; it’s a single grid of cells, each containing a note, transmitted on one MIDI channel. That means, most likely, you’ll use a different layer for each sound you want to generate in your synth or host.
• Cells are arrayed in a 17×12 honeycomb (a hexagonal grid), each transmitting one MIDI note. They’re organized in a harmonic table – the three adjacent hexagons around a single vertex, for instance, form a triad.
• Tokens are the things that actually do stuff – they’re what make Elysium generative and interactive. Functions currently include Start/Stop, Note (plays an actual note), Rebound (changes direction), Absorb, Split, and Spin (impact movement). Arrange these on the grid, and instead of playing left-to-right as a traditional sequencer would, playback will navigate the spaces on the grid – potentially in unusual and interesting ways. To edit tokens, Elysium uses floating inspector palettes for setting parameters.
• Callbacks give you the power to define your own musical behaviors by scripting them, making your musical world more variable. Elysium uses the same JavaScript interpreter as the Safari/WebKit browser, so you can code in JavaScript. Ruby lovers can even work in MacRuby. These code snippets don’t have to be complex: on the contrary, they’re quite simple and friendly to non-programmers, tantamount to saying “Hey, sequencer, I command you to do THIS!”

Side note: I love the idea of scripting engines. Back in the day, HyperCard’s HyperTalk had simple, scriptable events that even kids could learn. There’s some real potential there, as we’ve seen in Native Instruments’ Kontakt sampler. If you’re afraid of code, don’t be. Even if you do nothing but copy and paste some useful code borrowed from someone else, you can benefit from a scripting engine. Change one variable to suit your purposes – even one number in that code – and you’ve just become a programmer. (Ableton? Ableton Live scripting? Please?)

Anyway, the resulting sequencer navigates through musical materials interactively. Add some layers, and you can create something quite dynamic. If that sounds as though it could become monotonous, consider this: you could use Elysium to trigger a sampler as well as notes on a synth, and you could modulate a synth’s timbres while Elysium drives notes. There’s some serious potential.

Musical Applications

Elysium: Probabilistic Arp from giles goat boy on Vimeo.

Giles Bowkett has a fantastic hands-on feature where he couple Elysium with some hardware sound sources:

Driving Korg Hardware With Elysium [Giles Bowkett Blog]

He also makes note of the similarity to the wonderful-looking reactOgon interface, which took this concept to a tangible table. That means that the actions were actually physical objects placed on the grid that controlled movement – brilliant, though apparently no one knows what happened to the project. (Too bad. I can imagine people playing Warhammer and performing music at the same time.)

There’s a separate hands-on employing Ableton Live, by mmi.

If you want to try this yourself, visit the Elysium project site and be sure to try the:

Introductory screencast

Going Hexagonal

All of this brings us to the question of why hexagonal grids are so cool. It’s been on my mind lately as I just read a fantastic chapter in the book Game Programming Gems 7, a book that could easily be titled “A Collection of Really Cool Ideas from Game Programmers.” Check out the chapter “For Bees and Gamers: How to Handle Hexagonal Tiles.” Basically, the advantages of a hexagonal grid as opposed to our usual square one:

• It’s the most efficient regular tessellation – it has the highest packing density and uses the least perimeter, making for an elegant, organic pattern
• Adjacent tiles can be described as defining a vertex (a point) or a whole edge, and you still get the same number of tiles – six. On a grid of squares, there are only four squares that are adjacent based on side (the ones above, to the right, to the left, an below), but eight squares sharing a vertex (the ones on the diagonal). That makes navigation through the grid somewhat confusing – though it does enable the games of chess and checkers.
• The distance from one tile to an adjacent tile is the same, whichever direction you go.

This comes up in game design because hexagonal grids work well for mapping movements of … well, little dudes fighting in strategy games. The advantage is the inverse of what you get in checkers and chess: you can define one kind of movement from a tile to an adjacent tile.

You can perhaps already see what this means for music. It means hex grids are efficient, they allow unambiguous movement to adjacent tiles, and they form neat little triads and dyads that can make sense harmonically when we’re talking pitch.

At the same time, these seem advantages pose some challenges. The hex grid is so regular, it’s a little hard to look at. There’s a reason pianos use keys of different sizes and colors. It would be possible to use clever coloring schemes to help with this, though the shape would remain regular (and thus a little hard to look at). Elysium does have a color scheme applied, but it certainly requires some adjustment; perhaps the ability to shift on-the-fly to see pitch relationships could help.

I do also wonder if there aren’t ways of using these kinds of grids aside from just putting a note on each tile. Elysium does have more going on, but you can’t see it. It’s all hidden behind the tiles in scripts and slightly hard-to-recognize icons. It’d be great to see more visual representation of movement and interaction. This app is new, so perhaps there’s still time.

That said, I think the capabilities here are already amazing. I was a skeptics of hexagonal grids when I first saw them, feeling as though I’d just been dropped on an alien starship. (Greetings, fellow Cardassians!) But there is something behind the geometries we use. And I have no doubt that a lot of future experimentation with sequencers will involve more than just grids that read, as piano rolls and notation once did, in linear fashion from left to right.

Related

Giles Bowkett also investigates the Erratic probabilistic VST drum machine for Windows, which he says is better suited to drum parts than Elysium is. (Erratic is the plug-in’s name – not that I haven’t occasionally encountered an erratic plug-in.)

Nodal, like Elysium, is Mac only, free, and uses a graphical interface to create interactive rules. Interestingly, it uses square grids to Elysium’s hex grid and provides schematic-like flow diagrams of movement. Each approach, I think, has some advantages and tradeoffs.

Kodu by Microsoft Research uses interactive rules for game design, not music, but I can see the interface working well for musical applications, too. What really makes it work is that you have immediate visual feedback as to what you’ve created, which makes the kid doing the driving very pleased, indeed.

Intermorphic’s own generative suite draws upon a lineage that includes Eno’s landmark Ambient Music I. It’s far less graphical,but can be used to create sophisticated systems, interfaces with mobile devices, and provides deployment options (so other people can hear your generative work and not just a recorded take).

And be sure to check out the generative tag on CDM.

For a hardware device using this scheme (and with a nice solution to the color / mapping challenges), check out the C-THRU Axis.

The AXiS-64 pro MIDI controller [Product Page @ C-THRU MUSIC]

Zillion-Keyed Keyboards, New Musical Layouts, and Microtonal Gadgets [CDM, on NAMM 07]

(thanks, MattH, for the reminder to get this bit in, too!)

Better support for music and audio is still evolving (as well as lots of stability and compatibility improvements), but I have faith open-source coding tool Processing [site | on cdmu | on cdmo ] could yield wonderful new visual interfaces for music. Daniel Piker has the latest addition, inspired by a recent post here:

FizzyNumberMusicMaker at Open Processing, a site for sharing Processing sketches – warning, makes sound immediately!

Built on the Game of Life ideas from our friend wesen (of ruin & wesen), this project uses colored cells to trigger elaborate washes of piano sound. He writes:

If the cell’s state is not just simply on or off, but a number in a range then you get all sorts of interesting musical runs and trills. You can also clearly see the connection between the colours and the sound.

The headline sums up the experience of using it. Ah, I remember countless hours spent with a desktop Yamaha GM unit and my old Roland Sound Canvas SC-55. But even if the sound of a thousand attacking General MIDI pianos makes you hide under your desk, you ought to be able to see how a simple interface can yield lots of different results. I can’t wait to see what’s next. Previously:

Build Your Own Game of Life Sequencer in Processing: Video Featuring rwmidi

Since then, I’ve gotten to hang out with wesen in Berlin. Basically, rwmidi has a little ways to go. The biggest issue is how to schedule events. Processing is set up to base timing on framerate, which doesn’t work all that well for music applications, which require greater accuracy. There’s also the tantalizing possibility of figuring out a way to slave Processing sketches to MIDI clock – so you could have Ableton Live running, then pull up a Processing sketch, for instance. wesen is working on those problems, but if you’ve seen good solutions outside the (somewhat limited) Java APIs, let us know.