(If you don’t know what he’s talking about, see here.)
Yes, in case you’re looking for a creative way to practice your Theremin playing, here you go. Now, where’s our Theremin Hero game? From the description by Glasgow-based YouTuber conquerearth, previously seen using the Theremin to play “Still Alive.”
This is even more fun with two people playing! One person controls left/right, the other controls jump.
Its not just limited to the theremin. Its even possible to hook up a microphone and use your voice to control the game! Or a guitar! Or a violin!
Heres how it works:
The sound from the theremin is split into its frequency and amplitude components in real time, which are then mapped to values in a linear scale representing the X and Y axis. Pitch becomes horizontal control, and Volume becomes vertical control.
The X and Y scales are then cut up into different zones. In this case, Left; Right and dead zones for the horizontal, and a single trigger and dead zone for the vertical.
The trigger zones are then mapped onto a virtual joystick hooked into an emulator.
The end result is a fairly usable input control for playing games like mario. The bars give the much needed visual feedback as to how “in tune” you are, so you have a better feel of where the trigger points are.
I’m sure there’s a deeper meaning I could extract about gestural controllers, expressive musical instruments, and the meaning of life, but it’s Friday and it’s lunch break time. If you can do my job, feel free – add in comments. (If your cat walks across your keyboard, it’ll still probably come across as more intelligent than an average YouTube comment, so have at it!)
Speaking of games, you can expect game production to start to attract the attention of musicians and web publishers. Whereas a few short years ago, targeting musicians might mean dangling rock club gigs or album sales, now a lot of those same music makers want to break into gaming, too.
Kongregate is a bit like public access, only on steroids and for games. The idea is this: get indie game makers in one place contributing games, then get lots of people playing those games, then support the system with ad revenue shared with the game makers. The model has grown rapidly, with millions of users and over 15,000 original games.
The newest project from Kongregate looks to connect artistic talent on projects, including musicians, composers, and sound designers wanting to work on game projects. The Collabs section will see artists and sound and music creators uploading their work to find collaborators. Initially, there’s a contest on, with competition for attention, cash, and studio prizes.
The competition aside, this could be the beginning of a successful community for collaboration in the indie Flash gaming world. Assets are often uploaded under a Creative Commons license, and I see one of the top sounds draws on samples from Freesound.org. While career success is an obvious goal, the contributors so far appear to see sharing as a way to get there – in stark contrast to the model in the mainstream, big-business game industry. Quality is, of course, variable, but ask anyone in the game industry how to become successful and the answer is always make as much as you can. Getting work out there, even primitive, can be part of a learning process. So I’m eager to see what transpires as these kinds of communities grow.
There is an invariable comparison to Deviant Art – and you’ll see they’ve already begun to invade.
Oh yeah, and I quite like these glassy tendrils, rendered in Cinema 4D. Image (CC) Chaodeath. Now, make that run real-time. Or, erm, imagine those are virtual renderings of artists … collaborating.
Wired has a great mini-documentary on the score for the videogame Infamous. It’s chock full of sound design ear candy, not only served by the chops of composer Amon Tobin but the team at Sony Music and Sony’s entertainment division, as well. Curiously, Jonathan Mayer, Music Manager at SCEA, says explicitly that he doesn’t want composers writing interactive music. He’d prefer to have them write a conventional score and then adapt it to the interactive engine. Now, of course, around these parts we like the idea of composers finding ways to write genuinely generative and interactive scores. But in this case, Mayer is acting as a kind of remix artist for the game realm, sampling Tobin’s compositions and reconceiving them in the game world. That kind of collaboration could be powerful.
Chuck Doug, SCEA music director, overstates things a bit by claiming this game has a unique aesthetic. The visuals are a burnt-out, post apocalyptic city – yeah, been there quite a few times. The music involves lots of ethnic percussion-y instruments and bowed metal and deep booming sounds. (Let me get this straight: we’ll hear a plucky stringy thing, then a bowedy metally thing, then there will be a big boom!) So, generally, not some radical new departure from game and motion soundtracks. But regardless of its novelty, I’d be an utter killjoy to complain: it sounds utterly gorgeous.
Previously:
I got to listen in on a lot of gems regarding sound design from composer Troels Folmann. He doesn’t just bow metal instruments – he boils them.
You’ve heard the chip hype. But there’s something behind it: vintage digital chips can make wonderful sounds. And I’m thrilled that someone has painstakingly reproduced those sounds in an upcoming package.
Emulating analog circuitry, from amps to classic synths, has been long understood. But we’ve finally reached an age when people begin to appreciate the odd idiosyncrasies of digital technology, too. There hasn’t ever been a comprehensive attempt to emulate each detail of a range of 80s sound chips before – until now. Plogue (makers of the highly underrated Plogue Bidule patching environment) and David Viens have tackled just that as a labor of love, and you’ll be able to use the resulting “chipsounds” library later this spring.
Plogue’s chipsounds recreates the blippy personality of the Commodore 64, the Nintendo NES, the Game Boy, the Atari, the Vic20 – and circuit-bent and abused variations, too. It’s got a powerful artist endorsement from 8 Bit Weapon and Computer Her (pictured here). There are arpeggiators, noise patterns, distortion emulation, custom software, all built on the ARIA synth/sampling engine.
The basic specs:
7 chips: TIA, 2A03 PAPU, VIC-I, SN76589AN, AY-3-8910, POKEY, and SID. Haven’t heard of all of those? No worries. But you’ve probably heard the chips. The horribly-named SN76589AN was used in my very first computer, the IBM PCjr, my first game console, the Colecovision (boy did I pick them), and in the TI. The 2A03 is from the original NES. The TIA was in the Atari.
Tricks, built in: One-shot arpeggiators, rapid waveform changes, envelope resync tricks are all built in – stuff that’s hard to pull off, as the creators note.
Emulations of psuedo noise patterns, distortion
Switch on each chip’s limited resolution and pitch values – or switch them off, and create sounds the PCjr couldn’t
Presets from 8 bit Weapon and ComputeHer
8 bit Weapon’s wespons: a VIC-20 (well, the box), a C128 (foreground), a C64 (top left), the Woz-designed Apple IIe (aka your entire childhood computer class for many of us), and … a GameCube.
The step sequencer. The sixteen-pad drum machine. The piano roll. The step sequencing piano roll. The waveform editor. The multi-track recording. Live music is a dynamic and changing phenomenon, but much of our technology assumes fairly predictable interfaces with time. Elysium, which we saw early this week, breaks out of that mold by defining generative systems that live on a hexagonal grid or “honeycomb.” There’s lots of great reader feedback on that story, and Elysium’s creator wrote in to talk a bit about what influenced him.
I want to highlight two sequencers that you play as if they’re games. (Just don’t play a Vulcan – they always win.)
Robots on a Grid
Al-Jazari is named for a 13th-Century scholar and musician who apparently invented an entire band of water-powered hydraulic robotic musicians with more than fifty facial and body movements per song. (Okay, that clearly deserves a separate post later. So, our Western education is so eager to avoid the achievements of Arabs that we skipped over the fact that he basically invented Disneyland in the Middle Ages.)
Al-Jazari in the 21st Century iteration takes the idea of robotic agents and builds a sequencer around them. Creator Dave built a grid on which you can give the robots symbolic instructions (like up, right, down, left), selected from a gamepad. Each grid square represents a note, with pitch modulated by moving bricks up and down. Like Elysium, the music is generated as events are triggered on the grid. And like Microsoft Research’s (non-musical) game Kodu, the gamepad and a set of symbols make what is essentially scripting easy and transparent. (Few would likely call this “programming” because it doesn’t look scary, but that’s what it actually is.)
Al-Jazari is open source, built in the elegant coding language Scheme (a Lisp dialect) atop a game engine called Fluxus. Dave has extensive documentation on its development, and not only the code but even the textures and models. You can use this yourself on Mac and Linux, but it’ll require some messy compiling. (Thanks for this link, MattH – this is layered with things that blow my mind!)
Mark Burton’s reacTogon was the influence for Elysium. It’s a “chain reactive performance arpeggiator” – that is, it takes the usual, static, repeating patterns of an arpeggiator and turns them into something altogether different, by allowing events to transform dynamically in two dimensions across a hexagonal grid. The interface is a multi-touch controller with physical objects, so there’s a tangible element, as well.
Looking at reacTogon alongside Al-Jazari really demonstrates some of the advantages of a hexagonal grid versus the more traditional square grid. (And if you think about most musical applications, most of what we have is relatively non-dynamic right-angle grids. There’s movement, but only left to right, with start/stop or loop points. One exception: Follow Actions in Ableton Live.)
Al-Jazari requires movement only to tiles with adjacent edges. reacTogon, since it tiles hexagons, has six adjacent tiles instead of four. It can also map a harmonic table, as other musical hexagonal grids do. Now, that’s not to say reacTogon is better than the other – on the contrary, it demonstrates that just one choice – a grid of squares or a grid of hexagons – can create very different musical possibilities. So even if you’re not musically impressed by these examples just yet, think about the possibilities here. We’re still early in software design and musical interface, so early that something as simple as a simple geometric pattern can become an entire composition.
That’s something to ponder on the eve of the music manufacturers’ trade show.
(If anyone has more documentation on Mark or his creation, let me know.)
2
