Designing Sound, as the name implies, focuses entirely on the craft of audio from film to games. While there are industry-driven sites devoted to the topic, this blog is entirely the labor of love of composer and sound designer Miguel Isaza, whose writing has also appeared on Spain’s Hispasonic and Monofónicos. (Miguel also tweets to Reaktor aficionados as reaktorlovers.) That personal perspective has imbued the site with the feeling of artists talking to artists.

http://designingsound.noisepages.com/

All week, Designing Sound has focused on Rob Bridgett, who has worked on numerous sound designs for games. Despite the massive growth of the game industry, most top artists have worked largely in obscurity – even less so in sound. There isn’t an equivalent of Ben Burtt, Randy Thom, Walter Murch, or others. (Those greats have been featured in Designing Sound specials, too.) Gaming is a young industry, to be sure, but that’s no excuse for simple ignorance.

In this week’s interviews with Isaza, Bridgett talks frankly about every last detail of what goes into sound production. He’s frank not only about what can go right in a game production – Scarface, pictured above, gets special treatment – but also what can go wrong. The brutal deadlines, fluid production parameters, and tangled production process of games can exact a toll on sound in gaming. The high point of this: Bridgett has gotten to employ the full resources of Skywalker Sound and has been at the forefront of bringing Hollywood-style sonic treatment to gaming.

I’m sure many readers here are curious about the games industry. There’s still time to forward your own questions to Miguel to pass along to Rob Bridgett.

Exclusive interview

Rob Bridgett Special

Ask your own questions

Incidentally, this is beyond what we even imagined for our fledgling noisepages.com, which we’re readying for a full launch as a community and blogging platform. Miguel created Designing Sound without prompting or assistance – it’s entirely his vision. It’s great to have people sharing information in this way. I can’t wait to see what’s ahead.

Musicians and artists now have the power to fuse visuals, sound, and interaction, to make a spectacle, an album, and a game all at once. But with the blank canvas of three different media before you, what form should that fusion take?

Space shooters with pounding electronic beats behind them have cleared some of the way. Now it’s ambient music’s turn. In the game Osmos, you become a mysterious particle, floating amongst gravity wells in various fields of material. By carefully navigating, applying just the right vector force to move through the shifting landscape, you merge with other particles and escape to safety.

http://www.hemispheregames.com/osmos/

The move from “shoot stuff” to “move” or “eat” seems to be rising in popularity, with games like fl0w and Spore’s initial “cell stage” encouraging nonviolent navigation. To me, there’s something happening to the zeitgeist, perhaps a renewed awareness of cosmic (micro- or macroscopic) being, and of movement that draws on free-floating physics.

Even amongst a wave of games in this mode,when you actually play Osmos, you realize that it is something different and special. The design makes ingenious use of different kinds of movement and pacing through its different modes, at one point calling upon you to hurtle around a black hole, then move at nearly imperceptible speeds through a seemingly impossible-to-traverse petri dish of massive particles. No less than a shooter, it connects to the id and survival instinct. Pac-Man, the most successful arcarde game of all time, and one of the few that sucked in men and women in equal measure, was noted for its emphasis on eating as the mechanic. Consuming stuff appeals to everyone.

Of course, this is on a music site, and with good reason: what makes Osmos work is that Osmos is musical. It’s immediately beautiful and delicate, a perfect aesthetic union of the texture of the music and the on-screen arrangements of particles. More importantly, the music is woven directly into game play, providing subtle cues for dangers, and underscoring the pace of gameplay. You can only solve a level by managing speed and motion, and the music helps provide both the literal indications of speed and help your head get into the right zone to lose yourself in the world. If blips in early arcade games helped create a zone of play trance, now we have spectacular ambient soundtrack of music by Loscil, Gas/High Skies [Microscopics], Julien Neto, and Biosphere.

The music isn’t simply a beautiful soundtrack to the game. The game really feels like an extension of the world of the music. Put it all together, and something magical happens in this $10 game: you hear the music in a new way.

I spoke to the lead designer behind the game, programmer/animator Eddy Boxerman, along with musical-sonic collaborator Mat Jarvis aka Gas aka High Skies.

Peter: I found it amusing that some of the game press have stumbled around looking for a name for a new genre here, the "eat other stuff" category. To me, the basic game controls could be traced back to early titles like Asteroids. What are the games that have inspired you, either specifically or generally?

Eddy: Some people are dubbing the gameplay type as "eat ‘em up", as opposed to the classic "shoot ‘em up". But it’s true, the physics/controls have more in common with classic games such as Asteroids and Gravitar. The only "modern" game that otherwise influenced me was Katamari Damacy. It’s funny: when I sent out the first prototype to friends, I was concerned they would think the game was too similar to Katamari. That’s when I heard about flOw, which I’ve tried to steer stylistically clear of ever since. I guess it’s an archetype though, and the comparisons have been inevitable. As for Spore, Osmos was about one year into development when I saw the first preview footage of its "cell stage". On top of that, I learned that Will Wright had hired Brian Eno to do the music! I definitely had a "why should I bother?" moment at that point. But here we are, a couple years later, and I think we’ve managed to put out a unique game with a great mix of gameplay, sound, and visuals.

Peter: Ha – well, I’m glad you “bothered”! One thing that I think is really unique about Osmos is the gravitational mechanic. How did this come about?

Eddy: I was (and probably still am) a sci-fi kid. And when I read about real phenomena like colliding galaxies, retrograde planets, and the like, my mind goes to stange and wonderful places. That said, the Spacecraft Dynamics course I took during my engineering degree definitely played a large part in putting those mechanics and levels together. Thanks, Professor Misra! :)

Peter: How are the physical mechanics of the game constructed? This is essentially two-dimensional vector math, yes? Were there refinements you needed to make in order to keep performance up, or to keep the levels playable?

Eddy: That’s a big question! But yes, essentially it’s 2D vector math, though we make use of some 3D math (including quaternions) on the particle systems. The majority of the physics is quite simple though — first year bachelor’s stuff: F = ma, conservation of mass and momentum, gravitational laws, basic time integration, etc. We follow the spirit of the laws, but not always the letter. For instance, if you look at the Earth’s solar system in its entirety, you wouldn’t even see most of the planets; that doesn’t make for a very playable game though. As such, we took many liberties when it comes to scale, constants and exponents in the equations. The majority of the work was in the tweaking of those values to make the game /feel /good.

Peter: How did you prototype the game? What was the process of evolution like? Were there any failed attempts along the way?

Eddy: I put together the first prototype starting from a NeHe OpenGL tutorial. I added some basic physics, mouse controls, some highly unoptimised collision detection code, and voila, I had something to play with. After that, I immediately integrated [cross-platform 3D audio API] OpenAL, as the game was just begging for sound and music. I then hunted for some good sounds (discovering freesound.org in the process), put together a simple looping song (my first rough and humbling attempt to create digital music), and sent it out to a few friends. I’ll make that version available for free someday… when I’m feeling brave.

As for failed attempts, there were tons of shelved experiments and features that were cut. One interesting problem was the difficulty curve of the gravitational levels. In fact, the first gravity levels looked a great deal like the "Warped Chaos" levels do today: several free-floating Attractors in a sea of regular motes. I found it incredibly difficult, however, to make a "beginner" version of those levels. If the gravity was too weak, the Attractors had little apparent effect; too strong, and the level became incredibly difficult. I stuggled with this for a long time, until I hit on the idea of putting one, immobile Attractor in the center, with everything else orbiting around it. This allowed for the creation of systems with strong gravity effects, but long-term stability. It seems so obvious now, especially given the example of our solar system, but it wasn’t back then. In the end, these are some of the coolest levels in Osmos — practically its "signature" level type. Moral of the story: necessity really is the mother of invention.

Peter: What is the visual engine like? The sound engine?

Eddy: As I mentioned, I bootstrapped from a NeHe tutorial, but that’s all been replaced at this point. It’s now a homegrown engine using OpenGL. It doesn’t make any use of pixel/vertex shaders, so it runs on a wide variety of hardware. The majority of our texture work is done in Photoshop.

[The sound engine is] a wrapper we’ve built around OpenAL. At a basic level, all we ever do is mix and adjust the gain and pitch of our sounds and music. This allows us to run on generic sound hardware. But we do make extensive use of those "effects", and it’s possible to get a great deal of variety and feedback with them. In the end, it’s all about the quality of our sound sources, and the algorithms that adjust and smooth the gain and pitch of each.

Peter: For pitch shifting, were you able to do that natively in OpenAL?

Eddy: Yes, OpenAL supports pitch shifting at the software level. I ported our sound engine to use DirectSound at one point, and found that it’s pitch shift range is rather limited. We reverted back to OpenAL.

Peter: One thing that really strikes me about the game that is its use of pacing. Even without the obvious technique of allowing the user to control speed, there’s this extraordinary contrast between levels that require you to move quickly, that require you to anticipate the rate of movement along a vector of other objects, or that require you to move almost imperceptibly slowly. Was this an early goal, or something that evolved out of developing the game concepts?

Eddy: It evolved from the game concepts themselves. We tried to fully explore the fundamental controls and game space of Osmos, and converged on a number of interesting regions and structures that were fun to play with/in. Some people actually "complain" that the pacing of the game isn’t consistent across levels — some are fast, some slow — but that wasn’t our goal. In a sense, we’re merely presenting the results of a great deal of research and exploration into the space, with our sole requirement being that the levels are fun and interesting. We wanted it to be a game of concepts and understanding, not speed. The addition of time-warping allowed us to break free from that, expand our scope, and include a much larger variety of levels, as some have both fast and slow moments in them; we wanted the player to be able to control the pace and difficulty to their level of comfort.

Peter: Connecting the action to music, how important is the use of music in conveying time?

Eddy: I think pitch-shifting the music and sound effects helps players track time-warping in an inutitive way. Without these aural cues, the mental connection would be incomplete. That said, I sometimes test the game without sound, and it’s totally playable — just much less immersive.

Peter: At what stage did you involve the musical element? How was that relationship established?

Mat: Eddy first contacted me two or three years ago about using one of my tracks on Osmos (“Gas – Discovery”). He sent me a basic alpha version where the game was literally flat circles on a plain background, but even back then with the simple graphics and no sound it was compelling. I think it was at this early stage that I sent him a copy of another High Skies track, “The Shape of Things to Come,” which he also used a section from. It wasn’t too long later that he sent me a version of Osmos with most of the music that made it to the release version and it all just complimented each other beautifully.

Eddy has done a great job choosing music that compliments the game and graphics, and they also compliment the music. I think he’s done a great job overall as well, keeping his vision consistent for the look and feel of the Osmos world. Even though some of the levels are quite varied; some are quite chilled, others fast paced, nothing seems out of place. He has created a new world that’s both microscopic and macroscopic.

Peter: The musical and sound effect elements really do blend effortlessly. Mat, I know you made substitute sounds – how did this help blend the aesthetic?

Mat: I made the rebound noise when you bounce off the walls/ boundary. The original sound was quite hard and metallic with a lot of reverb, and I suggested a softer echoey sound. There was nothing wrong with the original, but it made the boundary feel quite hard and cold like being in a metal tank. I sent Eddy some analogue samples, using a [vintage Roland keyboard] Jupiter 6 with varying delays/ echoes. Because the tones are so pure and tuned, Eddy pitched them slightly to fit with the various keys of the different music.

Eddy: In general, it was a matter of searching and experimentation for the "right" set of sounds that fit well together — which can be a lengthy but rewarding process. Once integrated, minor gain and pitch adjustments helped fit it all together.

Mat provided the bounce sound, as well as the continuous absorb/being-absorbed sounds. The other sounds were created/shared on freesound by the users Elektrocell, fran_ky and Jovica. (Check out the Osmos credits in the readme.html for details.)

Peter: I recently spoke to Crystal Method, and while they’ve done some notable game scores, they actually said they wouldn’t want their music to be placed in a game context at which the speed changed, that it’d lose something. This seems like the opposite of that. Now, maybe it’s easy to take for granted with ambient music as opposed to something beat-driven like Crystal Method, but do you think there’s something special that allows this music to be adaptive in that way?

Mat: I think that in the right circumstances music with drums could work well and may even highlight the time-shifting more. Of course with the wrong game and wrong music it could sound terrible too.

Eddy: It’s a delicate issue. Out of the context of the game, I think it would seem wrong. There were also some pieces of music I tried which didn’t lend themselves well to this kind of manipulation, and which didn’t get included as a result. But with these songs, and everything working together in-game, I feel the whole experience is stronger as a result. I’m just glad Mat and the other artists agreed — or at least… didn’t object. ;-)

Peter: Hey, I think if you can write music that sounds good played at a different speed, that’s nice.

Osmos seems to me a musical experience, in that the sense of the music is transformed by the visuals and the interaction with them. Do you think it’s possible that audiovisual interfaces could go even further in terms of their impact on the music?

Mat: Yes, it almost seems as though Osmos creates a world for the music to exist.

I’ve always liked music visualisers like the Processing and Cymatics stuff, they’re quite compelling to watch how they react to the music, so it would be interesting to go the other way; by manipulating/ sculpting abstract shapes which then modify or even create sounds and music, especially using the new controllers like the Wii, [Microsoft’s] Project Natal and Sony’s Motion Controller instead of the mouse.

Eddy: I totally agree with Mat. Yes, please! More feedback between music, visuals and interactivity — in all directions. I’d love to experiment more on all of these fronts. In general, I think games such as Audiosurf and Auditorium, while great, have only begun to scratch the surface of what’s possible. Interactive musical "toys" such as [Nintendo/Toshio Iwai’s ]ElectroPlankton or Dub Selector are another great direction; and Rock Band Network is about to expand the market in a huge way. It’s exciting!

Peter: Along those lines, this is obviously a new take on music distribution in a way that goes well beyond what titles like Rock Band have done. Are there other cases in game history that to you have done that? Is there potential in these new outlets, outlets that are more accessible to independent developers (Steam, Direct2Drive, Xbox Live Arcade, iTunes App Store), to really change game development?

Eddy: Wow, that’s another big question. Really, I just felt the music was such an important part of the experience in Osmos that we should show the artist and track names during the game. But now that you mention it, I can’t think of another game that has done this, besides games like Rock Band where the song /is/ the game/level. That said, one way I’d love to push this evolution is to "augment" music videos with interactivity: ie. into music video-games. (The term "game" could be used rather loosely here.) Everyday Shooter does this, though Jon Mak actually created the music /for/ the game in that case — which rocks — but collaborations could lead to some really amazing things in this direction.

Peter: Eddy, Mat, thank you. Whether it’s in the form of a game or an audiovisual performance, we’ll certainly continue to explore these areas. And – hint, hint – Osmos 2, with multiplayer? Just a thought.

Osmos Trailer from hemisphere games on Vimeo.

As you may know, the creators of games like Grand Theft Auto have collaborated with Timbaland to bring a mobile music studio to Sony’s PSP (and later, the iPhone), based on an ambitious free Flash experiment on their Website. Now, it’s my impassioned belief that you shouldn’t need lots of canned loops or celebrity endorsements to make music fun, so normally I might actually run the opposite direction of any story starting with that line. But here’s the surprise: underneath, the app is more powerful than I expected.

I’ve gotten an early preview of the title in person at Rockstar’s offices here in New York, and was also able to grill their developers on geeky details of how the sound engine is put together. A test copy isn’t yet available so I can’t properly review the app, but I am at least able to talk about some of what lies beneath the PSP screens and marketing.

For some time, a select few have known that the Sony PSP’s secret is that it’s a powerful handheld computer, ideal for mobile music. Brilliant-but-underground apps like PSPSEQ and PSP Rhythm capitalized on this potential, but required you hack your PSP in order to run them, because Sony restricts launching non-authorized applications from memory.

Beaterator is the first full-featured app that can be run directly on the PSP. Some people may not look past the fact that it comes from a game company, past its (admittedly) thick layer of marketing glitz and celebrity endorsement. But based on a first look, I believe Beaterator is the most powerful music app ever released through game channels, surpassing in functionality even the recent cult hit Korg DS-10 for the Nintendo DS.

In the interest of disclosure, I have a confession: I didn’t expect to have any interest in Beaterator at all. I was concerned that the musical experience would be watered down (though more on what I actually discovered below). The fact that this game had one artist – Timbaland – literally dancing around the screen talking about how it’s his game I thought would be a deal killer. And, of course, it’ll be impossible to talk about this game without the shadow of the “Acidjazzed Evening” controversy, which aleges Timbaland plagiarized music by Finnish composer Janne Suni – made worse by a lawsuit and a glib interview in which the artist responded, “It’s from a video game, idiot.” Timbaland is by no means the first artist to get into trouble with an uncleared sample, but the fact that it was a much lesser-known artist and that the situation was handled less than gracefully certainly created a credibility issue in the enthusiast community.

I bring those issues up front, because I know readers will bring them up. But what intrigues me about Beaterator is that it has an essentially split personality. At one moment, Beaterator is an animated Timbaland talking to you while you trigger canned loops with game buttons, neither game nor, really, a music creation app. At another moment, though, it’s a full-blown music sequencer you can carry around on your PSP, with some retro design and sound features that might actually make it appealing. And I think it’d be unfair to cover one side without the other.

The marketing for Beaterator focuses on the thousands of loops assembled by Timbaland and Rockstar. But Beaterator isn’t limited to those loops. What you likely won’t see emphasized in the gaming press:

• Sampling: You can make your own samples using the mic (or, if you can find it, you can add a PSP microphone)
• Audio import: You can import WAV files from a computer, as easily as dropping them onto a MemoryStick.
• Audio export: You can save your work as an audio file. Rockstar will have its own site for exchanging your music with other users, but that will be limited to the built-in effects (I’m guessing so they don’t have to police piracy). But that won’t stop you from exporting audio on your MemoryStick and using it however you like.
• MIDI import and export: While even many serious iPhone games lack this functionality, you can use Beaterator as a mobile MIDI editing workstation.
• Grown-up interface and effects: Beaterator has real audio effects, with real labels. The Compressor has labels like Gain and Ratio, instead of, you know, “Phatness” or “AMPMEUP.” It’s a clue that this really is a tool and not a game.
• It’s-a-me … not! Game cartoon character heads never appear in the interface – though I do have to admit, those Mario Paint Mario noteheads were cute. (For the PSP, might I suggest semidemiquavers with the face of Kratos?)

I love my desktop sequencers, but having these kinds of features in a comfortable-to-hold mobile device you take anywhere, being able to fly through settings with the PSP buttons, and lots of little details added by the Rockstar developers like confining pattern editing to scales and keys make Beaterator look like something that’ll be fun to use. After a couple of minutes, I was ready to charge up my PSP and fire up Beaterator alongside PSPSEQ.

Inside Beaterator’s Engine

Beaterator began several years ago on Rockstar’s website. Before making full-blown music production tools with Flash was popular, before the idea of “cloud editing” had become a buzzword, a side project at Rockstar yielded a free Flash game, which you can still play. The interface is loop-based and reminiscent of tools like ACID, GarageBand, and Fruity Loops. But it’s surprisingly minimal, capable of full-blown pattern and loop editing, includes real-time effects, and comes with a selection of loops from some of my all-time favorite producers – A.VEE & 3D, Juan Atkins, King Britt, Matthew Dear, and Steinski. Side note: please, Rockstar, can we have a custom version of Beaterator with those producers?

http://beaterator.rockstargames.com/beaterator.html

Having talked to mobile developers both big and indie, I was curious about the technical details of Beaterator’s implementation – especially after being impressed in a short demo by capabilities that went beyond what I had expected. Rockstar replied with some very particular details from the developers. I think the answers say a lot about what’s possible on the PSP – even with that iPhone version in the works – and how a handheld sequencer on mobile hardware can be put together.

PK: So, I see eight tracks, some effects – what are the capabilities of the underlying audio engine in Beaterator?

Rockstar: Our engine runs at 16-bit stereo, 22.05kHz throughout. As you say, there are 8 tracks, each of which each can have up to two insert effects* summed into a stereo mix. Each track also has a stereo pre-fader Send to a dedicated reverb buss which runs a global reverb unit which is also added into the output. The channel level, pans, aux send and all effects parameters can be automated to 1-bar resolution, as can the final mix output level, pan, and the global reverb parameters. At any given time, each of the 8 tracks can be playing either a sample-based Melody/Drum loop (with 8 channel polyphony), a monophonic synth melody loop, or a mono/stereo timestretched audio loop.

Our sequencer also supports 8 channels, at 4ppqn. The maximum song length is 240 bars, and we are fixed to 4/4 time. BPM ranges from 60-300, and there is a simple 16th-note swing control as well.

The insert effects we support are: Compressor, Chorus, Delay, Distortion, 3-band EQ, Multimode Resonant Filter, Flanger, Noise Gate, Phaser & Tremolo.

A lot of the editing (aside from vocals, really) appears to be in MIDI pattern editing. Is this always triggering a sampled instrument, or is there live synthesis / DSP going on under the hood at all? (I know the PSP is capable of such things.) Do you have any control over the timbre of the instruments, or just the musical patterns?

We trigger either our pitched sample playback code or our own DSP synthesiser on a channel. The sample playback code is a fairly simple 8-voice (which means a theoretical maximum polyphony of 64 if you are playing 8 samples on each of the 8 channels) pitchshifter (no multisampling), with no real control of timbre (no filters). But it does support velocity sensitivity (although this has to be sequenced as the PSP buttons aren’t velocity sensitive) and a full ADSR amplitude envelope.

The inbuilt synth is monophonic (but you can run one per channel, so up to 8 in theory). It’s a simple 3-oscillator Virtual Analog design. Each oscillator has a smoothly-morphable waveshape from Sine, through Triangle, Sawtooth, Square and finally to 10% Pulse) and has independent +/-2 octave pitch and +/-1 semitone detune controls. There is also a separate white-noise generator. The synth also has its own multimode resonant filter (24dB/octave Low Pass, 12dB/octave Low Pass, 12dB/octave Band Pass, 12dB/octave High Pass and 24dB/octave Low Pass modes) with controllable keyboard tracking. There are two ADSR envelope generators, one locked to amplitude controls, and the other freely assignable to the modulation matrix. There are also two LFOs with multiple shapes and speeds. These three modulation sources can be freely assigned to any of the 14 modulation destinations, which amounts to 42 modulation slots. Unfortunately, none of the parameters of the synth can be automated.

Pattern editing in Beaterator does not use MIDI internally – The game is locked to 4ppqn on a five-octave keyboard, and the melody notes use a unique pitch bend/portamento technique which doesn’t map directly onto MIDI pitch bend events. However, we can import and export MIDI files with a reasonable degree of accuracy, which is a feature we think will be particularly useful.

I’m already impressed by some of the editing capabilities – I was surprised to see a brief glimpse of envelope rubber-banding. Any other specifics you want to talk about in terms of editing possibilities?

As explained above, we have ADSR envelope control throughout, and we are particularly proud of our Synthesizer. Our sound waveform editor supports most of the normal editing tools you would expect (trim, insert silence, normalisation), and also allows you to set up sustain regions for the sample playback engine, timestretch and slice the waveform.

Okay, so let’s imagine I’ve got a bunch of audio loops on my drive and want to do, effectively, what Timbaland did with his loops. Do you have as much control over authoring loops for Beaterator as Rockstar? Are there limitations on this feature?

You can freely import and edit any 44.1kHz or 22.05kHz mono or stereo uncompressed 16-bit WAV into Beaterator (we have 9MB of sample memory available in any one song). You can edit these however you like (indeed we use these tools ourselves to generate content).

Do you need to prepare your loops at a fixed bpm? If I bring in a 120 bpm loop and change the tempo to 144, does my loop stretch? (If it’s doing stretching, the audio warping engine sounds really fantastic!)

We do timestretch loops to match the songs tempo (but this can be disabled if desired). You can also over-stretch sounds for that early-90s “granular timestretch” effect. Thanks for the compliments on our warping engine too!

I’ve got a soft spot for 90s digital, I think. What was the emphasis of the Rockstar team in terms of their samples and musical genres?

The focus was on loops that could work well with most genres. We like to think you can create songs from Rock to Rap with the selection we present.

Is it (You) Live, or is it Timbaland?

Beaterator gets at the heart of what’s happening with the way music creation is packaged in a digital age. Rockstar contrasted their title with things that are “games,” like the Rock Band/Guitar Hero mold that was refined by Harmonix. Rockstar emphasizes creative music creation and deemphasizes gaming. At the same time, they pack the title with pre-made loops and are concerned about whether what you do will easily sound good, or whether you’ll be overwhelmed by the genuinely powerful tools underneath. Beaterator, unlike Rock Band, is not about playing along with your favorite artists – but clearly Rockstar is betting that Timbaland is a favorite artist of prospective buyers, and that you will try to sound like him and use his loops. Rock Band makes no such attempt to be creative. The Beatles, coming out next week, is about playing along with the Beatles. (I recall singing along with my sister when we were kids, and I was someone who grew up taking weekly piano lessons.) Yet the “game” in this case does just the opposite – instead of trying to be easier, the whole selling point is a ramped difficulty curve. Maybe the reason studies are showing people graduating from Rock Band to real instruments is that, eventually, if you seek out difficulty, you need to go beyond the game. (Actual instruments: they’re the ultimate expansion pack.)

It’s a paradox, but it’s not a paradox restricted to gaming. You can take the conflict above and apply it to the way all music technology is marketed. On one hand, you have software that’s almost comically complex – sometimes offering so many options that it’s hard even for people with doctoral-level training in digital signal processing to make actual music. On the other, from many of the same vendors, you have pre-built loop libraries and presets with push-button simplicity, requiring less musical coordination or rhythm than, well, Rock Band on Easy mode.

All of us, like our technology, have a split personality when we use digital tech. But maybe the ultimate question is a simple one: can you make something?

I’ll reserve that question in regards to Beaterator until I get a final version. I was set to take a development build home with me, but I do have to wait until the final release. I do think these are interesting questions, though.

Oh, and say what you will about Timbaland, but animated Timbaland has some sort of nuclear control panel that he uses to DJ from. I want a real one. Surplus shopping, anyone?

Stay tuned for a look at the finished product. If fans of mobile game music were willing to use Mario Paint to get an extremely basic song editor, I think Beaterator could be a revelation. And in addition to looking at music production in Beaterator well beyond what might qualify as “Rock” or “Rap,” I think it’s long overdue for a guide to the other independent apps for the PSP. (In fact, I just got a new one in my inbox), so watch for that, too, in a separate story.

Videos from Rockstar (all images and videos are of the PSP version, not the iPhone)…

Now, I talk too much. The best way to make my argument? Listen to the kids. Their favorite feature: recording their own voice.

I rest my case.

Ten minutes. Four or five kids (or adults). Make a song. Go.

That’s the idea behind the Youth Music Box, developed by Silent Studios and Chris O’Shea. (Our friend Chris you may recall from various interactive projects and the blog pixelsumo; he sends this project our way.) The software is build in openFrameworks, the C++-based creative coding environment for artists.

With keys, drums, and yes, even a scratching DJ-style interface, the music box brings together kids for quick music making, inspired by the phenomenon of musical games. The experience is guided by genre, with some effort to make sure whatever they do sounds good, but it’s extraordinary how effective it is at conveying the experience of the successful jam. It’s a bit of a confidence builder, in other words, for a group musical experience, perhaps more so than those ear-splitting, cheap plastic recorder consorts I recall from my youth.

And oh yeah, those kids look super cute once they get rocking out. (See video below.)

Youth Music Box Experience from Silent Studios | Resonate on Vimeo.

All of this raises some fascinating questions, and not always with the answers you might expect. In a normal musical ensemble, you begin sounding like crap, amp up difficulty, and eventually sound something like this – at least as far as coherence goes, assuming you’re not aiming for experimental free jazz. But with the addition of technology, whether musical games or the presets on our favorite synths or the quantization and beat-synced loops of our sequencers, it goes something in reverse. You start out sounding like this, pull apart the mechanisms that make you sound a certain way, and eventually find your way to your own personal approach. (And at some point, you get some of the readers on this site, writing code to produce their own sounds and musical structures line by line.) In fact, one could imagine scaling difficulty of even this particular setup, gradually adding greater musical freedom and taking away the “training wheels” of all the rules-based restrictions that make the results sound a particular way.

Skeptical about the connection of music-based games and actual music making? Think again – even as music education unravels worldwide, games are actually encouraging real music. That revelation was the impetus of the music box project:

Research commissioned by Youth Music found that up to 2.5 million young people in the UK – or 1 million aged between 12 and 18 – have been inspired to progress into ‘real’ music-making because they have played music-based console games.

You got it – they hit those plastic buttons, got inspired, got bored, then decided to go to the real thing. And otherwise, they might have remained passive musical consumers: the game was a gateway drug. Of course, that means that any such interactive experience has to stand up to polished Guitar Hero and Rock Band-style games. But anyone who believes the music games genre has peaked and is on its way out may be dead wrong on many, many levels. On the contrary, this may only be getting started – and the real growth could come in music beyond the realm of games, as people graduate to the unlimited set of possible music experiences.

Chris sends lots more documentation of this project, if you’d like to learn more:

by silent studios and me for uk charity youth music to get kids turned on to music
http://www.vimeo.com/6210259

watch some bbc coverage here
http://news.bbc.co.uk/cbbcnews/hi/newsid_8160000/newsid_8168800/8168881.stm
http://news.bbc.co.uk/1/hi/technology/8154449.stm

Ed.: The video at top doesn’t play outside the UK, because we don’t pay BBC license fees. What, all those Doctor Who videos I bought in the 80s and 90s didn’t make up for it?

here is a press release from roland. the box is ‘powered by roland’
http://www.audioprointernational.com/news/1329/Roland-unveils-Music-Box-for-Youth-Music

some launch pics
http://www.flickr.com/photos/pixelsumo/sets/72157621466657993/

making of pics
http://www.flickr.com/photos/pixelsumo/sets/72157621404410234/

this goes into some of the ideas and details about the musical kit
http://musicispower.youthmusic.org.uk/blog/24/youthmusicboxlaunchesatlondonssouthbankcentre/

on the website there is a very simplified flash version you can try out on a mini timeline, just click play online :)

its quite funny to read these comments on it
http://www.hypebot.com/hypebot/2009/07/youth-music-box-democratizes-music-creation.html

And yes, you can try this yourself and play online! The official site:

http://musicispower.youthmusic.org.uk/youth_music_box/

The production company:

http://www.silentstudios.co.uk/

And Chris’ own site:

http://www.chrisoshea.org/

Roland is involved, and donated an E-09 Interactive Music Arranger to give kids some toys to explore.

And yes, I did notice a certain kindred spirit in the form of Moldover’s Octamasher. The underlying technology and its results are different, but to me what’s most interesting isn’t the superficial similarity of these projects, but the fact that they array the instruments in a circle. Computer production often simply orients a single person to a screen – not so ideal for collaboration. And even Rock Band and Guitar Hero, like an onstage band, line up artists for a (now nonexitent) audience. Perhaps the circle is about to make a comeback as music restores its social aspect.

Curious to hear other thoughts on these projects as they evolve.

Osmos Trailer from hemisphere games on Vimeo.

Osmos is a glorious glimpse of the fusion of electronic sound and game design many of us anticipate. It is built around a (challenging!) physics-based gameplay style – in the same vein as float-around-the-world games like flOw (and long before that, Asteroids) with procedural design and a perfect, liquid electronic soundtrack. Osmos became available DRM-free yesterday on Valve’s terrific Steam service for US$10 (on sale for a little less this week), and you can buy worldwide from the developer on Direct2Drive. (The developer has temporarily suspended direct sales from their site. Updated: the game is available again direct from the developer. It’s worth buying direct if you want to get a free coupon for the Mac and Linux licenses when they become available. Steam and D2D are great stores that support indie developers, though, and in the case of Osmos you don’t get any DRM with either one.) There’s also a free demo available. Versions for Mac and Linux are coming soon.

The roster of artists working on the music is simply a dream, including Loscil, Gas/High Skies, Julien Neto, and Biosphere.

I’ve already lost myself in the opening levels, and can’t wait to get deeper. CDM will have an interview with the creators by next week, once they recover from the launch.

And yes, indie gaming looks like a very fertile ground for digital artists and musicians, indeed.

Now, I’m not going to say anything else, because I want some time to play the game.

http://www.hemispheregames.com/osmos/

If you’re looking for something fun to fiddle around with this weekend, this could be your ticket: we’re tipped off that iZotope have released a video game-themed expansion for their iPhone-iPod touch drum machine.

As Timbaland would surely say, were he asked:

T: It’s from a video game, idiot! [laughs]
P: [laughs]
T: Freaking jerk.

(Look that up, if you don’t know what I’m talking about.)

Update: VIDEO. Sweet, brilliant video.

Sure, it’s no LSDJ, but it could be a more-than-fun diversion – and I still think iZotope did one of the most elegant interface designs for the iPhone anywhere, in terms of actually designing around the touch interface.

And to think you can get it and a whole new iPod touch for the price of a Logic upgrade. Just sayin’.

iDrum Video Game Edition [iTunes]

Performance with Cubie from sadmb on Vimeo.

Music sequencing as a Rubik’s Cube-style game, or hypnotic, kinetic rotating wheels – your piano roll won’t know what hit it. New musical art is set to be performed in Argentina, but you can download both tools, free.

Computer interfaces for music date back decades now, but with ingrained notions of hardware sound sequencers, linear media like tape, and hundreds of years of notation in staves and bars, old habits can be hard to kick. Yet it seems that suddenly, a younger generation of audiovisual composers is exploding notions of how musical interface and sequence could work, fully embracing a virtual space in which they themselves have come of age.

Next month’s spectacular-looking 404 Festival could make anyone want to book a flight to Argentina. Two highlighted artists from this festival for me really embody the possibilities of new sequencing metaphors. Both are built in Java.

At top, Cubie by Sadam Fujioka of Japan is free, downloadable software that combines audiovisual performance and game in a rotating cube.

Cubie is a software instrument which provides innovative idea of musical performance, differs from existing musical performance system such as musical notation, DJ systems, DAW systems, etc… It has a novel concept incorporating a new interactive technique based on puzzle games. Music is represented from highly saturated colored letters on a 3D cube. Almost unlimited number of melodies and rhythms can be created from a combination of those letters, and it can be changed on real-time by operations based on puzzle game. Those playful operations push a performer to play repeatedly and get the skill of performing with Cubie. Cubie is free software and you can play just like sadmb do.

More information in both Japanese and English at sadmb site (with lots of other software, as well). Built in Java with the use of JSyn for synthesis.

http://sadmb.com/

If these cubes feel overly rigid to you, though, and you don’t like the mechanical repetition of these lines, enter the crazy, spinning world of Hiroshi Matoba.

Hiroshi Matoba: OVERBUG from antjeverena on Vimeo.

Overbug is a music-performance tool designed to compose Minimal and Dance Music.

Through looping and newly arranging sound patterns, called ‘Bugsounds’, the program creates complex, polyrhythmic sounds. Overbug differs from conventional linear controlled music sequencers, which arrange the sound into a linear timeline from left to right. In Overbug the sound arrangement of the repeating music loops is equal to the visual abstraction of circular actions which built the interface through circles.

I showed a very early sketch I was working on last year of a circle-based sequencer, also built in Processing, though (cough) my chops are nowhere near Hiroshi’s. I was more interested in using the circles to subdivide cycles, as in Indonesian music. Seeing this piece is a major kick in my pants to try to work on my project a bit more and go a different direction.

Here’s a demo video explaining how this works:

More information + free download (just updated this month):
http://www.dominofactory.net/Overbug/

If You’re in Argentina

Don’t miss a terrific-looking exhibition of Japanese works and the rest of the
http://www.404festival.com/
(info in Spanish + English)

These two works clearly belonged together, but I feel bad for not featuring any Latin American (or Argentinian, specifically) work — those of you associated with 404, if you’ve got hot tips, send them in.

This is worth posting for this line alone:

“Who needs a Natal when you’ve got a theremin!”

(If you don’t know what he’s talking about, see here.)

Yes, in case you’re looking for a creative way to practice your Theremin playing, here you go. Now, where’s our Theremin Hero game? From the description by Glasgow-based YouTuber conquerearth, previously seen using the Theremin to play “Still Alive.”

This is even more fun with two people playing! One person controls left/right, the other controls jump.

Its not just limited to the theremin. Its even possible to hook up a microphone and use your voice to control the game! Or a guitar! Or a violin!

Heres how it works:
The sound from the theremin is split into its frequency and amplitude components in real time, which are then mapped to values in a linear scale representing the X and Y axis. Pitch becomes horizontal control, and Volume becomes vertical control.
The X and Y scales are then cut up into different zones. In this case, Left; Right and dead zones for the horizontal, and a single trigger and dead zone for the vertical.

The trigger zones are then mapped onto a virtual joystick hooked into an emulator.

The end result is a fairly usable input control for playing games like mario. The bars give the much needed visual feedback as to how “in tune” you are, so you have a better feel of where the trigger points are.

I’m sure there’s a deeper meaning I could extract about gestural controllers, expressive musical instruments, and the meaning of life, but it’s Friday and it’s lunch break time. If you can do my job, feel free – add in comments. (If your cat walks across your keyboard, it’ll still probably come across as more intelligent than an average YouTube comment, so have at it!)

Kongregate is a bit like public access, only on steroids and for games. The idea is this: get indie game makers in one place contributing games, then get lots of people playing those games, then support the system with ad revenue shared with the game makers. The model has grown rapidly, with millions of users and over 15,000 original games.

The newest project from Kongregate looks to connect artistic talent on projects, including musicians, composers, and sound designers wanting to work on game projects. The Collabs section will see artists and sound and music creators uploading their work to find collaborators. Initially, there’s a contest on, with competition for attention, cash, and studio prizes.

http://www.kongregate.com/collabs

The competition aside, this could be the beginning of a successful community for collaboration in the indie Flash gaming world. Assets are often uploaded under a Creative Commons license, and I see one of the top sounds draws on samples from Freesound.org. While career success is an obvious goal, the contributors so far appear to see sharing as a way to get there – in stark contrast to the model in the mainstream, big-business game industry. Quality is, of course, variable, but ask anyone in the game industry how to become successful and the answer is always make as much as you can. Getting work out there, even primitive, can be part of a learning process. So I’m eager to see what transpires as these kinds of communities grow.

There is an invariable comparison to Deviant Art – and you’ll see they’ve already begun to invade.

Oh yeah, and I quite like these glassy tendrils, rendered in Cinema 4D. Image (CC) Chaodeath. Now, make that run real-time. Or, erm, imagine those are virtual renderings of artists … collaborating.

Wired has a great mini-documentary on the score for the videogame Infamous. It’s chock full of sound design ear candy, not only served by the chops of composer Amon Tobin but the team at Sony Music and Sony’s entertainment division, as well. Curiously, Jonathan Mayer, Music Manager at SCEA, says explicitly that he doesn’t want composers writing interactive music. He’d prefer to have them write a conventional score and then adapt it to the interactive engine. Now, of course, around these parts we like the idea of composers finding ways to write genuinely generative and interactive scores. But in this case, Mayer is acting as a kind of remix artist for the game realm, sampling Tobin’s compositions and reconceiving them in the game world. That kind of collaboration could be powerful.

Chuck Doug, SCEA music director, overstates things a bit by claiming this game has a unique aesthetic. The visuals are a burnt-out, post apocalyptic city – yeah, been there quite a few times. The music involves lots of ethnic percussion-y instruments and bowed metal and deep booming sounds. (Let me get this straight: we’ll hear a plucky stringy thing, then a bowedy metally thing, then there will be a big boom!) So, generally, not some radical new departure from game and motion soundtracks. But regardless of its novelty, I’d be an utter killjoy to complain: it sounds utterly gorgeous.

Previously:

I got to listen in on a lot of gems regarding sound design from composer Troels Folmann. He doesn’t just bow metal instruments – he boils them.

GDC: Boiling Waterphones and Other Sonic Inspirations from Composer Troels Folmann

And on the subject of getting composers to write interactively, Matt Ganucheau has been teaching that way:

Teaching Adaptive Music with Games: Unity + Max/MSP, Meet Space Invaders!