The gaming industry has made their bet, and it’s that touchscreens go better with tactile controls. Might digital musicians reach the same conclusion?

A funny thing has happened on the way to the touch era. The vision of a device like the iPad is minimalist to the extreme: an uninterrupted, impossibly-slim metal slate, as impenetrable as some sort of found alien scifi object. The notion is that by reducing physical controls, the software itself comes to the fore. It’s beautiful conceptually … and then you find yourself tapping and stroking a piece of undifferentiated glass. For navigating interfaces – and even, I’d argue, exploring sound design and composition – it works brilliantly. But for live digital performance (what to game lovers is called “gaming”), for anything that wants tactile feedback, it can be imprecise or unsatisfying, or both.

Watching this shake out as a design problem is fascinating, especially coming from the perspective of music. Digital musicians were exploring alternative interfaces since before it was cool. Given the ability to make any sound we can possibly imagine, the question of how you design an interface around sound is compositional, philosophical, essential.

Whatever winds up working in the marketplace, there are some fascinating ideas for combining touch with tactile. Since both are good at certain tasks, why not do both?

We’ve seen several examples among musicians and researchers exploring how to augment the touchscreen with physical input:

Mike Kneupfel’s research at NYU’s ITP program, in the video at top, investigates adding additional inputs. See: Extending the Touchscreen.

We saw that kind of extensibility in an iPad dock concept by Livid Instruments.

While it lacks additional tangible controls, I/O extensibility is featured in a still-as-yet-unreleased “pro” dock by Alesis, and most recently in a DIY dock by circuit bending pioneer Reed Ghazala.

Now, game vendors are moving in the same direction – even with prototypes that look quite a lot like the research project above. (Sometimes, arriving at the obvious conclusion is necessary for a great design.)

Sony’s PlayStation Vita, successor to the PSP mobile game platform, augments touch input with tactile controls in much the same way as Michael Knuepfel’s work does. Notably, it also proposes how these inputs can coexist in a form factor that’s larger than a phone, but smaller than a tablet – scaled roughly to a comfortable holding distance between your two hands. (Microsoft and Apple each unveiled standard split keyboards on Windows 8 and iOS 5, respectively. The era of thumb ergonomics is now fully underway.)

Nintendo’s Wii U controller combines a lot of sensing capabilities into one device. Like Sony’s effort, the centerpiece is the combination of the interactive touch display with analog controls. But true to its Wii heritage, Nintendo is packing other sensing technology, too. While its evolution has been more piecemeal, the same is true of the Xbox 360 in the Kinect era. The Kinect camera is really a bundle of mic and stereoscopic camera sensing with software intelligence for motion analysis and even speech analysis via a variety of methods. While Kinect is touchless, the conventional gamepad still plays a role.

What’s the relevance of all of this evolution to music? Digital music’s demands parallel gaming, requiring precision, accessibility, scalability from beginners to hardcore experts, and real-time interaction. Also, music research has often been at the forefront of experimentation with a variety of means of translating sensory data to expression. And since musical practice itself is roughly as old in human evolution as language, if not older, it’s a key way of glimpsing how ubiquitous interfaces can become meaningful.

Let me put that another way: the stuff game companies are doing now looks a heck of a lot like what computer musicians have been doing for years.

While much of the acclaim for platforms like the iPad has been for their transparency and unadorned interfaces – and while I believe those are valuable concepts – bundles of capabilities for interacting with the world can become powerful. That means efforts like Apple’s addition of USB MIDI connectivity to the iPad, or Google’s nascent work to standardize USB host mode and open hardware development (based on Arduino), take on new meaning. Add to this additional connectivity via Bluetooth and wifi, and it may be that we only really see what these platforms do when, like the PC, they start geting sociable with a range of other gear.

This could also mean that communities like the music community have a chance to prove that the “post-PC era” is a little different than it’s been described in the mainstream press – and maybe a little less a radical departure. The “post PC era,” we’re told, is less about being a hub for a lot of hardware. But as people look for tactile feedback, some of the coolest applications of these platforms may not be in the mainstream use as “consumption” devices, but at the fringe.

I’ve just come from the launch of the Samsung Galaxy Tab 10.1 in New York. You’re not missing much; there were a handful of people snapping up the tablets. (I think the 10.1, and a few other Honeycomb-based tablets, do have a bright future, though their growth may be a bit slow at first as developers get their hands on them and give people a reason to buy them.)

What was most compelling to people at the launch, though, was a planned appearance by pop star Ne-Yo (at least according to some staffers to whom I spoke).

But the connection was, at best, tenuous. It may be when devices like these tablets are made more viable for musicians onstage that that connection starts to make sense. And that may mean that Apple and Google/Android vendors alike need to start to think more aggressively about the larger ecosystem and hardware applications. Remember all those futuristic promises from Apple about hardware accessories? Right now, the most significant hardware is the Square payment add-on, and it uses a hack to make it work through the audio jack. Both Apple and Google can do more work to open up hardware development.

It’s all well and good for the tablet to be a “post PC” device, to be different from PCs, to be better. But they may simultaneously need some of the openness to other gadgets that made the PC age so revolutionary.

Load up an Ableton set or mix samples, and you’re already in the domain of interactive music. With joysticks and arcade buttons and other controls, the blending of game and musical interface into generative compositional fusion is even clearer. It’s little wonder many electronic musicians take an interest in the nexus of gaming and music.

Any discussion of interactive music scores for games would be incomplete without Jonathan Mak. His self-produced title Everyday Shooter used classic top-down space combat as a musical experience: not only do sound effects in the game act as musical elements, but even the flow of the game itself fits into a generated song structure. Mak even imagined the title as an album. Playing through it, once you get into the groove of the action, the roles of gamer and listener merge into a single flow. (See video, at end.) Another nice feature – breaking from cliche, it’s a music game that employs guitar lacks in place of, say, a pounding trance soundtrack.

Now, Mak turns his attentions from space shooter to platformer, with SoundShapes, on the console Sony announced this week, the PlayStation Vita. It’s best to watch the video to see what’s going on. It’s just a taste; we’ll have to see the final title.

There’s more good news, too: on of our favorite artists, the inventive i am robot and proud, is the musical collaborator. And you can now look to Toronto as a hotbed of indie game action – take that, Montreal and New York – with i am robot and proud and the team behind iPad album-as-game-as-album Swords & Sworcery.

The effects of making ever game event musical can be cartoonish at times – though, perhaps in a game, that’s part of the pleasure and aesthetic. But in Mak’s best moments, it was as though he was composing with gameplay – canonical gameplay forms as a modern, digital parallel to musical forms like a sonata.

We’ll be watching. Thanks to Metehan Korkmazel for the tip!

Via GameSetWatch, who have some nice analysis. (One point of disagreement – they speculate this will be onstage “in the hands of at least one chiptunes performer.” I think that’s actually relatively unlikely; chip music artists continue to prefer dedicated music tools, not games. Laptop artists would occasionally feature an ElectroPlankton cameo. But I’ve been fiddling with some Processing sketches that try to make game interfaces for music. It’s fun, if really hard; I’ll keep trying. Seems a good airport layover project.)

Previously on CDM:
Portal 2′s Musical World, Available Free, in Non-Adaptive Form “For Testing” [ Also makes use of interactive musical accompaniment ]

Game Meets Album: Behind the Music and Design of the iPad Indie Blockbuster Swords & Sworcery

Ed.: Make no mistake about it: digital sound tech, from mixing to processing, has evolved to a fidelity on par with its analog predecessors and opening possibilities well beyond what they offered. But the making of that evolution wasn’t easy, and it was more than a technical challenge. You can thank the creative spirit of people like Paul Frindle. As contributor Primus Luta explains to CDM, his work is about more than just engineering or tools – it’s driven by creative, musical energy. -PK

Author’s note: I wanted to bring this piece to the CDM audience because, whether we know it or not, if we Create Digital Music, we are indebted to people like Paul Frindle.  While this piece is on the technical side, one of the things that I hope readers will pull away is his creative spirit. May Paul inspire you to bring that same energy to the work that you produce in the digital realm.  You can read the full interview, with war stories from Virgin Records, Trident Studios, SSL and more at AvantUrb.

In the world of audio, Paul Frindle is a legend.  During his tenure at Solid State Logic, he was responsible for the channel electronics of the SSL G Series Console.  He was also a part of the team that broke the “damnable black art” of digital conversion.  He went on to cofound the (pre-dot=com) startup Oxford Digital Ltd. Their first contract was with Sony (who would eventually take over the company), developing the application design of Sony’s flagship digital mixing console.  The result of this work was the OXF-R3, to this day regarded as the pinnacle of digital mixing consoles, not only in music, but also in film.  Like everything Paul has worked on, as much of a landmark as the OXF-R3 was, it proved to be but merely a stepping stone.  Where it was leading, however, could have been much different.

“I think there was a fantastic opportunity to revive the large studio concept, by integrating non-linear storage and editing into the OXF-R3,” Paul says. “It was already a massively-powerful workstation, wide open [enough] to accept it. This would have been amazingly powerful and creative, and would have knocked underpowered workstations off the map for many years to come, restoring a much-needed differential to the elite studios against the upcoming project studios.”

The OXF-R3 has only continued to blur that line in favor of the project studios.  Strapped for the kind of clients who could appreciate — let alone could afford — high-end studios, the great studios of their time have faded away one by one. If those studios could have stayed on the leading edge of digital tech, would it have been enough to halt those closures? We may never know.  Fortunately for all studio buffs, high-end and project alike, there was another avenue of exploration left for Paul that would give his work the broadest audience to date.

“The design of the OXF-R3 was amazingly ahead of time. It was a great big, highly flexible processor with a whole load of software running on it, which was restricted and presented on a panel just for conformity and convenience. It was already ‘software in a box’. It could even be controlled remotely. All of the design systems and debugging tools I was using on it consisted of on-screen GUIs.”  This was a dramatic, yet understated shift from the way technical engineers had previously worked.  It was a physical product, but the brains of it was moving into the virtual space.

“I was warning that the OXF-R3 product concept was obsolete even before we finished it. The large digital tape recorder was nothing more than a very costly and highly delicate ‘bit bucket’ organised like an analogue machine. With the meteoric rise in performance of digital technology, it was fairly easy to envisage a time when a unit bought for £1000 would be capable of doing a large chuck of what a mixer needed.  In the near future, we would be able to make art without all this paraphernalia, at a miniscule fraction of the cost. I was far more excited about this than doggedly hanging onto established formats and design constraints.”

Not one to let this excitement lay dormant, Paul and a few others started their own pursuit.  “The plug-ins project was initially hatched from humble beginnings, almost by us working in our spare time and at nights. My colleague actually did the first proof of concept EQ plug-in over the Christmas break and it all grew from that.

“What people needed most were high-quality, refined and indispensable applications; the EQ and Dynamics were adapted to provide that. Making them identical to the OXF-R3 applications was a link to our existing reputation. Of course running these in 48bits for TDM or double float in RTAS actually provided better performance than was available in the OXF-R3 32-bit, fixed-point environment. And it has to be said that we ironed out a few bugs along the way too, so these were actually better than the applications in the large format console.”

For users, this resulted in what are still being called the best equalizer and dynamics processing plug-ins on the market.  For Sony, however, the greatest deliverable was the system they built to create both the OXF-R3 and the plugins.  “It was a complete hierarchical graphic design system running on a specially-designed processor, which allowed real-time interaction and analysis of the action for almost every instruction in your processing design!”  If this description sounds familiar, it is because what Paul is describing is a modular environment for signal processing, much like tools like Max/MSP, AudioMulch and Plogue Bidule.

“Not only did it allow engineers without formal programming skills to build highly complex applications, it also very crucially allowed us to experiment freely and actually listen to what was happening in real time! It was this system that enabled me to delve so deeply into what we could hear and why, exploit that knowledge and realise the applications for the OXF-R3 console and subsequently the Sony Oxford plug-ins. Quite simply, I was able to ‘play around’ with all sorts of  wacky processing models to get the behaviour that matched the all-important sounds in my head.”

This freedom of experimentation allowed Paul to move from traditional audio utilities like EQ’s and dynamics processors into more creative arenas.  “The Transmod was something that I have always wanted since the mid-1970s, and over the decades had tried on several occasions to make out of analogue technology. But it was doomed to failure because of the relatively poor accuracy and stability of [analogue] components. During a lunchtime, I knocked up a digital version of my old idea as proof of concept, and it just worked!

“The Inflator came about because I received a late night call from a friend who had been doing high-profile sessions in L.A. with Eric Clapton and BB King. He had slogged away for months doing recordings and mixes, but had been beaten into production by another engineer who managed to make it louder. He wanted to know if there was anything he could possibly do to make it louder without wrecking the sound completely.  I was reminded that I had to make my first transistor power amp design in 1970 twice as powerful as the previous tube amp design to get the same volume and impact. All I had to do was to apply all this old knowledge into a digital process and the same effect would be available. I used a combination of math packages and the OX-R3 design system to experiment and extract the salient details of what made the tube amp louder. This was definitely a walk on the wild side, since for the first time in this employment I was making something whose sole purpose was to generate a heap of distortion!”

After leaving Sony Oxford, Paul set out on his own again to further explore the creative possibilities opening up through digital audio.  The result is his latest venture Pro Audio DSP.  “This initiative was conceived as a way of getting this stuff done without too much interference from marketing executives and sales infrastructures.”

The first product is the Dynamic Spectrum Mapper plugin.  “It was yet another object I had always wanted to have, but the idea was given greater urgency from listening to what people were trying to achieve in their productions using greater amounts of compression, the kinds of character they were trying to produce, and the difficulties they were battling with along the way. This, and a deep personal dislike for the artefacts produced in conventional multi-band designs, gave impetus for the design of the DSM. Digital processing seemed to provide the possibility of actually making it at last.

Dynamic Spectrum Mapper introduction from Paul Frindle on Vimeo.

“I am particularly pleased with the DSM because it’s exactly the sort of thing I want to bring to the marketplace – serious processes that have groundbreaking practical purpose and facility.  They are, at the same time, artistically capable and great fun! Such things excite me because they bring genuinely new capabilities and artistic power to the production process.”

If there is a theme to be found throughout Paul’s career it is a continuous effort to push forward this idea of the technology as art.: “I don’t want to waste the rich experience of the past in some manic push for ‘newness,’” says Paul. “Neither do I want to simply try and blindly copy what was there, in the hope that it does the same ‘kind of thing’. I want to understand it and use that understanding to produce new stuff, which is truly creative and actually advances our art. We should be carrying the past forward with us in a continuous process of advancement, not writing it off to history, or reverting to it in a religious search for past success.”

Speaking with Paul, his mind is so focused on the present or even the future, it’s easy to forget his historical relevance.  Working dilligently to realize the ‘sounds in his head’ and put them out into the world, he is not only an inspiration for the work he produces, but for the creative ethic it exemplifies.

As you may know, the creators of games like Grand Theft Auto have collaborated with Timbaland to bring a mobile music studio to Sony’s PSP (and later, the iPhone), based on an ambitious free Flash experiment on their Website. Now, it’s my impassioned belief that you shouldn’t need lots of canned loops or celebrity endorsements to make music fun, so normally I might actually run the opposite direction of any story starting with that line. But here’s the surprise: underneath, the app is more powerful than I expected.

I’ve gotten an early preview of the title in person at Rockstar’s offices here in New York, and was also able to grill their developers on geeky details of how the sound engine is put together. A test copy isn’t yet available so I can’t properly review the app, but I am at least able to talk about some of what lies beneath the PSP screens and marketing.

For some time, a select few have known that the Sony PSP’s secret is that it’s a powerful handheld computer, ideal for mobile music. Brilliant-but-underground apps like PSPSEQ and PSP Rhythm capitalized on this potential, but required you hack your PSP in order to run them, because Sony restricts launching non-authorized applications from memory.

Beaterator is the first full-featured app that can be run directly on the PSP. Some people may not look past the fact that it comes from a game company, past its (admittedly) thick layer of marketing glitz and celebrity endorsement. But based on a first look, I believe Beaterator is the most powerful music app ever released through game channels, surpassing in functionality even the recent cult hit Korg DS-10 for the Nintendo DS.

In the interest of disclosure, I have a confession: I didn’t expect to have any interest in Beaterator at all. I was concerned that the musical experience would be watered down (though more on what I actually discovered below). The fact that this game had one artist – Timbaland – literally dancing around the screen talking about how it’s his game I thought would be a deal killer. And, of course, it’ll be impossible to talk about this game without the shadow of the “Acidjazzed Evening” controversy, which aleges Timbaland plagiarized music by Finnish composer Janne Suni – made worse by a lawsuit and a glib interview in which the artist responded, “It’s from a video game, idiot.” Timbaland is by no means the first artist to get into trouble with an uncleared sample, but the fact that it was a much lesser-known artist and that the situation was handled less than gracefully certainly created a credibility issue in the enthusiast community.

I bring those issues up front, because I know readers will bring them up. But what intrigues me about Beaterator is that it has an essentially split personality. At one moment, Beaterator is an animated Timbaland talking to you while you trigger canned loops with game buttons, neither game nor, really, a music creation app. At another moment, though, it’s a full-blown music sequencer you can carry around on your PSP, with some retro design and sound features that might actually make it appealing. And I think it’d be unfair to cover one side without the other.

The marketing for Beaterator focuses on the thousands of loops assembled by Timbaland and Rockstar. But Beaterator isn’t limited to those loops. What you likely won’t see emphasized in the gaming press:

• Sampling: You can make your own samples using the mic (or, if you can find it, you can add a PSP microphone)
• Audio import: You can import WAV files from a computer, as easily as dropping them onto a MemoryStick.
• Audio export: You can save your work as an audio file. Rockstar will have its own site for exchanging your music with other users, but that will be limited to the built-in effects (I’m guessing so they don’t have to police piracy). But that won’t stop you from exporting audio on your MemoryStick and using it however you like.
• MIDI import and export: While even many serious iPhone games lack this functionality, you can use Beaterator as a mobile MIDI editing workstation.
• Grown-up interface and effects: Beaterator has real audio effects, with real labels. The Compressor has labels like Gain and Ratio, instead of, you know, “Phatness” or “AMPMEUP.” It’s a clue that this really is a tool and not a game.
• It’s-a-me … not! Game cartoon character heads never appear in the interface – though I do have to admit, those Mario Paint Mario noteheads were cute. (For the PSP, might I suggest semidemiquavers with the face of Kratos?)

I love my desktop sequencers, but having these kinds of features in a comfortable-to-hold mobile device you take anywhere, being able to fly through settings with the PSP buttons, and lots of little details added by the Rockstar developers like confining pattern editing to scales and keys make Beaterator look like something that’ll be fun to use. After a couple of minutes, I was ready to charge up my PSP and fire up Beaterator alongside PSPSEQ.

Inside Beaterator’s Engine

Beaterator began several years ago on Rockstar’s website. Before making full-blown music production tools with Flash was popular, before the idea of “cloud editing” had become a buzzword, a side project at Rockstar yielded a free Flash game, which you can still play. The interface is loop-based and reminiscent of tools like ACID, GarageBand, and Fruity Loops. But it’s surprisingly minimal, capable of full-blown pattern and loop editing, includes real-time effects, and comes with a selection of loops from some of my all-time favorite producers – A.VEE & 3D, Juan Atkins, King Britt, Matthew Dear, and Steinski. Side note: please, Rockstar, can we have a custom version of Beaterator with those producers?

http://beaterator.rockstargames.com/beaterator.html

Having talked to mobile developers both big and indie, I was curious about the technical details of Beaterator’s implementation – especially after being impressed in a short demo by capabilities that went beyond what I had expected. Rockstar replied with some very particular details from the developers. I think the answers say a lot about what’s possible on the PSP – even with that iPhone version in the works – and how a handheld sequencer on mobile hardware can be put together.

PK: So, I see eight tracks, some effects – what are the capabilities of the underlying audio engine in Beaterator?

Rockstar: Our engine runs at 16-bit stereo, 22.05kHz throughout. As you say, there are 8 tracks, each of which each can have up to two insert effects* summed into a stereo mix. Each track also has a stereo pre-fader Send to a dedicated reverb buss which runs a global reverb unit which is also added into the output. The channel level, pans, aux send and all effects parameters can be automated to 1-bar resolution, as can the final mix output level, pan, and the global reverb parameters. At any given time, each of the 8 tracks can be playing either a sample-based Melody/Drum loop (with 8 channel polyphony), a monophonic synth melody loop, or a mono/stereo timestretched audio loop.

Our sequencer also supports 8 channels, at 4ppqn. The maximum song length is 240 bars, and we are fixed to 4/4 time. BPM ranges from 60-300, and there is a simple 16th-note swing control as well.

The insert effects we support are: Compressor, Chorus, Delay, Distortion, 3-band EQ, Multimode Resonant Filter, Flanger, Noise Gate, Phaser & Tremolo.

A lot of the editing (aside from vocals, really) appears to be in MIDI pattern editing. Is this always triggering a sampled instrument, or is there live synthesis / DSP going on under the hood at all? (I know the PSP is capable of such things.) Do you have any control over the timbre of the instruments, or just the musical patterns?

We trigger either our pitched sample playback code or our own DSP synthesiser on a channel. The sample playback code is a fairly simple 8-voice (which means a theoretical maximum polyphony of 64 if you are playing 8 samples on each of the 8 channels) pitchshifter (no multisampling), with no real control of timbre (no filters). But it does support velocity sensitivity (although this has to be sequenced as the PSP buttons aren’t velocity sensitive) and a full ADSR amplitude envelope.

The inbuilt synth is monophonic (but you can run one per channel, so up to 8 in theory). It’s a simple 3-oscillator Virtual Analog design. Each oscillator has a smoothly-morphable waveshape from Sine, through Triangle, Sawtooth, Square and finally to 10% Pulse) and has independent +/-2 octave pitch and +/-1 semitone detune controls. There is also a separate white-noise generator. The synth also has its own multimode resonant filter (24dB/octave Low Pass, 12dB/octave Low Pass, 12dB/octave Band Pass, 12dB/octave High Pass and 24dB/octave Low Pass modes) with controllable keyboard tracking. There are two ADSR envelope generators, one locked to amplitude controls, and the other freely assignable to the modulation matrix. There are also two LFOs with multiple shapes and speeds. These three modulation sources can be freely assigned to any of the 14 modulation destinations, which amounts to 42 modulation slots. Unfortunately, none of the parameters of the synth can be automated.

Pattern editing in Beaterator does not use MIDI internally – The game is locked to 4ppqn on a five-octave keyboard, and the melody notes use a unique pitch bend/portamento technique which doesn’t map directly onto MIDI pitch bend events. However, we can import and export MIDI files with a reasonable degree of accuracy, which is a feature we think will be particularly useful.

I’m already impressed by some of the editing capabilities – I was surprised to see a brief glimpse of envelope rubber-banding. Any other specifics you want to talk about in terms of editing possibilities?

As explained above, we have ADSR envelope control throughout, and we are particularly proud of our Synthesizer. Our sound waveform editor supports most of the normal editing tools you would expect (trim, insert silence, normalisation), and also allows you to set up sustain regions for the sample playback engine, timestretch and slice the waveform.

Okay, so let’s imagine I’ve got a bunch of audio loops on my drive and want to do, effectively, what Timbaland did with his loops. Do you have as much control over authoring loops for Beaterator as Rockstar? Are there limitations on this feature?

You can freely import and edit any 44.1kHz or 22.05kHz mono or stereo uncompressed 16-bit WAV into Beaterator (we have 9MB of sample memory available in any one song). You can edit these however you like (indeed we use these tools ourselves to generate content).

Do you need to prepare your loops at a fixed bpm? If I bring in a 120 bpm loop and change the tempo to 144, does my loop stretch? (If it’s doing stretching, the audio warping engine sounds really fantastic!)

We do timestretch loops to match the songs tempo (but this can be disabled if desired). You can also over-stretch sounds for that early-90s “granular timestretch” effect. Thanks for the compliments on our warping engine too!

I’ve got a soft spot for 90s digital, I think. What was the emphasis of the Rockstar team in terms of their samples and musical genres?

The focus was on loops that could work well with most genres. We like to think you can create songs from Rock to Rap with the selection we present.

Is it (You) Live, or is it Timbaland?

Beaterator gets at the heart of what’s happening with the way music creation is packaged in a digital age. Rockstar contrasted their title with things that are “games,” like the Rock Band/Guitar Hero mold that was refined by Harmonix. Rockstar emphasizes creative music creation and deemphasizes gaming. At the same time, they pack the title with pre-made loops and are concerned about whether what you do will easily sound good, or whether you’ll be overwhelmed by the genuinely powerful tools underneath. Beaterator, unlike Rock Band, is not about playing along with your favorite artists – but clearly Rockstar is betting that Timbaland is a favorite artist of prospective buyers, and that you will try to sound like him and use his loops. Rock Band makes no such attempt to be creative. The Beatles, coming out next week, is about playing along with the Beatles. (I recall singing along with my sister when we were kids, and I was someone who grew up taking weekly piano lessons.) Yet the “game” in this case does just the opposite – instead of trying to be easier, the whole selling point is a ramped difficulty curve. Maybe the reason studies are showing people graduating from Rock Band to real instruments is that, eventually, if you seek out difficulty, you need to go beyond the game. (Actual instruments: they’re the ultimate expansion pack.)

It’s a paradox, but it’s not a paradox restricted to gaming. You can take the conflict above and apply it to the way all music technology is marketed. On one hand, you have software that’s almost comically complex – sometimes offering so many options that it’s hard even for people with doctoral-level training in digital signal processing to make actual music. On the other, from many of the same vendors, you have pre-built loop libraries and presets with push-button simplicity, requiring less musical coordination or rhythm than, well, Rock Band on Easy mode.

All of us, like our technology, have a split personality when we use digital tech. But maybe the ultimate question is a simple one: can you make something?

I’ll reserve that question in regards to Beaterator until I get a final version. I was set to take a development build home with me, but I do have to wait until the final release. I do think these are interesting questions, though.

Oh, and say what you will about Timbaland, but animated Timbaland has some sort of nuclear control panel that he uses to DJ from. I want a real one. Surplus shopping, anyone?

Stay tuned for a look at the finished product. If fans of mobile game music were willing to use Mario Paint to get an extremely basic song editor, I think Beaterator could be a revelation. And in addition to looking at music production in Beaterator well beyond what might qualify as “Rock” or “Rap,” I think it’s long overdue for a guide to the other independent apps for the PSP. (In fact, I just got a new one in my inbox), so watch for that, too, in a separate story.

Videos from Rockstar (all images and videos are of the PSP version, not the iPhone)…

Now, I talk too much. The best way to make my argument? Listen to the kids. Their favorite feature: recording their own voice.

I rest my case.

July 1, 1979: it was thirty years ago today that the Sony Walkman went on sale, launching mobile music for the first time.

Wait – rewind (so to speak). That honor really belongs to the portable transistor radio – and, indeed, part of the reason America already knew and loved Sony by the time 1979 rolled around, having embraced their pocketable radios as early as the 1950s. In fact, if you want to blame a device for degrading audio fidelity, you should again look not to MP3s and iPods but back to — you guessed it — the same transistor radio.

But no matter. The Walkman did popularize carrying your own music collection with you. It was not only about mobility, but mobile music collections free of airwaves, mix tapes and the experience of walking around the city or doing a workout with your own personally-assembled soundtrack. It turned everyone into DJs and made the music something that could easily bounce around inside your head rather than around your living room or a music venue. The Walkman and not the iPod might also have to carry the burden of claims that music was made antisocial – but it also made for a uniquely personal experience.

And do we ever love cassettes, with their ability to accommodate our own mixes and recordings and stack in neat cubes.

True, the link that’s making the rounds on the Web parodies the clueless 13-year-old child of the iPod age:
Giving up my iPod for a Walkman [BBC News]

This comes from a different planet than the one on which we live on CDM. In this world, snarky 13-year-olds have no idea what the metal/normal switch does, and the zinger is “Did my dad, Alan, really ever think this was a credible piece of technology?” Okay, you snot-nosed brat, it’s a good thing global warming will revert us all to a primitive Stone Age existence and you won’t have to suffer the fate of technological advancement. PS – your dad says never to call him Alan again. (I kid, kid, really. Just can’t resist.)

Of course, on our planet some 13-year-old is probably assembling his or her own cassette player out of spare parts and turning it into a circuit-bent DJ machine, and knows the entire history of the Sony Walkman by model number, and can tell you which factory assembled your old broken model based on the serial number. In that demented spirit, I invite readers to share your own Walkman memories, and offer up a selection of my favorite cassette-themed posts from CDM (of which, I was surprised to discover, there are quite a lot).

I won’t even try to summarize the history of the Walkman, because I have no idea what it is, and Wikipedia has beaten me to the punch.

CDM on Cassettes

The best story of all time: Eric Beug on how to make a Mellotron sampler entirely out of Walkmans, as seen at an early Handmade Music with CDM, Make Magazine, and Etsy. See MAKE:blog for the full post.

The best-ever cassette quote: from experimental DJ Artjom (DIY machines and Max patches below):

Yes, you can contact with me. But, if you would want that I played on your party on cassettes, then I refuse. I do not play on cassettes any more. In general, I don’t want play in the club, because people come there to drink and to search partner for copulate. This is bad.

The best day for cassettes: when we read RIAA numbers that showed that DVD Audio and SACD combined were still matched by cassette sales. Some new formats catch on. Some do not.

Cassette tapes (and other tape media) as a way of making lo-fi samples:

Free Tape-Recorded Samples of Roland TR-606, 808

Cassettes for uses silly and uses practical alike:

Cassette Change Purse; Choosing Cassette Decks with Pitch Control

In other words, cassettes can be entirely useless and about nostalgia only — or they can remain a useful and inspiring musical tool even for digital users, helping you get out of your rut and approach sound in a new way.

Cassette Jockeys at the 2007 Maker Faire

The work of DJ Artyom, who assembled DIY DJ gear using cassette tapes for a unique sound and mixing techniques:

Homemade Cassette Tape DJ Mixers + Max/MSP PC

An international collective shares mix tapes – the physical tapes, yes, even in the Internet age

Above: Andy Warhol shills for TDK. Video cassette tape, to be sure – but sublime nonetheless. If I had to remember my Japanese lines, I might have to close my eyes, too.

Tape collections:
The brilliant Project C-90
The Obsessive “Tape Jam”

Walkman Sequencer: Tape + Homebrew Sequencer + Nintendo Game Boy

Gijs Gieskes is a master circuit bender, and cassette is a favorite medium. Check out his Tape Seq 02, which varies cassette playback using controllable pots and synchronizes to a Game Boy. It’s an analog result that’s only possible in this way with tape as the playback technology.

Put a cassette deck inside a Windows PC (sadly, this product appears to be discontinued?)

You Tell Us

Nostalgia is one thing. But what to you have the cassette and the Sony Walkman meant for music? And is there anything these youngsters (well, anyone younger than … 20, I guess?) could learn about this technology? Is there a lesson from the Walkman?

Above: You know a technology makes an impact when it has its own graffiti. The cult of the cassette, as captured (CC) hugovk.

Wired has a great mini-documentary on the score for the videogame Infamous. It’s chock full of sound design ear candy, not only served by the chops of composer Amon Tobin but the team at Sony Music and Sony’s entertainment division, as well. Curiously, Jonathan Mayer, Music Manager at SCEA, says explicitly that he doesn’t want composers writing interactive music. He’d prefer to have them write a conventional score and then adapt it to the interactive engine. Now, of course, around these parts we like the idea of composers finding ways to write genuinely generative and interactive scores. But in this case, Mayer is acting as a kind of remix artist for the game realm, sampling Tobin’s compositions and reconceiving them in the game world. That kind of collaboration could be powerful.

Chuck Doug, SCEA music director, overstates things a bit by claiming this game has a unique aesthetic. The visuals are a burnt-out, post apocalyptic city – yeah, been there quite a few times. The music involves lots of ethnic percussion-y instruments and bowed metal and deep booming sounds. (Let me get this straight: we’ll hear a plucky stringy thing, then a bowedy metally thing, then there will be a big boom!) So, generally, not some radical new departure from game and motion soundtracks. But regardless of its novelty, I’d be an utter killjoy to complain: it sounds utterly gorgeous.

Previously:

I got to listen in on a lot of gems regarding sound design from composer Troels Folmann. He doesn’t just bow metal instruments – he boils them.

GDC: Boiling Waterphones and Other Sonic Inspirations from Composer Troels Folmann

And on the subject of getting composers to write interactively, Matt Ganucheau has been teaching that way:

Teaching Adaptive Music with Games: Unity + Max/MSP, Meet Space Invaders!

The urgency of being way behind a single dominant player can make electronics makers do some odd stuff to promote their products. iPod, once an icon of digital cool, has achieved such ubiquity that it doesn’t even try to be hip any more. The thing is being promoted with American Idol, for crying out loud — not exactly indie cred. We saw Microsoft enlisting indie musicians and animators to sell Zune, of course.

But here’s where things get surprisingly amazing: Sony is using weird and wonderful Japanese experimental music to promote Walkman.

Now we’re talking.

And whether or not Walkman is cool again, this is for sure: Japanese experimental musicians? Mind-blowingly cool. And, apparently, in love with using light as a controller for sound.

Atsuhiro Ito uses contact mics on a fluorescent bulb he dubs the Optron. Instead of just being stage eye candy, the bulbs are really making the sounds here; coupled with guitar effects, he can solo on the bulbs. It’s what the Knitting Factory will be like after the nuclear winter. I can’t wait.

Taeji Sawai uses a light pen to draw melodic lines and rhythmic onto a screen. The basic effect – track light from a single source – is old. Yet he’s clearly got a brilliant aesthetic mind that makes it all work; the elements are strikingly simple but never fail to be engaging. And there’s a strong connection to work by his fellow sonic inventor Toshio Iwai.

Thanks to our friend Donald Bell of cnet, aka very talented and (cool) musician Chachi Jones, who has a great write-up:

Sony Walkman promos are awesome, confusing

Confusing? No, I’d say Sony is confusing; the real question is why their Walkman can’t be more like these ads. Plus, since neither Don nor I can read Japanese, how do we know those characters don’t say something like “Hey, guys, sorry for that bit with the lousy boring electronics – we’re coming back from the dark side to make awesome things again”? Okay, maybe not. (Do let me know if the next one says “Fine, you damned snarky blogger, I’d like to see you run a giant multinational corporation.”)

Admittedly, the problem here is this makes me want to toss my iPod touch out the window and build my own open source MP3 player with Popsicle sticks and wire, or, at best, mod an original Walkman so I can play circuit-bent OGG files using power from a bicycle. At the very least, I’m ready to add to my Atsuhiro Ito and Taeji Sawai collection. And I don’t think their full body of work is on iTunes. That’s just as well.

So, Sony, thanks. Now, will you let us run homebrew music apps on your PSP? Please?

PSP lgpt port [fundable]

You’ll need to hack your PSP, of course, until Sony sees the light and allows arcane music downloads via its official store. But hacking isn’t so bad. We’ll keep you posted!

Retro hardware? Vintage game machines? Old computers? New mobile devices? Whatever it is, we’ll make music and motion on it.

The Blip Festival, the legendary international festival of vintage music and visual tech, invades New York today (Thursday) through Sunday. There’s an unbelievable lineup, with fantastic musicians and live visualists playing every single night Thursday, Friday, Saturday, and Sunday, from music from m-.-n to Bubblyfish and visuals from Paris Treantafales to Meneo (and many other friends). In fact, every single musician has their own live visuals, so your eyes and ears are guaranteed to be (over)stimulated at all times.

Saturday afternoon is a lineup of workshops, including making your own visual electronics with VBLANK and putting music on NES albums with NO CARRIER.

Sunday is the debut of Reformat the Planet, the documentary film.

2008 Blip Festival

And before the Friday night Blip festival starts, get your 32-bit / mobile gaming + music device / happy hour mixer on:

Mobile Music: 32-Bit Blip Drinkup/Meetup with CDM + Boing Boing [Facebook]

Friday 32-bit BB/CDM Meetup @ Bell House Bar

Blip has a strictly 8-bit and/or retro focus. The stated mission is to:

showcase emerging creative niches involving the use of legacy video game & home computer hardware as modern artistic instrumentation. Devices such as the Nintendo Entertainment System, Commodore 64, Atari ST, Nintendo Game Boy and others are repurposed into the service of original, low-res, high-impact electronic music and visuals…

Now, I love retro tech, but being the subversive character I am, I have to say, cough, “low resolution”? “8-bit”?

And so, with Joel Johnson (Boing Boing / Offworld / Boing Boing Gadgets), we’re hosting a very informal meetup to celebrate all things mobile and 32-bit with the Boing Boing and CDM communities. If you’ve got one, bring your PSP, your Nintendo DS, and your GamePark (or even mobile phone / PDA), and prepare to share. I’m especially hopeful we’ll get some wireless action with multiples of the DS, Korg DS-10, and homebrew. We may be able to unlock your PSP for homebrew (contact us first – likewise, give us a holler if you’re good with a Pandora’s Battery and Magic Memory Stick). If you’ve found a way to hook your 8-bit Game Boy into your new DS DIY MIDI interface, all numbers of bits will be accommodated.  I’ll be bringing my PSP with the incredible PSPSEQ onboard – which sounds utterly beautiful and is really inspiring to use. I’ll have DS homebrew, too.

If you just want to meet me and Joel and folks and see what’s possible and nerd out and have a few drinks, that goes, too!

We’re meeting at the bar at the Bell House, which also happens to be where Blip is happening. So you can come, get some drinks and snacks, and get your mobile music/visual geek on. Bonus: it’s two-for-one happy hour, so bring a friend / significant other and we’ll make them feel at home!

Bell House Food & Drink Menu

RSVP on Facebook

When: Friday, December 5, 6-8p

Where: 149 7th Street, Brooklyn, NY 11215 [Map | Directions]

See you there!

Again, very important rest of the planet, I’ll try to stream live if WiFi cooperates in the bar! Watch http://twitter.com/cdmblogs for updates.

With all this talk of mobile music creation, it’s time to get a little scientific. Which mobile digital platforms do you actually own? Which do you want to read about on CDM? We have, of course, lots of interesting stuff happening with actual mobile computers – think UMPC, Eee, and OLPC – but then, those fit nicely with other computing platforms since that’s what they are. Other handheld game systems, PDAs, and phones require real, specific attention for musicians. And naturally, this is about making music on mobile systems, not necessarily playing Mario Kart.

We need to know what you think. Your feedback will help us direct the site. Don’t worry, we still love things that no one else does, so fear not if you’re in a more obscure category – though you will want to get your votes in.

This is also a chance to sign up for our soon-to-launch email list, which we’ll use for human-created, exclusive dispatches from team CDM in a form that makes sense for our overburdened inboxes. (It won’t duplicate anything else, and it won’t be too often, and it won’t be sold to anyone else – it’s just another way for me and the team to chat with you.)

So, here goes – you’ll need to click through to the actual site to finish the survey, or head straight to:

http://www.surveygizmo.com/s/61300/yvwf9

Respond now; poll closes Monday 8/18

Photo credit: Yesrobot’s Game Boy rig, captured by Alícia