Commercial developers are now releasing music creation apps for mobile game systems, in the form of the KORG DS-10 for Nintendo DS and Rockstar’s Beaterator for PSP. But some of the best ideas still come from the homebrew community.

What’s most impressive about ToneSynthDS is not so much what it does as its interface, fitting all its functionality into the DS’ two compact screens. Its minimal interface finds an elegant arrangement of everything you most urgently need, with a sequencer screen on one DS screen and basic virtual analog synth parameters on the other. A 4 x 4 matrix next to the main sequencer grid lets you switch between patterns, in a step sequencer reminiscent of the monome and Tenori-On. There isn’t a whole lot of depth to event editing in this early version, but it could be a lovely way to sketch melodic patterns. (And some of those limitations come from the DS itself. Note, though, that this app gets a full 16 real-time channels on the original DS hardware to the Korg DS-10’s paltry two.)

Developer Fanta/Hotelsinus Sound Design has been posting mock-ups, demos, and now builds as he goes. That means that he gets feedback from an audience of readers and incorporates those as he develops the app – another key difference between the DIY/homebrew scene and conventional commercial development.

More good news: this DS app should also run as a PC VST in a forthcoming version, opening up the fun to folks using netbooks and laptops instead of the DS and creating a nice mobile-to-computer workflow.

http://ndscomposer.blogspot.com/

In related Nintendo DS news: If you’re thinking about getting the new DS-10 Plus Limited Edition of the KORG DS-10, you’ll need to get it for the region coding of your DS. (In other words, you probably won’t want to import it.) The “Dual Mode” functions are region-locked, so North American and European users can’t use the Japanese DS-10. That’s not such a big deal, as North American distribution was announced, and other regions are expected to follow, but it’s good to know. See details on the All Things KORG DS-10 blog. (Thanks, DS-10 Dominator!)

Check out some demo videos and a quick run-down on specs, and if you’ve got the capability to run homebrew, you can give this a try. Thanks to Art/toitoy for the tip!

• Two oscillators with fixed oscillators, ADSHR envelopes
• Filter section (in development)
• Ring modulation and “cross” mixing (cross-fading between oscillators)
• 16×16 step sequencer, 4×4 pattern selection

Clearly, there’s a lot of work still to be done, so test this build at your own risk. But it’s already good fun, and the coming roadmap looks logical, with filter options, disk rendering, song mode, and more in store. It’s also an interesting read as far as wrangling with emulators and some of the challenges of DS development.

Imagine a nightmarish, dark-world, alternative-reality version of Wii Music, one that sends Miyomato-san screaming. That’s what you get from tokoloten, in a very un-Nintendo noise performance, as found on comments. The Wii is just one of his tools:

tokoloten uses a variety of objects such as magnet motors, infrared devices, game controllers… in order to hide his lack of conventional technic. Depending on the venue, the show might be ambient-like, experimental or electronica with weird cinematographic references. But it most often combines all of this.
tokoloten is based in Lausanne, Switzerland.

It’s proof that the controller – any controller – is in the hands of the creator, and what it sounds like is entirely undetermined.

Mapping a hardware input to a sound means making an abstract connection between one physical action and another sonic reaction. What that relationship is is entirely up to you. I was honestly a bit surprised by some of the impassioned critical reactions to yesterday’s brief mention of the use of the Wiimote as a studio recording. Of course, that proves the creed of the blogger – post first, ask questions later, and when in doubt, just post. Amidst some of the frustration, there are some good discussions, though I do dream of an Internet on which we criticize content without name-calling.

But the reality remains: controllers are always abstracted from the sound, by definition, and whether they’re satisfying to you depends on how you’ve mapped them. I don’t know what qualifies as innovative, but then, there have been times when I’ve very much enjoyed turning a knob, so “innovation” isn’t always what matters to me. I tend to fall back on Duke Ellington – “if it sounds good, it is good.” For controllers, that means “if it feels good, it is good.” You’re the one with the controller in your hands.

For an alternative example, musician/artist Kassen has an excellent session on improvising with custom software and game controllers. Below, you can catch some of his talk from Amsterdam’s famed STEIM research center, which has a long history of researching the controller-music connection. After all these years asking that question, what we have is …more questions. But that’s a beautiful thing.

Kassen (DJ, performer, ChucK programmer) from STEIM Amsterdam on Vimeo.

Part of the reason I’ve never liked “controllerism” as a term – sorry, Moldover – is that there is no clear technique, no clear sound, no particular discipline. That is, I understand the case for the term and I’m glad there’s a discussion. But it seems to me that part of why controllerism is interesting is that there is no such thing as controllerism. The beauty of digital music is that you do have wide-open, blank-page possibilities. You can create your own system. It is abstract, simulation, ungrounded in physical reality. But while that is at odds with millenia of acoustic instrument-making, it’s also in tune with centuries of compositional and notational tradition, which are abstract. For the first time, the systems of how we conceive music can themselves become physical.

That to me is an exciting thing.

So, here’s a question — let’s take the example of sensors that handle orientation. How would you want to deal with them in music software, if they could be standardized, if any accelerometer or tilt sensor could announce its orientation? How do you decide which is the x, y, and z axis, for instance? How would you want the data normalized?

Today was full of good news for people interested in carrying pads in the palm of their hand.

Fans of the Nintendo DS in North America, the Korg DS-10 Plus synthesizer for Big N’s game system is now coming to your side of the Pacific Ocean. (That also bodes well, I think, for other parts of the world.) The DS-10 I think really deserves some credit for making a straight-up music title a hit on gaming platforms, and its success certainly surpassed my own expectations. It’s not a game, it’s not an interactive experience, it’s not a music game – it’s actually a synth and music workstation that happens to run on a game platform. The DS-10 Plus beefs up the original’s features, though it now has a commercially-available rival in the form of Rockstar’s Beaterator for PSP.

In Plus for both the DS and DSi:

• MUTE/SOLO built into the SONG mode
• EDIT/PLAY enabled for all modes within the SONG mode

Apparently DSi-exclusive (as I had speculated in the original story on the new edition):

• Twice the analog synths (4 of them, instead of 2)
• Twice the drum machines (8 instead of 4)
• Twice the tracks (12 instead of 6)
• Expanded song mode: programmable track mute, realtime editing (that is, edit parameters inside the song mode
• Two effects layers instead of just the usual effects routing (the equivalent of running two instances of DS-10)

(Previously: Korg DS-10 Plus Coming, with Beefed-Up Features for Nintendo DSi)

I’m also pleased that, if the Joystiq story confirming North American distribution is correct, only the extra effects layers require the newer-model Nintendo DSi. It sounds as though the rest of this functionality works just fine on other DS models.

Correction: As Liam notes in comments, and as I’ve clarified above, many of the new features are indeed DSi-exclusive. That means this is probably worth upgrading if you have a DSi, and a reasonable purchase if you don’t already have DS-10, but something you’ll ignore if you have a pre-DSi system and the earlier DS-10 title. Joystiq apparently mis-interpreted the press release, which is easy enough to do; it’s confusingly written.

XSEED press release

Via Joystiq’s David Hinkle:
XSEED bringing Korg DS-10 Plus to North America

Call it the 8-bit preservation society. Chipsounds is now available. It’s a new programmable soft synth, filled with custom oscillators and samples of famous and obscure vintage chips, accompanied by an EP of free chip tracks. Far from a threat to fans of hardware, I think this release is a major achievement for fans of digital sounds.

Oh yeah, and if you’ve been feeling burnt out on chip music in general, firing up some of the sound of some of these more obscure chips could well change your mind. If you like sound, there’s something here for you.

Chip music, championed by a supportive network of artists and fans, has unquestionably made the big time. But for those who value the unique sounds of a variety of vintage 8-bit chips, there is still cause for concern. Even though they’re digital circuits, the unique design of various chips won’t last forever. Some chips are simply disappearing, while others cease to work. At the same time, while the sound of the Nintendo game system has become ubiquitous, lots of other unusual chips don’t get heard. Software emulation and sample packs so far have been pretty shallow. Emulators tend not to model all the nuances of different chips, and samples are really only expressive if they’re presented in the context of something that’s fully programmable and playable.

Enter Chipsounds. Creator David Viens told us about the Chipsounds project back in January:
Authentic Chipmusic Soft Synth Emulation: Plogue Chipsounds Scoop from NAMM

It’s available today, with an introductory price of US$75 ($95 thereafter).

chipsounds @ Plogue [Product Page]

Something like Chipsounds could have been just an attempt to cash in on “what the kids are playing.” But David’s work is more like an epic love poem to the sounds of chips themselves, not only as a reminder of game music but as a unique sound source. And the passionate chip music community got in on the act, as well, with notable artists contributing to the product’s development and in fine form on the EP.

But forget about that for a second. What matters is that chipsounds is an exhaustive, exhaustively programmable set of sounds that almost no eBay budget could ever amass. It takes some unique sounds and allows you to warp them into arrangements and performance configurations not possible with hardware. And it might well make you explore hardware in a new way all over again.

For your listening pleasure, here is the full, free EP with downloadable tracks to set the mood. It’s all been made with Chipsounds by some terrific artists, including David Viens himself, and covers a range of genres and techniques.

Why Chipsounds

David has a really lovely intro in the manual for the tool. He’s got a story like many of us I expect have.

My father bought a Commodore VIC-20 for me and my brother when I was around nine. After a few days with it, I guess he knew I had found my calling. There is not a year that passes without me reminding him how bringing that computer home some cold autumn night changed my life.

But this isn’t just nostalgia. David also notes that some of the limitations imposed by earlier 8-bit hardware caused artists and musicians to invent new techniques that were later lost. These methods can now be rediscovered and coexist with new processes only possible with newer tech. What Chipsounds represents is an expanded “sonic palette,” not just the literal representation of the hardware included. And for those willing to dig into programming the sampling instrument itself, that palette can be even wider and more personal.

David did a whole lot of work on research and experimentation to make this work, but also drew upon the massive community online. Here’s a look at the chips included.

The Instruments

David did extensive research, testing, sampling, and A/B sound programming for the project. Just going through the chips is a nice history lesson – and could be a good introduction for those interested in working with hardware, too. You can check out extensive technical details on the hardware at the chipsounds blog.

SID (6581) and (8580) It’s the mother of all sound chips, and deserves the top space in this list. The SID was the legendary Commodore 64 chip, sampled in this collection at 96KHz. The 8580 I think doesn’t get nearly enough credit, so it’s nice to see both so you can hear the oddities of each.

RP2A03 (NTSC) and RP2A07 (PAL) and RP2A0X (unlimited): This is the big one – the chip in Nintendo’s NES and Famicom. It’s not actually a dedicated audio IC, but a clone of the 6502 CPU, but it still has some unique features and sounds.

DMG-CPU, SGB and DMG(unlimited) The classic: Nintendo’s own sound generator for its Game Boy handheld. Confession time: I’ve heard this chip so much that I’m starting to long for other things. But again, because the Chipsounds collection lets you create hybrid instruments in different ranges, there’s nothing stopping you from inserting DMG sounds where you wouldn’t expect. (And while functioning Game Boys are everywhere and run a variety of amazing homebrewed sequencing software, some of these other chips aren’t as accessible or portable.)

AY-3-8910 (various clocks sources), YM2149 (2Mhz): General Instruments’ sound chip was one of the great sound chips of the 8-bit gaming and computing age, found in the Intellivision, Vectrex, Atari ST, and Sinclair ZX, among many others. That means it’s critical not only to gaming fans, but also fans of the sounds in early tracking musicians, particularly on the Atari ST. It’s even got its own Wikipedia article.

D1867G The classic Casio VL-1 makes a surprise cameo in this collection. Result: you have the opportunity to imagine your own music console that combines the sounds of the VL-Tone with the IBM PCjr, and that’s a beautiful thing. The VL-1 may be the odd man out in this collection, but then, it also exemplifies the lo-fi digital sound of the 80s – and with the ARIA sampling engine, you can warp it to do things it has never done before.

P8244 (NTSC), P8245 (PAL) This is one of the rarer (or at least more unexpected) entries in the collection, the sound chip that drove the Magnavox Odyssey2. Intel’s Video Display Controller used this chip to make both graphics and sound (hmmm… could Chipgraphics be next?) For extreme nerding out, check out David’s full post on working with this chip. Unlike the other entries here, the VDC doesn’t have much documentation online for these kinds of applications.

POKEY (various clock configuration) Atari’s Doug Neubauer created sound capabilities for this chip, used in Atari’s 8-bit computers as well as many arcade games. (The POKEY actually handled not only audio, but keyboard, pots, timing, serial… Arduino fans, take note.) Which arcade games? Try Tempest, Gravitar, Gauntlet and Crystal Castles, for starters.

TIA (NTSC), TIA (PAL) and TIA (unlimited) Another combined graphics and sound chip, the Television Interface Adapter was the sonic soul of the Atari 2600. The variations here in Chipsounds give you a lot of choices, including the awesome “polynomial counters” which create different kinds of distortion. Using keyswitching, you can choose among these sounds live, ideal for keyboardists. And David has even included the sounds the TIA makes when the cartridge was improperly inserted.

SN76489(AN) (various clocks) Here’s my personal favorite: the classic Texas Instruments sound chip was dead-simple (three square wave generators and one white noise generator), but elegant, efficient, and unique in sound. The BBC Micro, IBM PCjr, and ColecoVision game system all used its sounds. I can still hear the echoes of Subroc in my sleep. (Yeah, okay, I was a bit jealous of my friends who had Apple IIs and NES instead of the more oddball PCjr and Coleco I had, but now I’m older and appreciate them more.)

Side note: David was nice enough to share some of his SN chips, so I’m working on building them into standalone hardware and will share the results.

UVI 2637(NTSC) and 2637(PAL): Now we get into the chips you probably haven’t heard. Signetics made this chip for the Arcadia 2001 console developed by Emerson (yeah, the electronics company) in the heady year of 1982, before the meltdown that would purge the home gaming market. That console was widely cloned, under names like the Interton, Leisure Vision, and MPT-03.

VIC-I : 6560 (NTSC) 6561(PAL) in various configuration Here’s another oddball chip: the VIC-I, used in the VIC-20, had 7-bit pitch range, giving you oddly-tuned scales, plus a truly strange noise generator. That strange sound is rarely heard, but leave it to the demoscene to exploit it. From the Chipsounds manual:

In 2003, a brilliant demo writer by the name of Viznut reverse-engineered this side effect, mapping all possible “weird” waveforms that the chip was able to reproduce in a deterministic manner, and put the to good use in his now famous “Robotic Liberation” demo.

Here’s a look at that creation:

The Software

Let’s get something out of the way: I believe in synths. I’m naturally skeptical of samples. If I believed for a second Chipsounds was about plugging in some sampled sounds and hitting a key and waiting, I wouldn’t have posted this article. Fortunately, Plogue’s ARIA sampling-plus-synthesis engine is powerful enough to allow immense programmability and playability. It’s loaded up with programs that model every last detail of these instruments, while also providing the possibility to create your own, unique performance configurations. Samples make up just a portion of the sound, used where appropriate, with lots of custom oscillators and modulators, as well. This is really a full-blown instrument, not just a sample library. (ARIA has previously been sampling-only, but Chipsounds is the first of a line of instruments to use synthesis, as well.)

Standalone, plug-in modes:

As a plug-in, Chipsounds works with VST on Mac and Windows, RTAS (for Pro Tools) on Mac and Windows, and Audio Units on Mac. And of course, in plug-in mode you can automate all your parameters.

In standalone mode, you have additional features: audio file recording, MIDI file playback, and even the ability to render MIDI to audio directly.

Mixing, Multis:

• Load up to eight chips/instruments per instance. (Each of those, in turn, can be made up of combinations of samples.) Maximum polyphony is suggested at about 4-5 voices for artistic reasons, but… rules are made to be broken, right?
• Assignable tuning, polyphony, mix parameters
• Reverb busing
• Key switching, which allows you to change between waveforms immediately using a key on your keyboard
• Snapshots

Sound editing:

Here’s where things get fun – and where you can do things more easily than you could with the original hardware. Even with the ARIA engine alone, you have a virtual studio of tools in which to place your samples.

• Arpeggiator for pitch, velocity: with configurable range, loop modes, gate, sync, etc.
• Wave sequencer: This allows you to sequence lists of pitches on an instrument, allowing tracker-style events inside the software. (Add your own tracker to the mix and – well, things get pretty hectic.)
• Live, high-performance oscilloscope.
• Pitch LFO (currently fixed), pitch and amplitude envelope generators.
• Effects, which currently includes only an ARIA-native port of the lovely Ambience reverb by Magnus Jonsson. (But then, the advantage of having these sounds on your computer is easy access to all your other effects.)

Still Want Hardware?

In order to make the Chipsounds collection, David spent time rigging quick hardware devices allowing the actual chips to be connected to a computer. That could make Chipsounds an affordable gateway drug into building your own standalone hardware with these chips as sound sources, as I hope to do soon with my TI SN’s. To get you started, check out the superb resources on the Midibox wiki:

Midibox SID
Midibox POKEY
MIDIbox AY 3 8912

The SID is the most common of these, but ironically finding working SIDs is getting to be much harder than finding these other unique, lovely chips.

I’m actually really interested in the possibilities of combining hardware with the open-source Arduino platform and creating devices that behave in new ways; stay tuned, and hopefully we can get a group of folks working on that.

One example – our friend little-scale aka Sebastian Tomczak of South Australia – has used the Arduino to connect to the SN chip and create a MIDI-controlled Sega Master System equivalent:
MIDI + Arduino + chip on little-scale’s blog

Add in new MIDI capabilities on the Arduino, and this gets quite interesting.

The Artists

A lovely collection of artists contributed to the EP and to the development of the software, so this is very much a release connected to the community. (David’s own music is on the EP, too.)

The artists:
8Bit Weapon
Computeher
nitro2k01
Chupathingy and on MySpace
James Mireau
XC3N
shrimps

And for more on the making of one of the tracks, GameBoy Genius aka nitro2k01 has documented the work of translating a hardcore chip track from Game Boy to computer, using Renoise. This is a pretty traditional approach to what to do with chip music, but on the other hand, once you’re in the world of Renoise, you could go in other directions, as well.

If you’re interested in anything covered here – the artists, the chips and digital synthesis history, how to use the software, or how to make some of these hardware creations – all of these topics are fair game for CDM. I promise a non-nostalgic (okay, maybe slightly nostalgic), musical approach to these topics.

In the meantime, let us know what you think of the software.

It’s drumming, the multi-player game. The Drummer is an open-source application for the Nintendo DS handheld, developed by Andrea Bianchi and Woon Seung Yeo and presented alongside a paper earlier this year at the NIME Conference (The International Conference on New Interfaces for Musical Expression). As with any Nintendo homebrew software, you’ll need a special DS cartridge capable of loading software from flash memory – though if this app were developed more, it could make a terrific DSi app.

The idea is this: while making a handheld game system into an instrument, why not take advantage of its networking features? Grab a friend (or friends) with the Nintendo DS, whip up a drum kit that’s to your liking, then play along.

Oddly, while we live in a networked, Internet age, the client-server model rarely gets applied to music. One of the things I try to explain about the protocol OSC (OpenSoundControl), aside from the fact that it doesn’t have to be about sound, is that it’s really a collection of best practices in open networking communication. It’s not simply about connecting devices to one another in serial fashion, as with MIDI, but forming a network – an idea familiar to anyone who uses instant messaging online. True, latency considerations and other complications can add another dimension of challenge. But I think there’s plenty to explore when it comes to networking devices, and it promises to make computer music a less solitary experience. The Drummer is a good step in that direction.

The Drummer project page + NIME paper
Google Code page

Thanks to Andrea for sending this our way!

Ed.: It’s more than nostalgia that drives the dedicated chip musician with their modified Nintendo instruments. As guest writer Vijith Assar learned while interviewing Anamanaguchi, some more elemental love of digital synthesis leads these artists to deal with esoteric hardware and crashing homebrewed software. Vijith covered Anamanaguchi for New York’s Village Voice, but this trio had far more geeking than could fit in the free weekly’s pages. The band’s front man and songwriter, flanked by talented NES hacker bandmates, muses on the technology and artistic process – and on why, yes, the act did have to start with blowing on the cartridges. (Surprised?) -PK

I recently had a chance to chat with Anamanaguchi, who would probably be the boy-band teen idols of the chiptune world if the scene were to tolerate such things. Lead songwriter Pete Berkman opened up about his creative process and the digital speed bumps he hits along the way, and guitarist Ary Warnaar is on another planet when it comes to working with Game Boy synths like LSDJ and Nanoloop, but the most freakish technical bits came from bassist James DeVito. He wrote later to describe in detail the customized hardware he’s cobbling together for use on tour, which so far has involved modding the Nintendo for multiple outputs, each with a bolted-on 1/4″ jack and volume knob, and integrating a tiny high-res screen lifted from a PlayStation. He’s even considering a built-in controller for the next version.

The stock NES has five channels of sound — two square waves (lead), triangle (usually for bass), noise, and DPCM sample channel. Normally, these are all mixed down to one mono output, but by tapping directly into pins 1 and 2 of the CPU, we are able to separate them into two outputs. Pin 1 on the NES CPU (2A03) contains the two square channels, and pin 2 contains the triangle, sample and noise channel. A third output is gained from a proprietary audio expansion, containing two extra square channels and a sawtooth channel. This particular one, VRC6, was designed by Konami and featured only on Japanese Famicom games. However, with development carts we are able to get the expansion audio on our NES. The extra audio chip is in the cartridge itself, and outputted directly through a pin on the cartridge. This pin is tied directly to pin 9 on the expansion port, which is where we tap in to get our third output. Directly off those pins I connected 1µf capacitors @ 50V (negative leg goes to CPU pin, positive goes to output) to protect the chips from any short circuits or power surges when plugging a cable in. From there it’s relatively simple, putting them in line with 50K pots and outputting directly to the 1/4 inch jacks out the back. The screen is all wired internally. 5V power is taken from the regulator within the screen and fed into the NES. In order to avoid problems, I cut out the 7805 regulator in the NES and applied the 5V where it needed to be. Audio and video were soldered directly to where the RCA jacks are attached to provide signal to the screen.

And what then? Well, let’s ask Pete.

Vijith: How do you do write these sequences?

Pete: It’s a [DOS] program called Nerdtracker 2 that apparently writes music in the language that the NES can understand. It’s a really home-brewed program. It was made in 1998 by a bunch of Swedish dudes, and it never got out of beta, and it’s prone to crashing, and it has all these terrible bugs in it, half the features don’t work.

And the decision to mix it with guitars?

Pete: I started messing around with it and sending songs back and forth with a friend of mine, and in the beginning, the music I wrote kind of sounded “videogamey,” but as I continued writing, my actual musical influence kind of started to get in there. And at that point, it made a lot of sense to put it as an instrument in a full live band setting, with guitars and drums and that sort of thing. Right before going to NYU, literally NYU move-in day, I released the Power Supply EP through 8bitpeoples, which I had recorded totally by myself at my house except for one track which we recorded with James. All I had was a shitty mic and a shitty guitar and a shitty amp and just recorded what I knew, without any kind of formal training.

It was made in 1998 by a bunch of Swedish dudes, and it never got out of beta, and it’s prone to crashing, and it has all these terrible bugs in it, half the features don’t work.

Do you write using a guitar or a Nintendo?

Pete: It’s a mixture of both. Certain songs, I’ll get the idea as a melody in my head. The music is pretty melodic, so it’s pretty transferable from instrument to instrument. Anything I write on guitar I can put on the Nintendo, and anything I write on the Nintendo I can usually play on guitar – unless it’s way too fast, which it usually is.

Recently, I’ve been getting more into making sounds on the Nintendo that can’t be reproduced by instruments, doing stuff that only the sound chip can do. But more or less I like to create a skeleton of the song on the NES. Ary, on the Game Boy, makes some absolutely ridiculous stuff that’s really fucking weird, like, really just straight-up the weirdest music I’ve ever heard. And the way he does it is not so much thinking musically, but technically. When I came into the 8-bit world, I was definitely the opposite. Any time there’s electronic music, you have people who are thinking technically, and usually that’s music that I’m not very interested in, because it’s kind of cold, usually. I came into the 8 bit world with a very musical background, being in bands growing up and stuff, as opposed to a programming background. But recently I’ve been getting really into making strange sounds on the Nintendo that, like, “Whoa, I didn’t know you could do that with that sound chip.” At the same time, I’m mixing that with that simple pop sensibility.

What I usually like to do is to harmonize everything. Why not? You have two square channels. What else are they going to do but harmonize each other?

James: You don’t have the option of chords, so you might as well harmonize.

Pete: I tend to get bored very easily, which kind of finds its way into the music too. Like, “Oh, here’s an idea. Oh, wait, no, it’s gone now. Now it’s totally different.” In high school, I guess I was diagnosed with ADD — whether that’s bullshit or not, which I think it is, but I’m very capricious, and I tend to jump from thing to thing, in life and in music. But yeah, basically, hyperactivity is something I do.

Basically, hyperactivity is something I do.

How does it actually work? All this time I thought it was a MidiNES, but I recently read a YouTube comment where you said that wasn’t the case.

Pete: Two years ago, I was really upset by the claim that it was MIDI, because it was such a ridiculous process that we don’t do anymore. Back then, you would make the song in Nerdtracker 2, and if you typed in a wrong filename and hit Enter, the program would just crash, and you’d lose everything you had worked on. From there, you’d have to hit Enter to create, like, four different files — temp.ihd, temp.dat, temp.dmc, and temp-dot-some-other-shit. And you’d take all those files and compile them in an NES compiler. That would give you a Nintendo Sound File. And you’d have to do this specifically in Windows 98, because the assembler for XP was fucked up, and it would give you the wrong shit, the wrong hex to burn onto a chip. What you would do from that point is turn it into a binary file, .nsf. The only command is “Play this song at this location in the EPROM’s memory.” And so what you would do from there is you would take that binary file and burn it to a special 28-pin EPROM chip that you would have to order in bulk from some electronics company in New Jersey. And then if you’re lucky, the burning worked. And then if you’re even luckier, all 28 pins are in place in the socket that you soldered into an NES cartridge. And then if you’re even luckier, the NES is willing to play the song in the cartridge — instead of having to blow on it — and then it plays. And that’s the process that we did live, with one chip for each different song, having to flip it out with a guitar pick and replace it with my shaky hands.

James: And the chips aren’t even labeled. So it was this long, complicated process.

Wait, isn’t that last problem your fault?

Pete: Yeah.

James: We’ve come a long way since then.

Pete: Yeah, we have come a long way. That’s why I was… not upset, but adamant about saying what it was. But we’ve got this new system that’s the happiest…

James [unzips case]

Pete: Yeah, we have it here. Instead of burning stuff to a chip, you just take the NSF and put it on a CompactFlash card, and put that in a cartridge that will straight-up just play the song, and has a menu. It’s a 2-gig Flash card, so you can put every song on there, and there’s an on-cartridge browser. And we have a screen hooked up to it, too.

James: The card is usually meant for development, but it also plays the Nintendo sound files that Pete exports, so we can actually just go through it and the file browser has all of our songs listed. (And every game we downloaded from a torrent.)

Ary: He’s currently working on a new Nintendo. They’re going to replace literally every electrical component.

James: Well, not everything. But just make it sound better, like improve the output.

You mean just gutting it and rebuilding it with better parts?

James: It’s more like rebuilding the audio output aspect of it, and certain things like the power supply that adds noise to the signal. It’ll have newer parts, so it’s less likely to explode on stage. With our old setup, if major vibrations were happening to it, it would actually just restart the song.

Pete: Tons of aberrations live.

Ary: And major vibrations happen a lot on stage…

Check out the band for yourself; they’re on tour now.

Vijith Assar is a musician, writer, and computer geek based in New York City. His musical projects have tended toward scores for film, television, and
advertising, and his writing has appeared in the Village Voice, the New York Post, Tape Op, Electronic Musician, and PopMatters, among others. He plays the Chapman Stick and might be going bald because of Reaktor.

For many, mobile technology and developing for the iPhone and the iPod touch is a fad and a Gold Rush. Good designers, though, take a longer view of how interaction can be expressive. And there are few people with a better sense of the big picture of small devices than Dr. Ge Wang. The co-founder, CTO, and Chief Creative Officer of Smule has a background that goes well beyond the latest Apple platform. Along with Perry Cook at Princeton, Ge Wang is the co-originator of ChucK, a real-time programming language for synthesis so efficient some people use it live onstage. (ChucK, as an open source project, now has a terrific team of people behind it.) ChucK is the sonic engine that powers Smule’s projects. Ge Wang also teaches at Stanford, working with students and fellow researchers to explore new ways of interacting with music technology.

Ge Wang joined me for a lengthy phone conversation recently. He really contextualized why the iPhone is important in the grand scheme of things, but also how the people at Smule and Stanford (and Princeton) can approach technology for musical interaction, focusing on what devices are rather than what they’re not.

(The audio here, believe it or not, is extensively edited – Ge Wang is that easy to talk to. I hope the next time it’s over beers rather than Skype.)

The full interview can be played below, or downloaded directly.

Download MP3 of the interview

Thanks to KORG and the Nano Series for their support of programming on createdigitalmusic.com.

Lastly: a video of the Smule team headquarters and playing around with Leaf Trombone for a Zelda duet!

More information:
The Mule Chronicles [Smule Blog]
http://smule.com/
Center for Computer Research in Music and Acoustics (CCRMA), Stanford University

Previously, for more on Ge Wang and CCRMA:
Make:TV Meets Stanford Musical Inventors, Feedback Piano

Video + Audio Subscriptions, iTunes Podcast

CDM is now launching regular audio content on the artists and inventors we cover as part of our series CDM Sounds. You can subscribe (and review the podcast) via iTunes, where you’ll also find our new video series:

cdm Sounds Podcast [audio]
cdm TV [video]

Or using your software of choice, subscribe directly to RSS. (I like to follow podcasts with Banshee and Winamp this way.)

We’ve fixed some transcoding issues for iPod touch/iPhone on the video podcast. Please do test this and let us know if you have any issues on your software/hardware.

This is worth posting for this line alone:

“Who needs a Natal when you’ve got a theremin!”

(If you don’t know what he’s talking about, see here.)

Yes, in case you’re looking for a creative way to practice your Theremin playing, here you go. Now, where’s our Theremin Hero game? From the description by Glasgow-based YouTuber conquerearth, previously seen using the Theremin to play “Still Alive.”

This is even more fun with two people playing! One person controls left/right, the other controls jump.

Its not just limited to the theremin. Its even possible to hook up a microphone and use your voice to control the game! Or a guitar! Or a violin!

Heres how it works:
The sound from the theremin is split into its frequency and amplitude components in real time, which are then mapped to values in a linear scale representing the X and Y axis. Pitch becomes horizontal control, and Volume becomes vertical control.
The X and Y scales are then cut up into different zones. In this case, Left; Right and dead zones for the horizontal, and a single trigger and dead zone for the vertical.

The trigger zones are then mapped onto a virtual joystick hooked into an emulator.

The end result is a fairly usable input control for playing games like mario. The bars give the much needed visual feedback as to how “in tune” you are, so you have a better feel of where the trigger points are.

I’m sure there’s a deeper meaning I could extract about gestural controllers, expressive musical instruments, and the meaning of life, but it’s Friday and it’s lunch break time. If you can do my job, feel free – add in comments. (If your cat walks across your keyboard, it’ll still probably come across as more intelligent than an average YouTube comment, so have at it!)

Well, fine, Jamie Lidell. Now you go and ruin it for the rest of us. See, none of us playing with a Nintendo DSi will possibly look as good as you do.

I jest, of course. Jamie Lidell, the wildly-talented vocalist, picks up the new, online-savvy take of the Nintendo DS and breathes cool into it. This is what Sony ads tried to do, but Jamie does masterfully. And, okay, don’t expect the built-in sound app on the DSi to do as much as it appears to be doing here – there’s quite a lot of non-real-time, non-DSi remixing going on, even though what he does do with the simple app is genius.

Thanks to Liz Revision for finding this one.

This does bring us to a burning question: Nintendo and Sony, I’m looking at you. When will we be able to run eccentric and niche music creation apps as official software on your machine? Imagine NitroTracker on the DSi download store or PSPSEQ and PSPRhythm on the Sony Store.

It’s not lost on me, either, that I’ve complained about Apple’s App Store approval for iPhone and iPod touch as being vague and inconsistent with a few apps, while Nintendo and Sony and Microsoft’s Xbox only allow a few apps to ever see distribution. But now that the game makers have online distribution, I wonder if that could change. Movie multiplexes once promised that, amidst a few dozen screens, one would show Bollywood and experimental film. Perhaps these stores could have an “enter at your own risk” category for homebrew. Sony, after all, is desperate to recover sales lost on its PSP. And I have to admit, I think homebrew is, sadly, partly at fault. Homebrew developers and users painstakingly document hacking steps because it’s the only way to get their software on the device – only to have the same system abused by people who don’t want to pay for games.

Korg came out with its DS-10 app for the Nintendo handheld officially, and it was an enormous, runaway success, spawning YouTube virals and entire bands. Now, granted, the app had a major commercial publisher behind it (AQ Interactive), adding credibility – but distribution was limited by the physical cartridge, and the app itself didn’t shy away from Big Boy, niche soft synth controls.

8-bit musicians will likely never touch the DSi, preferring the vintage Game Boy. But a few hard-core gamers are also hard-core handheld musicians. Underground is great, and there’s a certain ethos around hacking. But access isn’t such a bad thing. If just one advocate at Sony or Nintendo would consider it, I think wonderful things could happen.

Now, if you’ll excuse me, I have to see if it’s possible to get a DS homebrew music app running in an emulator on my Android.

Game Boy superstar Pixelh8 is releasing his fantastic 8-bit music software into the wild. And it’s even being picked up in music education. From True Chip Till Death:

Pixelh8 sez:

After lengthy consideration, I decided I would rather have my Game Boy / Game Boy Advance music software be used by everyone it can be used by, instead of just the few.

All of my software Music Tech V2.0, Pro Performer and more are all free for download at http://pixelh8.co.uk/software/ Enjoy! Please read the FAQ before emailing me questions about it, it’s pretty straight forward. I am doing a lot of work in music and music education, the software is now even being used in some UK schools for students to do their GCSE music composition on.

There are also new videos in his archives for your viewing pleasure. (Check out the BBC Radio 1 appearance on the Pixel8 site. And yes, that’s Radio One.)