Nintendo Wii Fit: More Bizarre Music Controllers to Come?

Nintendo keeps cooking up innovative new control schemes for its Nintendo Wii console. And if the Wii controller was any indication, you can expect musicians, DJs, and artists will be taking up this latest controller shortly after it’s available. The Wii Fit controller is a force-sensing panel the player stands on; it’s used to measure weight and balance. “Ah, just what I need during a workout,” you say, “an always-on scale to demoralize me.” Amazingly, though, this simple controller is used for some pretty impressive controls, from balance for yoga to leaning weight in one direction or another.

Foot-based controllers are a wonderful thing for music, because we usually greatly overburden our hands with tasks — play guitars and keyboards, twist knobs, run faders, etc. It’s not hard to imagine the Wii Fit board as an expression controller, in place of a pedal. And it shouldn’t be hard to get data out of it, either, since it looks like it also uses Bluetooth, just as the Wii controller does. (Musicians and DJs, among others, have happily employed the Wii remote in creative applications for Mac, Linux, and Windows.)

Previous Wii Coverage on CDM

While we wait, though, I’d like to ask another question: does anyone know of creative uses of foot controllers for music over the years? Most of what the Wii remote does had been done previously in various forms by music researchers, composers, and inventors, up to a couple of decades before Nintendo shipped their remote. That’s not to say Nintendo was ripping off their efforts; on the contrary, it suggests the design of controllers is more than just fad and will continue to evolve.

So — fabulous foot inventions? We’d love to hear them.

Wii DJs Scratching with Traktor on Wiij, and Wii, Wii Everywhere?

Is the Wii controller the new mouse? They’re starting to pop up all over the place, with all sorts of applications. As the villain in Pixar’s The Incredibles says at the end of the film, “When everyone’s super, no one is.” The related principle is, “When everyone has a gimmick, it’s not a gimmick any more.” Result: the gimmick disappears, and people focus instead on sounds and (in the case of Wii) the fun of moving around. And that’s a very good thing. (Hey, we got far more mileage out of the darned mouse than we every should have.)

We saw a proof of concept scratching using SuperCollider and the Wii remote a few months ago. I enjoyed that the results were sonically a little strange. But our friends at DJWiiJ now have more practical scratching set up with Traktor.

More details:

Wiij Scratching Now a Reality - Demo Video Provided

Yes, turntablists, I know — it doesn’t sound so much like normal scratching. As one commenter noted here, though, if you want vinyl, just use vinyl. Here, there’s almost a cartoon-like, digital scratching effect, like what turntablism would sound like in a universe with different physics than our own. This also demonstrates what can be possible with a different controller: you can differentiate what you’re doing in terms of custom software or software setups and … well, practice. DJ ! says he’s practicing, for his part.

Keep the examples coming. Oh, and CDM isn’t becoming the all Wii, all the time network — I’m still catching up after a long weekend, but more soon. I’m hoping you’re also catching up on work, so we’re kinda even.

What? You actually still want more Wii DJing? Fine…

read more

Refresh: Asides

Wii Control for Macs: OSCulator, for OSC, MIDI, and Keystrokes

I must make a correction and clarification in regards to OSCulator, the Mac utility for connecting to Nintendo’s Wii remote, which I mentioned in today’s Deckadance story. Despite the name, it supports the broadly-available MIDI as well as (for programs like Max/MSP, Pd, Flash, Director, Traktor, Reaktor, Processing, and others) OpenSoundControl. Simon Balarbe writes us:

It does not just support Osc but It outputs Midi and keystrokes also … Recently I used it with Ableton Live in a live Electro Acoustic Performance at University. I find it more stable than WiitoMidi and it had MIDI output and use of the accelerometer before WiitoMidi.

Fair enough! So there you have it: grab a Mac with Bluetooth support, a Wii remote, and OSCulator, and you ought to be able to communicate with any software you like — even if you can’t do MIDI, you can do keystrokes.

Most of my time I’ve been using the aka.wiiremote external for Max/MSP, just because that’s convenient if you’re a Max user. But for all other Mac users, OSCulator indeed looks like the most versatile choice.

OSCulator Wiki/Project Page [Mac software]

Deckadance DJ App Update Supports Wii Remote, Other Goodies

Wii remote as music controller

The Wii remote as music controller is gradually going from being a novelty to being standard equipment.

Deckadance, the DJ software from Fruity Loops creators Image Line, has only just come out and already has its first update. 1.10 is a big jump. Updates to the Ms. Pinky SDK support means it can now support absolute mode timecode (so you can needle drop anywhere you like), not only for Ms. Pinky vinyl but also M-Audio Torq and PCDJ, both of which are based on Ms. Pinky. There’s also an adjusted interface and updated playlist, among other bugfixes and enhancements.

The most interesting addition, though: it now natively supports the Wii remote from Nintendo. WiiJ, anyone?

Of course, you don’t need Deckadance to DJ with a Wii remote. On Windows, you can use GlovePIE, allowing for custom scripting. And on Mac, the most elegant solution is probably OSCulator, which translates to OpenSoundControl data, MIDI, and keystrokes. (Traktor, for one, supports both OSC and MIDI, though I haven’t yet tried OSCulator with it; I did have some issues using NI’s OSC implementation in Reaktor when I tried it. Update: you could use OSCulator and MIDI if OSC isn’t your cup of tea — more below.) For MIDI compatibility only, there’s also WiitoMIDI.

But I think built-in support in Deckadance is an interesting development. I’ve heard rumblings about Wii controller support showing up in other applications, as well, including VJ software. That means the Wii remote won’t be so much of a novelty in performance — meaning we’ll all have to actually learn to play with the thing skillfully. But maybe that’s a very good thing.

Thanks to Alexandre Guillet in Paris for the tip!

Updated: OSCulator the best choice for Mac MIDI, too? I erroneously implied OSCulator was for OSC only and not MIDI; if you’re on the Mac and wanting to use a Wii remote, see my separate note about OSCulator.

As for the Deckadance implementation itself, Wiij.com isn’t so impressed. I hope Image Line takes him up on his offer of help.

Wii Remote Scratching Proof-of-Concept on Open-Source SuperCollider

In case you missed this in comments, CDM reader Trademark has rigged a quick demo of how scratching with the Nintendo Wii remote might work. To manipulate the audio, he’s using the open source Mac/Linux audio programming environment SuperCollier:

If you think of this as a replacement for vinyl, you’ll naturally be disappointed. (The same is true of those plastic jog wheels.) But, while this lacks the control needed for DJing, what it does demonstrate is the accuracy of the acceleration data from the Wii and other similar accelerometer sensors. In fact, you can think of the scratching as a sonification of that movement. I expect more projects may soon grow out of new ways of assigning sound to gesture in the future — and, as proof of concept, this is impressive. Keep them coming; thanks, Trademark!

DIY Sensor Lovers: New Bluetooth, Ethernet, DMX Arduinos, More Resources

If you’re planning to build a creative new instrument or interface for music, and you don’t already have the open source Arduino project on your watch list, you should put it there. Chris O’Shea at Pixelsumo brings some great new goodies for Arduino lovers via the Italian project site / tutorial site / shop Tinker.it:

read more