Play Super Mario Bros. with a Theremin

This is worth posting for this line alone:

“Who needs a Natal when you’ve got a theremin!”

(If you don’t know what he’s talking about, see here.)

Yes, in case you’re looking for a creative way to practice your Theremin playing, here you go. Now, where’s our Theremin Hero game? From the description by Glasgow-based YouTuber conquerearth, previously seen using the Theremin to play “Still Alive.”

This is even more fun with two people playing! One person controls left/right, the other controls jump.

Its not just limited to the theremin. Its even possible to hook up a microphone and use your voice to control the game! Or a guitar! Or a violin!

Heres how it works:
The sound from the theremin is split into its frequency and amplitude components in real time, which are then mapped to values in a linear scale representing the X and Y axis. Pitch becomes horizontal control, and Volume becomes vertical control.
The X and Y scales are then cut up into different zones. In this case, Left; Right and dead zones for the horizontal, and a single trigger and dead zone for the vertical.

The trigger zones are then mapped onto a virtual joystick hooked into an emulator.

The end result is a fairly usable input control for playing games like mario. The bars give the much needed visual feedback as to how “in tune” you are, so you have a better feel of where the trigger points are.

I’m sure there’s a deeper meaning I could extract about gestural controllers, expressive musical instruments, and the meaning of life, but it’s Friday and it’s lunch break time. If you can do my job, feel free – add in comments. (If your cat walks across your keyboard, it’ll still probably come across as more intelligent than an average YouTube comment, so have at it!)

Jamie Lidell “Remixes” the Nintendo DSi; How About DSiTracker in an App Store?

Well, fine, Jamie Lidell. Now you go and ruin it for the rest of us. See, none of us playing with a Nintendo DSi will possibly look as good as you do.

I jest, of course. Jamie Lidell, the wildly-talented vocalist, picks up the new, online-savvy take of the Nintendo DS and breathes cool into it. This is what Sony ads tried to do, but Jamie does masterfully. And, okay, don’t expect the built-in sound app on the DSi to do as much as it appears to be doing here – there’s quite a lot of non-real-time, non-DSi remixing going on, even though what he does do with the simple app is genius.

Thanks to Liz Revision for finding this one.

This does bring us to a burning question: Nintendo and Sony, I’m looking at you. When will we be able to run eccentric and niche music creation apps as official software on your machine? Imagine NitroTracker on the DSi download store or PSPSEQ and PSPRhythm on the Sony Store.

read more

Pixelh8 Game Boy Software Now Free for Your Vintage Nintendo Handheld


Monster from Pixelh8 on Vimeo.

Game Boy superstar Pixelh8 is releasing his fantastic 8-bit music software into the wild. And it’s even being picked up in music education. From True Chip Till Death:

Pixelh8 sez:

After lengthy consideration, I decided I would rather have my Game Boy / Game Boy Advance music software be used by everyone it can be used by, instead of just the few.

All of my software Music Tech V2.0, Pro Performer and more are all free for download at http://pixelh8.co.uk/software/ Enjoy! Please read the FAQ before emailing me questions about it, it’s pretty straight forward. I am doing a lot of work in music and music education, the software is now even being used in some UK schools for students to do their GCSE music composition on.

There are also new videos in his archives for your viewing pleasure. (Check out the BBC Radio 1 appearance on the Pixel8 site. And yes, that’s Radio One.)

pixelh8

GDC: Nintendo’s Iwata on Iterative Prototypes, Teaching Programmers Rhythm

A real highlight for me at the Game Developer Conference was getting to hear Satoru Iwata deliver the keynote. Aside from being CEO of Nintendo as they have launched their most successful console ever, Iwata-san has left a sizable development legacy as a veteran of HAL Laboratory (Balloon Fight, Kirby). In the game community, I think the reception to his keynote was mixed – mostly, it introduced long-overdue storage solutions for Wiiware titles, along with some relatively minor game titles. But as a person interested in design and development – and what innovative interfaces could do for music and not just games – I found the rare insight into Nintendo’s development process inspiring.

The surprise: despite their enormous resources, Nintendo is moving to ever-smaller development teams. And they’re taking dance classes to work on their musical rhythm.

read more

Wireless MIDI on iPhone: Open Source Motion Control Talks to Nintendo DS, Computer

The Cupertino-Mushroom Kingdom gap has been closed: you can now mix and match DS and iPhone/iPod touch for wireless control of music and visuals. DSMI, the homebrew library that has enabled wireless and serial MIDI connections from the Nintendo DS, has come to iPod touch and iPhone. That means anyone building instruments and controllers on the iThing can now add wireless MIDI controllers that talk to computers – or other mobile devices, including the DS. It also means that DSMI’s acronym standing for “Nintendo DS Music Interface” has only one word that describes all the things it does.

If you’re a developer, you can grab the open source (LGPL-licensed) code. If you’re a user, apps are already supporting the new wireless features. There’s MIDI Motion Machine, which provides tilt and 16 triggers, and iXY, a 99-cent app for KAOSS Pad-style X/Y touch control. The MIDI Motion Machine author, TheRain, takes an interesting approach: there’s both a free and pay version, and the free version has source code.

iXY has one of the cleverest interfaces I’ve seen yet for something as simple as the trusted X/Y pad controller. Who says there isn’t still some room to refine interfaces?

Tobias Weyand, DSMI’s original co-creator along with TheRain, writes:

My friend TheRain has ported DSMI to the iPhone! This enables iPhone deveopers to easily integrate wireless MIDI in their applications, making it possible to control any MIDI application on the PC with the iPhone. The Wifi-to-MIDI bridge is the same DSMI server application that is also used for the DS, thus it works with Windows, OSX and Linux.
Also, like on the DS, both OSC and MIDI are supported!

DSMI for iPhone is available from our Google Code site (http://code.google.com/p/dsmi/) together with an open source example application called MIDI Motion Machine that is a tilt-based xy-controller.

The cool thing is that this library takes away all the hassle of communicating MIDI messages to the PC and makes development of MIDI controllers very very simple. So, we hope that people will use the DSMI to create a lot of innovative iPhone MIDI controller apps.

Pretty cool, isn’t it? :-)

read more