Multi-Player Drumming: Handheld Open-Source Music for Nintendo DS

It’s drumming, the multi-player game. The Drummer is an open-source application for the Nintendo DS handheld, developed by Andrea Bianchi and Woon Seung Yeo and presented alongside a paper earlier this year at the NIME Conference (The International Conference on New Interfaces for Musical Expression). As with any Nintendo homebrew software, you’ll need a special DS cartridge capable of loading software from flash memory – though if this app were developed more, it could make a terrific DSi app.

The idea is this: while making a handheld game system into an instrument, why not take advantage of its networking features? Grab a friend (or friends) with the Nintendo DS, whip up a drum kit that’s to your liking, then play along.

Oddly, while we live in a networked, Internet age, the client-server model rarely gets applied to music.

read more

Tweak and Tweet: Make and Share Synth Sounds with Twitter


Tweet A Sound: getting started tutorial from Andrew Spitz on Vimeo.

You probably think of social networking and messaging as being about text, about saying things like “Wow, this tuna salad sandwich I’m having for lunch is delicious!” But the next Tweet you get on Twitter could be a synthesis preset.

Say what?

Working in Max/MSP, Andrew Spitz has developed a tool called Tweet a Sound. It uses Twitter as a communications platform for “social sound design.” Instead of just saying, “Wow, I be makin’ phat basslines,” you can actually share the sound. Whip up a sound using typical FM synth parameters and Max/MSP’s sound engine, then click “send.” You’ll send a string of numbers to your Twitter account, confusing those friends not in the know. But other users will be able to grab and play with your sound.

Andrew even encourages synthesis n00bs to play without fear – grab those envelopes and mysterious-looking settings and see what comes out. So, I hope you synth geeks do share this with some friends new to synthesis, as I think they’ll have a great time.

Right now, Tweet a Sound is Mac-only; we just need someone to save a Windows standalone version. Someone has asked about a Pd port, but let’s put it this way: this is the tip of a very, very big iceberg of sharing. It’s something worth considering in anything you’re doing, not just with Twitter, but whether you can provide networked capabilities in whatever you’re happening to build.

Ableton, of course, recently added the Share functionality to Live. But with open APIs and basic networking protocols, there’s no reason you can’t explore other features. Why not build a drum machine that lets you collaborate with one of your friends on your IM list, or a sequencer that automatically posts ideas as you revise them? Just doing these things for the sake of it could be a waste of time, but on the other hand, these social features could turn Web 2.0 sites into places that actually inspire you to make and share music rather than distract you with mundane activities.

I love the idea; let us know if you have some fun with it.

Tweet A Sound { sound + software } [Andrew Spitz Blog]

TUIO Multitouch for iPhone: Browser App Hack Replaces Rejected App


MSAFluid for processing (Controlled by iPhone) from Memo Akten on Vimeo.

TUIO is a simple but powerful emerging protocol for multitouch control for live music and visuals, as used on the powerful live tangible synth reacTable. Apparently no one told Apple, however. While the App Store rubber-stamps useless toys like fake cigarette lighter flames, they bizarrely rejected a powerful application by a leading digital artist that would enable standardized TUIO control – for free. (More back story below; see an example in action above.)

As a blogger, my reaction is usually to whine and pontificate, for better or worse. The engineering approach would be to find some hack away the problem. That’s what Andrew Turley did with the TUIO protocol. So, Apple won’t allow an app that does the trick? Why not go back to what developers did before the SDK, and just use the iPhone browser?

As Andrew explains it:

After reading the story I started thinking about seeing how far one could push Safari as an application platform, using web apps to get around Apple’s tight control of the app store. Since you would be connecting to another computer anyway to use an OSC application, why not just have the app be a web app running on a web server somewhere on the local network? The web server can then take care of things like sending out OSC messages or playing music or doing whatever it is people want to do.

To that end I created a little system that implements the TUIO protocol. You use an iPhone to run a web app, which in turn talks to the web server, which in turn sends OSC messages.

 

read more

Smule Leaf Virtual Trombone for iPhone: Multiplayer Judging Fuses Instrument, Game

leaftrombone

Smule, the folks who brought simulated Ocarina to the iPhone, are now thinking multiplayer. Instead of just playing a machine or a few of your friends as in Guitar Hero or Rock Band, Smule’s latest app turns your creations into a reality show with online judging. And the killer app itself? It’s a simulated, touch trombone.

It’s pretty wacky stuff, but Smule’s had some hits on their hands already, so I think the wackiness may be part of their secret. And it comes from a heavy hitter: Dr. Ge Wang, the founder, is also a professor at Stanford’s CCARMA research center, director of the Stanford Laptop Orchestra (SLORK to the East Coast’s PLORK), and creator of the ChucK Programming Language.

New in this version:

  • Teaching tools: Floating leaves guide first-time musicians to learn songs in “self tutorial” mode, and a browser-based composition tool helps teach you to compose.
  • Global judging: Online audiences can judge songs with emoticons and text and a 1-10 scale. Everything is integrated with the app itself (see image). Tromboning with the Stars, anyone?
  • The Power of Silliness: The most important feature, though, may be that everyone sounds a little goofy playing it, which can actually be liberating. As Dr. Ge Wang puts it, “It’s like singing in the shower.” Well, except with judges.

The app is simple, but the concept I think is pretty remarkable. We’ve seen interactive instruments, and we’ve seen music games. By adding the judging element, though, this is a free-form instrument that can also be a game. Now, without getting too ahead of ourselves, you could do the same thing with a Worldwide Online Kazoo Contest. In fact, maybe that’s a great idea. I suppose you could say music itself can be a kind of social game, played out on a stage. But nonetheless, making it an iPhone app can help free people up to get that message.

Oh, yeah, and got any doubts about the business model for open source? ChucK is a completely free, ridiculously powerful programming language for synthesis. It’s infinitely deeper than Leaf Trombone. But that power, packaged for a broad audience, can become a hit business – and likely to be popular well beyond musicians. If that’s possible, I imagine more could be soon. Remember, too, that whatever the Apple fanboys tell you, the iPhone is not a dominant mobile platform – nowhere close. Apple’s proprietary hardware means it isn’t really intended to be.

I hope someone working on platforms like Symbian and Google Android takes note: pack in geeky, nuclear-powered synthesis features, and people will find ways to put them to use in consumer apps that appeal to everyone. Leave them out, and you miss the boat. Or the trombone, anyway.

Direct iTunes App Link [99 cents]

http://smule.com/

Now, some very amusing videos of this thing in action:

read more

Crowdsourced Vocal Synthesis: 2000 People Singing “Daisy Bell”


Bicycle Built for Two Thousand from Aaron on Vimeo.

The song “Daisy Bell” has a special place in computer history. Max Mathews, who had by the late 50s pioneered digital synthesis using IBM 704 mainframe, arranged the tune in 1961 for vocoder-derived vocal synthesis technology on technology developed by John Larry Kelly, Jr.. Kelly himself is better known for applying number theory to investing in the markets — an unfortunate achievement in the wake of a financial collapse brought down by misuse of mathematical theory.

In 1962, Arthur C. Clarke happened to hear the 704 singing the Mathews/Kelly “Daisy Bell,” and the rest is (fictional) history – the HAL computer in the book and movie sings the song as he is being disconnected, as though the computer had learned this song as a “child.”

Here’s Max himself (namesake for Max, the patching language), overseeing a rendition of his arrangement:

read more