Control Music and Visuals with iPhone/iPod, Free Via Pd

The storied iThing. Photo: CC Nathan Makan, via Flickr.

Multi-touch controller goodness is now as close as your nearest iPod Touch or iPhone; all that remains is to hook it up to some creative music, visuals, or others. (I would prefer the iPod Touch for this reason; then you don’t have to worry about using it as a phone — draining the battery in the process — or needing AT&T service.)

Olle Holmberg has a new solution for using the Touch/iPhone as a controller, by translating input to OpenSoundControl (OSC) and, if you prefer, MIDI messages. He writes:

I was searching everywhere for a way to get my new iPod Touch to work like a wireless touch controller to Pd (and hence to everything else), but couldn’t find one — so I made one. It’s really just an OSC mapping for routing the default Mrmr “Performance.mmr” interface, but if you’re interested it would save you heaps of time, even though it’s not really anything difficult to make.

Mrmr is an “open protocol for mobile devices” for dynamically creating interfaces; we’ve covered it on Create Digital Motion, where vade has interviewed the creator, and we’ve seen it in action coupled with upcoming visual app 3L. Those solutions used proprietary software like Max/MSP/Jitter, though, whereas this works with the free and open source Pd. (We love Max, but having an alternative is good, especially if you just want to hook up your iPod Touch to Ableton Live or Reaktor, etc.) As far as I know, this should also mean compatibility with Windows and Linux, but maybe someone can verify that.

The Pd patch is below — homely but functional, and you can extend it if it doesn’t do what you need.

For more information and download of the first release:

PdiPod - Mrmr to Pd on iPhone & iPod Touch [on pissypaws.tumblr, Olle's blog]
Pd Forum Announcement and Discussion
Files/download

Digital Vinyl, Free and Open Source, in Max/MSP, Pd, Linux

Scratching began as a practical means by which DJs could cue records. (So say originators like Grandmaster Flash; if you’re interested in the history, check out the fantastic documentary Scratch — trailer above.) But something about the gesture, the mechanical feeling of scratching, and all that history has made the turntable compelling as a controller. It’s even taught as an instrument at Berklee.

So, what if you want to scratch for purposes other than conventional DJing?

Getting at Timecode

image Digital vinyl systems like Serato Scratch LIVE and Native Instruments Traktor Scratch are designed for DJs. Part of the whole advantage is that you get an integrated system with vinyl, decoding capability, audio interfacing with the computer, and software for DJ functions. If you want to take the turntable to other frontiers, you have to find a way to get the timecode data from the vinyl directly and do something different with it, like control an instrument or scratch visuals. (Only recently did a big-name, mainstream DVS, Serato, take on visuals, as seen on Create Digital Motion, and even then it makes some assumptions about what you want to do.)

We’ve seen a few examples of how to do this:

read more

Gorgeous and Out-there New Art and Music, Inspired by Radiohead


Weird Fishes: Arpeggi from flight404 on Vimeo.

Plenty of bands have jumped on the "remix generation" bandwagon, releasing music to be remixed and sampled and visualized as a publicity stunt. But, then, plenty of bands aren’t Radiohead. Readers here may have been disappointed that our favorite superband didn’t embrace Creative Commons sharing when announcing their iTunes-only stems. But a number of the artists we follow came up with some brilliant work.

In Visuals: Robert Hodgin, aka Flight404, has the enviable job of exploring new visual expressions as his day gig of sorts. Working primarily in code developed in the open-source, Java-powered Processing, he develops a technique and then iterates and iterates on it until it goes from computer gimmick to refined artistry. He blogs that process, as well, pushing forward the rest of the Processing community. His video above uses abstract, generative processes to visualize Radiohead’s "Weird Fishes", but is developed enough to become organic. It’s a voyage under the sea. Via our sister site, Create Digital Motion.

In Music: A number of readers tackled the Radiohead remix contest. Here’s my favorite: our friend Alan Molina created a sparse string accompaniment that spotlights Tom Yorke’s vocal part. He explains:

Thanks for listening!  I actually recorded and mixed all the strings.  

They are all a violin (just lots of layers of me).  My profession is an orchestral violinist–this remix was an outlet to do something different!

I used Ableton Live 7 for the effects, and used  the kind of mic that clips on behind the bridge of a violin.  Done on my couch in front of my computer!

Of course, the other direction to go is stretching the tune past the point of recognizability, with strange bizarro-universe remixes pulling the tune to experimental glitch and faux-punk. Here are a few of the more unusual takes on their music:

read more

Ground Control Broadcasting Now: Space-tacular Music + Motion on yuricdm.com

I’ll be live from the hangar, working to connect you virtually from around the globe. Photo: Scott Beale / Laughing Squid.

Hello from Ground Control: this week, I’ll be coming to you live from CDM’s micro-blog for Yuri’s Night Bay Area, ground zero for the global space rave celebrating human exploration of the cosmos. CDM’s challenge: to bring all the goodness up close and personal to you, from California to wherever you are on Planet Earth.

yuricdmWatch the minisite now, during the event, and in the couple of weeks following at:

http://yuricdm.com

or subscribe to the yuricdm.com RSS feed.

Yuri’s Night needs special nerdster love for a number of key reasons — a huge lineup of music, art, and science, plus a special CDM event and booth:

  • Music: The likes of Amon Tobin, Tycho, Christopher Willits, and many others … and our friend Ganucheau, too
  • Motion: Interactive installations and visualists everywhere, including our man Joshua with his incredible Wii-powered SuperDraw, built with Processing
  • Space and Science and Games: Here’s where I get especially excited — it’s an event on the airfield at Ames Research Center, not typically a place non-NASA employees can go, and we actually get to play there and listen some of the world’s top scientists. And Will Wright (creator of SimCity, Sims, and the upcoming Spore with its generative music) will be there, too, just in case your geek circuits weren’t overloaded yet.
  • CDM @ the Hangar: We’re running a special Futuristic Music Design Challenge competition, and we’ll have the CDM booth for much of the evening where various musical / visual makers will be showing off their inventions (with more of our friends elsewhere at the event). So stop by and say hi.

read more

Musical Brain API: An API for Music on the Web - And it Makes Pretty Pictures

matmossupreme

Everything has an “API” these days, but what that means in practice is often not so exciting. You can make little widgets for Facebook, or post recent Twitter messages, or do other simple developer tricks. Echo Nest’s “Musical Brain” API is more far-reaching: it’s an API for music. All music online. The first of a series of developer tools, “Analyze” is designed to describe music the way you hear it, figuring out tempo, beats, time signature, song sections, timbre, key, and even musical patterns. More developer tools will follow.

Twelve years in development, the Musical Brain is a bit like a digital music blogger. It’s been crawling the Web while you sleep, reading blog posts, listening to music to extract musically-meaningful attributes, and even predicting music trends. It’s like almost like a robotic, algorithmic Pitchfork. (And I’m serious — it may be April Fools’ Day, but this is real. That’s what the “brain” claims to do, backed by research at UC Berkeley, Columbia, and MIT.)

What does all of this mean? The Musical Brain may not be replacing your friendly local music blog any time soon, but what it can do is infuse some musical intelligence into applications like music visualization. The Matmos album at top used the Analyze algorithm to map the timbral profiles of songs on an upcoming album; that graph was then rendered by an artist in watercolor, translating the digital into traditional paint media.

The Analyze API could also enable everything from Web music apps and mash-ups to live audiovisual performance tools, or even smarter music games. That’s the reason co-creators Brian Whitman and Tristan Jehan, both with PhDs from the MIT Media Lab, chose to open up development to a broad audience. I got to speak to Brian a bit about the project.

read more

Music Video of the Week: Justice Sends Up Vintage Graphics

Daft who? In case you haven’t heard, the “it” French duo of the moment is Justice. Sure, they may not have a giant light-up pyramid on tour, but, their new album was one of the records we couldn’t stop listening to in 2007 (as opposed to Daft Punk, still riding the momentum of tunes we haven’t gotten out of our heads in years). Their new video is terrific eye candy for those with fond memories of 1980s bumpers, the sparkly titles aired by movie studios and cable TV networks. Good times.

 

I enjoyed this enough that I was curious if readers could spot nods to other spots (the UA logo is in there, for one):

From an Age Before CG: Justice Video Recalls Vintage HBO Motion Graphics [Create Digital Motion]

Now, with all of those, erm, words in this video, I’m sure fans will soon be labeling various body parts and doing their own videos.

Refresh: Asides

Jeane Poole Reviews Live 7, Suite, with Handy Resource Round-up

abletonlive7

Our friend Jeane Poole, who hails from the island continent pictured in the screen grab, has a terrific overview review of Live 7 — the upgraded app and suite. And, bonus, there’s some good resources for plug-ins and learning, to boot. The verdict:

read more

Ableton Live Does Frame-By-Frame Animation

Squarely in the “things Ableton Live was not necessarily built to do”: animating visuals, one frame at a time.

Cousin Throckmorton whipped up a retro visual feast of Space Invaders, Pong, and other games classics, using MIDI to step through frames individually.

You can MIDI sequence Live’s locators to jump between frames, thereby giving the effect of animation. Sprites/frames are drawn using blank MIDI clips; unfortunately, the resolution is limited by the Y-axis size, as Live doesn’t allow you to resize that. Live’s skins are somewhat tied to MIDI already, so you can “ride” the skins field to change background colors (it updates on midi notes on(?) Audio track is made of samples of video games, trails effect at end achieved via hacked Live skin. Sets/skins available for you to toy with at my myspace: myspace.com/cousinthrockmorton

Mind you, this is unlikely to shake the visualists on Create Digital Motion from specialized tools for visuals — and you could just as easily (uh, scratch that for far more easily) use MIDI to trigger a visual app. But the work is really incredible, and I think as Live grows in ubiquity, users will increasingly show their Live chops by hacking harder than ever before.

And for the record, this is the same Throckmorton who gave us a ribbon controller made from a drivers’ license, a drum made from a laser, and pennies as drum pads, among others. More MIDI-as-visual-control tips, too:

db3ll Channel

Prescient spam comment: “i am so lonely, i just broke up with my ex” says cutechick90201. Worry not, uh, imaginary cutechick. You’ll be surrounded by boys as you seduce them with the siren song of your drivers’ license.

Thanks, Cousin!

NAMM: Unofficial CDM Afterparty, Live in LA, Friday Night

namm_afterparty

Friday we’re pleased to co-host a party with trash_audio and vjkungfu.tv in Mid-City Los Angeles. If you’re in LA or visiting NAMM in Anaheim, you won’t want to miss this - Richard Devine headlining, terrific music and live visuals, and workshops.

If you don’t know the other two sites, by the way, trash_audio (featuring Richard, Justin, and Deep Element) is a fantastic blog that regularly profiles creative workspaces for music. vjkungfu.tv, helmed by VJ momo the monster, has in-depth video tutorials for live visualists; we hope to feature it more on createdigitalmotion.com in the near future.

Here’s the lineup:

1. MAKE + MINGLE. 8:00pm.

  • Bring your own DIY music or motion creations and other hardware toys and geek out with an international crowd of hipster-nerdsters! All projects welcome (space first come, first served — think small, bring portable speakers if you can
  • Put together free kits to make your own ribbon controllers without soldering
  • Learn how Bryant Davis Place (future-tense-cpu) built his own DIY VJ sequencer for M8 using the Lemur multi-touch controller.
  • Learn about the wonders of wireless MIDI sync in AV Performance with Acid&Bass&Momo producing a live remix of Karate Kid.

2. MIX + MASH. 9:30pm.

RICHARD DEVINE
The Deep Element
Justin McGrath
Liz Revision (Quantazelle)
Moldover
dj halon (Fake Science, False Profit)

Visuals:
Image8nineteen (Mat Hale)
Momo the Monster
Peter Kirn

read more

Refresh: Asides

Block Rocking Blocks: Latest in Visualism from Create Digital Motion

Digitalists can’t be satisfied with the aural alone, so for visuals, here’s the latest from CDMusic’s sister site:

UnitedVisualArtists blow us away with more elegant digital art, including the new generative visuals seen above for Chemical Brothers.

Jaymis has good times experimenting with slow motion on his new Sony camera; now gorgeous motion from butterflies is the domain of consumers as well as big-budget nature programs.

And in other news: top-shelf hard drive RAIDs, our own Jitterist vade talks about his work, remembering Doc Bailey’s spectacular work, what’s new (or isn’t all that new) in Jitter for Max 5, I get set straight on intelligent mirrors, and virtual access to the best cutting-edge techniques from visual mecca SIGGRAPH.

We’re pleased to welcome Dan Winckler to our team on CDMo, and we look forward to kicking this site’s little sibling into high gear. Musicians: visualists are your friends!