Refresh: Asides

Tutorial: More iPhone/iPod Touch Control With Open-Source Pure Data

image Cesare Marilungo has sent us a draft tutorial in development on using the iPhone / iPod Touch as a controller, via the open-source patching software Pure Data (Pd). He gives examples for both mrmr, the open-source project by Eric Redlinger here in NYC, and akaRemote.app from Masayuki Akamatsu (pictured). One advantage of akaRemote: you can transmit data to it for additional on-screen feedback.

This also isn’t a bad way to learn how to use OSC (OpenSoundControl) for communication. As you can see, it’s not hard at all — and this is patching OSC behaviors from scratch. Once you have X and Y coordinates, it should be easy enough to send MIDI messages to other applications that don’t support OSC, via IAC (Inter Application Communication) on Mac or a tool like MIDI-Yoke on Windows. (Linux and Windows users, note that the interface editor for mrmr is Mac-only.)

Using an iPhone or an iPod Touch as a music/multimedia controller (with example Pd patches)

Control Music and Visuals with iPhone/iPod, Free Via Pd

The storied iThing. Photo: CC Nathan Makan, via Flickr.

Multi-touch controller goodness is now as close as your nearest iPod Touch or iPhone; all that remains is to hook it up to some creative music, visuals, or others. (I would prefer the iPod Touch for this reason; then you don’t have to worry about using it as a phone — draining the battery in the process — or needing AT&T service.)

Olle Holmberg has a new solution for using the Touch/iPhone as a controller, by translating input to OpenSoundControl (OSC) and, if you prefer, MIDI messages. He writes:

I was searching everywhere for a way to get my new iPod Touch to work like a wireless touch controller to Pd (and hence to everything else), but couldn’t find one — so I made one. It’s really just an OSC mapping for routing the default Mrmr “Performance.mmr” interface, but if you’re interested it would save you heaps of time, even though it’s not really anything difficult to make.

Mrmr is an “open protocol for mobile devices” for dynamically creating interfaces; we’ve covered it on Create Digital Motion, where vade has interviewed the creator, and we’ve seen it in action coupled with upcoming visual app 3L. Those solutions used proprietary software like Max/MSP/Jitter, though, whereas this works with the free and open source Pd. (We love Max, but having an alternative is good, especially if you just want to hook up your iPod Touch to Ableton Live or Reaktor, etc.) As far as I know, this should also mean compatibility with Windows and Linux, but maybe someone can verify that.

The Pd patch is below — homely but functional, and you can extend it if it doesn’t do what you need.

For more information and download of the first release:

PdiPod - Mrmr to Pd on iPhone & iPod Touch [on pissypaws.tumblr, Olle's blog]
Pd Forum Announcement and Discussion
Files/download

Digital Vinyl, Free and Open Source, in Max/MSP, Pd, Linux

Scratching began as a practical means by which DJs could cue records. (So say originators like Grandmaster Flash; if you’re interested in the history, check out the fantastic documentary Scratch — trailer above.) But something about the gesture, the mechanical feeling of scratching, and all that history has made the turntable compelling as a controller. It’s even taught as an instrument at Berklee.

So, what if you want to scratch for purposes other than conventional DJing?

Getting at Timecode

image Digital vinyl systems like Serato Scratch LIVE and Native Instruments Traktor Scratch are designed for DJs. Part of the whole advantage is that you get an integrated system with vinyl, decoding capability, audio interfacing with the computer, and software for DJ functions. If you want to take the turntable to other frontiers, you have to find a way to get the timecode data from the vinyl directly and do something different with it, like control an instrument or scratch visuals. (Only recently did a big-name, mainstream DVS, Serato, take on visuals, as seen on Create Digital Motion, and even then it makes some assumptions about what you want to do.)

We’ve seen a few examples of how to do this:

read more

Refresh: Asides

Pure Data + GEM Workshop in Amsterdam

pdgem

Our friend Florian Grote is giving a workshop at STEIM in Amsterdam on Pure Data, the open source patching environment that’s a close cousin to Max/MSP. Florian tells us there are a couple of spots left for anyone near STEIM. The workshop is geared for composers, live performers who want to create their own instruments, and installation/visual artists interested in working with GEM’s visual capabilities.

The workshop will start with a thorough, two-day introduction to creative audio work in Pd, and then expand its focus on the GEM extension library for Pd. With GEM, sophisticated tools for visualization are available directly inside Pd, and their handling is not different from the audio-related elements. This enables Pd users to seamlessly integrate their own visuals into their musical performances or installations, as well as to get creative with the user interfaces for their instruments.

Cost is EUR200. There’s also a class blog, which I’ll be watching closely to make up for not being out there.

Pure Data & GEM Workshop @ STEIM

Crank + Linux iPod + Pd = Deconstructed Norwegian Folk Music

We live in an age of disposable electronics. iPod battery wears out or new prettier iPod arrives, and old iPod gets tossed. Or, if you’re Norwegian sound artist and musician Espen Sommer Eide, your iPod could live a second life far more interesting than its first.

The SlÄttberg is a custom musical instrument fashioned from an iPod running Linux, pdPod, the iPod-ready version of open-source multimedia patching software Pure Data, a 60s-era loudspeaker cabinet, an internal amp, and, most importantly, a big crank. Plugged into a Moogerfooger FreqBox, the resulting instrument feels like a reimagined analog Hurdy-Gurdy. Espen says he was inspired by deconstructing Norwegian fiddle music, and it comes out in the instrument not only in the sound but in the sense this creation is something Norwegian ethnomusicologists might collect, alongside ancient Scandinavian flutes.

Those of you in Norway, let us know how the premiere goes, and what else happens at the festival — sounds terrific. Espen writes:

Hi being a regular reader of your site, and since your article about the pdpod a while back inspired me to use my old ipod for this project - I thought you might be interested to check it out. A preview video of a custom built musical instrument by Espen Sommer Eide, artist and member of Alog and Phonophani. The SlÄttberg will premiere at the Borealis Festival for contemporary music Bergen, Norway late february 2008.

alog.net

Alog, by the way, is the acclaimed duo of which Espen is one half. And anyone who makes use of Duck-Rabbits (the “famous gestalt psychological figure representing both a duck and a rabbit depending upon the point of view”) wins still more bonus points.

Pd, Max’s Free Cousin, Gets Polish and Ease in Extended Build

Photo by the talented aoifejohanna, via Flickr.

Pd, Max/MSP/Jitter’s free and open-source cousin for Mac, Windows, and Linux, has long been a favorite of software DIYers. It powers the synthesis and processing capabilities of the ReacTable project, made famous recently by Bjork. And its open nature has earned some followers even among Max/MSP/Jitter users (nothing stopping you from using both).

One thing Pd hasn’t been — even assuming you know how to patch — is easy. That’s unfortunate, because there are would-be patchers who can’t afford Max, or who want a full patching environment on Linux, or want some unique features in Pd and its libraries.

Hans-Christoph Steiner has been working for a long time on “Pd-extended”, adding a lot of that polish and documentation, and making the whole thing easier to install. There’s a major new, finished release that came out last week. “Easy” might not be the appropriate word — but “easier”, combined with “powerful” and “free”, might get your attention.

Hans-Christoph himself checks in to explain what Pd is about, and this build, even if you have no previous experience with the environment. Take it away, HC:

Pd (aka Pure Data) is one of the Max family of patcher languages. It is a close cousin of Max/MSP. Pd and Max were both created by Miller Puckette. It is a visual, dataflow programming language for sound, video, 3D, etc. Basically, anything you can do with Max/MSP, you can do with Pd. Miller Puckette started Pd as his “version 3″ of Max, and therefore there are some essential differences, but if you know Max/MSP, then Pd will be easy to learn. The Pd-extended distro is the Miller’s Pd plus the work of over a hundred contributors. It includes a large array of libraries for working with all sorts of things.

There are many features hidden inside of Pd that are basically undocumented. Typical of free software developers, the Pd devs write a lot of interesting code, but are not very good at documenting it (me included). For this release, we tried to bring more of that code to the forefront. The first part is getting it easy to install, the next part is making the documentation.

read more

Robotic Knives Patched in Pd, Circuit-Bent Graphics Cards

So, you’re really hot patching synths in Reaktor. You’ve done some interactive music in Max/MSP. You think you’re really awesome. Fine. Go up against 5VOLTCORE and their knife-stabbing robot. They stake more than a reputation on this — they tempt fate and put their hand in the way of an evil robotic arm with a blade:

5VOLTCORE site (Thanks, Anton and the Pd list.)

I shudder to think what the debugging process was like. Pd (aka Pure Data, Max/MSP’s open-source cousin) is best known for music and synth applications, and to a lesser extent, interactive visual art. But the fact that it can also run a robot’s knife play demonstrates just how versatile and essentially application-agnostic these tools are.

Lest you think there’s no musical application all this mayhem, the folks of 5VOLTCORE have found equally destructive ways of creating music — like circuit bending graphics cards:

We mount cables stripped of isolation on an audio amplifier and use these to create short circuits and faulty currents on the chips of the graphic card of a computer. The intrusion of the amplified music signal in the graphic card causes the computer to get electrical impulses on parts of the hardware that are not designed to receive them. Instead of clean 0’s and 1’s, electricity generated by analog music hits the pins - and the computer tries to interpret it. A visual stream reacting in real-time to the music is generated. We then expand the possibilities of deconstruction with the help of tools like hammers and drill machines…

read more

Refresh: Asides

Vista, Gas Masks, and Pure Data

Yes, I’m enjoying our new inter-post asides to create fabulous new non sequitur combination headlines. More on Windows Vista’s audio guts: MS developer Larry Osterman explains (well, sort of) the new audiodg.exe “host audio engine.” The DRM bit is nasty, but the good news is it doesn’t seem to have an adverse impact on music apps, which in all our early test indications and research seem to be happier under Vista performance-wise. If you’re thinking of upgrading to Vista, the good news is in-place upgrades may be just fine, even though I still say wait at least a couple of weeks and use a second hard disk partition. Put your gas mask on: build an effects processor into a gas mask for “vocal bending.” Clearly the DIY project of the week! DIY Pd software: check out this free e-book for users of the open source multimedia patching software Pure Data (Pd).