Augmented Reality DJ: Scratch it with a Camera, Plus AR Resources


AR scratching from vanderlin on Vimeo.

“Augmented Reality” is a fancy term for describing ways of using computer vision to overlay digital intelligence on images. In other words, you can, for instance, scratch a vinyl record using a camera – plus a tag for identifying the object’s position in 3D space.

Cambridge-based designer Todd Vanderlin put together an elegant demonstration of the possibilities here, and his video has accordingly been making the rounds. (See: Synthtopia – and I actually heard about it this morning from a high school friend. The power of the Internet.)

Todd has more details on his site, which includes all kind of wonderful projects, like laser sound fountains and, always favorite around here, creepy circuit-bent baby dolls.

AR Scratching [Todd Vanderlin]

There’s actually some work to this: you need to figure out how the album is spinning. And of course, because this is augmented reality and not reality, there’s real potential here to imagine a new kind of vinyl DJing in which normal physics don’t apply.

From the video description:

I was playing around with some AR markers the other day and came up with this idea. taking just a plain old vinyl record and attaching an AR marker to the label you can track the record in 3D space. The next question was, can you scratch the record?

So by figuring out the velocity of the records rotation and applying it to the payback of the audio you can scratch. There is some digital noise that needs to bee worked out, but sounds pretty good. Its still really hard to scratch, it takes some practice but is super fun. The next step is to figure out some nice triggers for different modes. I like the idea of not needing a turntable but the actual spinning of the record helps with the scratching and playback. I made a couple modes, one where the record is paused and you can just scratch through the song. The other looks for zero velocity for x time and then continues on with the song. If there is velocity you then are scratching and the audio is affected. I think that this project has some legs can’t wait to play more.

I Want My Augmented Reality TV

So, this has sufficiently inspired you and you want more augmented reality? We’ve got more for you.

read more

Ableton Live 8 Misuse: Ping Pong Psuedo Scratching Effect Video Tutorial

For all the emphasis on learning how to use creative tools the proper way, it’s often when you misuse a feature that it really becomes a powerful tool. So, in the spirit of some of the “mistutorials” from Ableton’s own Dennis DeSantis, here’s our friend Michael Hatsis of New York’s Track Team Audio / Warper Party / Dubspot with a really unusual way to achieve scratching effects.

You know the Ping Pong effect for its clichéd, stereo-panning echo effects. But here, it goes an entirely different direction: now that Live 8 has added new delay modes, you can create some special effects that don’t sound like the typical effect. Mike manages to warp and bend Ping Pong into something that sounds a lot like scratching. He warns that “this is not meant to replace vinyl nor will it produce a totally authentic sounding scratch sound.” On the other hand, you start to get some sounds that are reminiscent of scratching but sound unique, which I think is a Very Good Thing.

Live 8 users, download the template:

http://www.trackteamaudio.com/videos/scratchtemplatelive8.zip

There’s also some nice discussion happening over on the Ableton blog. (Main request: automation / dummy clips for more sound-warping power.)

Video: Total misuse of a ping pong delay – scratch effects

(And those of you Pd/Max/SuperCollider/Chuck/Reaktor users out there, maybe this will inspire some DIY effects along similar lines.)

Previously:

Ableton Live 8 Creative Tutorial Videos: Using and Misusing Groove Extraction

Ableton Live 8 Creative Tutorial Videos: Misusing Frequency Shifter

(and, yes, much as I love Live 8, I welcome other tools, too – anyone interested in tutorials to request / tutorials you want to make?)

Fretless Fader DJ Video: Slide the Crossfader, Slide the Pitch

Ted Pallas sends along this terrific video of a hacked hardware crossfader, created by John Beez, that slides up and down on rails. Slide the crossfader itself vertically, and you change the pitch. It’s always fascinating to see this kind of solution — a bit like the keyboards that added pitch bend by letting you move the keys in latitudinal motion.

And, for a little extra something, he adds a talkbox, too. The only problem with the talkbox: a tube in your mouth is not the world’s most flattering physical interface.

From the description:

This is the first public view of the Fretless Fader system I designed for use with the Controller One (posted February 22, 2009). With this you can cut and change notes through 2 octaves without taking your hands away from the vinyl and fader. Big thanks to Gizmo at skratchworx.com for the feature! Stay tuned for an in depth look in the next vid.

Check out my band – Blount Harvey
http://www.myspace.com/blountharvey

Seen other attempts to do similar things? Let us know.

A Dreamy Prototype for Ableton Live Control Finally Mimics UI

Ableton Live controllers are suddenly everywhere, in commercial products and DIY creations. But an in-progress prototype being designed by Serbia-based creator Sasa Djuric, found on the CDM Flickr pool, goes the extra distance to integrate more effectively with the software. The hardware looks more like the on-screen UI, for starters – an elusive objective for many controllers. And by working with the Mackie Control protocol, Sasa is able to make communication between hardware and software fully bi-directional, so the controller gives you essential feedback. There’s even a facility for scratching. The design is based on the popular MIDIbox platform.

Sasa writes with details of what the creation process is like. It’s all still very much in progress, so we’re really excited to see how it evolves into a finished design.

Sasa explains (with videos to follow):

read more

NAMM: NI Traktor Scratch, Audio 8 DJ, You Know, for Turntablists

Traktor + vinyl + audio interface = Traktor Scratch. And while NAMM is cluttered with new DJ gear, this one deserves special attention. The audio interface alone may be worth a look, whatever system you use.

Months after they cut the cord with long-time partner Stanton and Final Scratch, Native Instruments is not surprisingly back with their own vinyl control solution, Traktor Scratch, and a new audio interface, the Audio 8 DJ.

Here’s the basic specs on the system, and our take on the whole system — including why we’re eager to test it:

read more