AR scratching from vanderlin on Vimeo.

“Augmented Reality” is a fancy term for describing ways of using computer vision to overlay digital intelligence on images. In other words, you can, for instance, scratch a vinyl record using a camera – plus a tag for identifying the object’s position in 3D space.

Cambridge-based designer Todd Vanderlin put together an elegant demonstration of the possibilities here, and his video has accordingly been making the rounds. (See: Synthtopia – and I actually heard about it this morning from a high school friend. The power of the Internet.)

Todd has more details on his site, which includes all kind of wonderful projects, like laser sound fountains and, always favorite around here, creepy circuit-bent baby dolls.

AR Scratching [Todd Vanderlin]

There’s actually some work to this: you need to figure out how the album is spinning. And of course, because this is augmented reality and not reality, there’s real potential here to imagine a new kind of vinyl DJing in which normal physics don’t apply.

From the video description:

I was playing around with some AR markers the other day and came up with this idea. taking just a plain old vinyl record and attaching an AR marker to the label you can track the record in 3D space. The next question was, can you scratch the record?

So by figuring out the velocity of the records rotation and applying it to the payback of the audio you can scratch. There is some digital noise that needs to bee worked out, but sounds pretty good. Its still really hard to scratch, it takes some practice but is super fun. The next step is to figure out some nice triggers for different modes. I like the idea of not needing a turntable but the actual spinning of the record helps with the scratching and playback. I made a couple modes, one where the record is paused and you can just scratch through the song. The other looks for zero velocity for x time and then continues on with the song. If there is velocity you then are scratching and the audio is affected. I think that this project has some legs can’t wait to play more.

I Want My Augmented Reality TV

So, this has sufficiently inspired you and you want more augmented reality? We’ve got more for you.

Auditorium is a fascinating free Flash game that turns interactive music arrangement into a series of puzzles. The center of the game is what the creators call “flow” – a visual stream of particles that can be directed to audio “containers” to create sound. The user places circles with icons signifying direction in the stream to redirect the particles where desired. As the stream hits the containers, it produces musical patterns. The results aren’t entirely open-ended – that is, there is a fairly fun puzzle game here, in that you can only “clear” a level by directing the flow of particles through all the objects. But the creators do claim that:

Auditorium is about the process of discovery and play. There are no right or wrong answers; there are many ways to solve every puzzle. To get started, fill up the first audio level.

playauditorium.com

SoundCloud: The Tour from SoundCloud on Vimeo.

SoundCloud, an online sharing community for sound and music, is now hours from public launch. I’ve been playing around with a closed beta for several months, and have to say, I’ve been really impressed. SoundCloud isn’t the first attempt to provide places to share music files with others, but previous attempts have been lackluster when it comes to easy sharing, features necessary to make music listening more enjoyable, and upload capacity. Most importantly, none has accomplished the community “stickiness” that has been the cornerstone of successful media services like Flickr, Vimeo, and YouTube. In fact, there’s been so much of a noise-to-signal problem with the Web space, I expect a lot of you have simply tuned out new Web services. There are some good reasons to pay attention to SoundCloud, though:

• Singing telegram, anyone? Music on SoundCloud acts more like a messaging service. Tracks from people you’re following appear in an inbox for you to sort through. You can even create a DropBox for other people, so this could be huge for people running labels or live events. (That’s especially welcome now that a lot of people have given up on individually clicking myspace links to hear what someone sounds like.)
• Easier uploads and sharing: Getting files on the service in your favorite format, with whatever length you want, is a whole lot easier than on competing services.
• Smart player interaction: Services like this now live and die on their embeddable player. SoundCloud’s is really clever and attractive. Download links are everywhere. Also, SoundCloud attacks the biggest problem with music – it’s invisible. There’s a waveform view, and people can comment on specific points in your music. That feature has been annoying in a lot of video players, but here comments appear only if you want them to, and I’ve found them really helpful in getting feedback. (See my example track below, for instance.)
• Open API: A full API means you can built interesting apps atop SoundCloud. Check out the lovely Radioclouds by Matas Petrikas for an example of how interesting this can be; source code is available.

SoundCloud, indeed, seems to have all the kinds of features that made Flickr stand out from a crowd of photo services. Labels are already onboard, too: Compost, BPitch Control, and Goldie are already making it part of their workflow, says SoundCloud.

It’s Flash 909, and Amiga Flash.

Code wizard Andre Michelle has already made a name hacking audio capabilities into Adobe Flash and ActionScript 3. We got to see his work in the form of real-time audio effects processing in the GarageBand-like online sample-and-compose interface for Splice:

Interview: How Splice.com Has Taken Music Real Audio Processing to the Web

Well, there’s more, well into the “Things Adobe Wouldn’t Normally Expect People to Do With Flash” category. There’s 8BitBoy (warning: link autoplays music), a Flash-based player for Amiga MOD tracker tunes. There’s a 909 emulation (cutely named FL-909). There’s open ActionScript 3 source called popforge [@ Google Code] with all the Flash-hacking tricks needed to do audio.

Now, the most tantalizing bit yet: Andre has a new music environment coming, and to tease its arrival, he’s put up a little application with Roland emulations and stompboxes — and it’s all part of the Rich Internet Application of the Future:

Our friend David Battino writes from O’Reilly Digital Media site to share the massive reader response they got to the Zoom H2 recorder. (The H2 is a smaller version of the H4, which made a guest appearance of sorts on Morning Edition this week.)

Mark Nelson didn’t manage to make this his fifth portable flash recorder review in Hawaii, but he made up for it in depth. His review of the Zoom H2 is almost 5,000 words and contains surround-sound links galore as well as some nifty audio examples.

What’s especially cool was that it became a collaborative review after I asked readers what features they wanted us to test when the H2 finally shipped. They piled on with questions, driving my blog to #1 on the whole O’Reilly Network. At last count, I had close to 300 comments. One reader even wrote a Mac plugin to convert the H2’s quad recordings to 5.1.

So, there you have it: mobile recording geekery can have mass appeal!

Review

Pre-discussion