Hypo Chrysos live at Trendelenburg AV Festival, Gijon, Spain, December 2011.

From Your Body to Music: Interview with Biophysical Xth Sense Interface Creator

What you’re watching in the video above doesn’t involve cameras or motion sensors. It’s the kind of brain-to-machine, body-to-interaction interface most of us associate with science fiction. And while the technology has made the occasional appearance in unusual, niche commercial applications, it’s poised now to blow wide open for music – open as in free and open source. Erasing the boundary between contracting a muscle in the bio-physical realm and producing electronic sound in the virtual realm is what Xth Sense is all about. Capturing biological data is all the rage these days, seen primarily in commercial form in products …

READ MORE →

Shimon, Percussionist Robot, Gets Smarter; A Talk with its Creator

Shimon, an adaptive, improvisational, percussion-playing robot, is getting smarter – and more famous, with appearances in places like the Stephen Colbert show. Now, humans have been known to get a big head under such circumstances. Shimon’s head has gotten “more social” – gestural intelligence helps the robot relate to fellow players and nod its head in time to the music. I got a chance to talk more to project creator Dr. Gil Weinberg, director of the Georgia Tech Center for Music Technology. He’s also taken some of this technology and built it into mobile app ZOOZBeat which you can spot …

READ MORE →

iPhone Day: LaDiDa’s Reverse Karaoke Composes Accompaniment to Singing

LaDiDa Demo from khush on Vimeo. There’s no question iPhone/iPod touch development – really, just clever mobile development – has gotten a bit overhyped lately. But that’s all the more reason to do a round-up of genuinely interesting stories, real innovation happening on the platform. So, I’m clearing out my inbox with some of the more creative tools appearing recently on Apple’s mobile gadgets. There’s no better way to kick off today’s festivities than with this unusual “reverse karaoke” creation. Sure, people may think they’re tone-deaf. But even the layperson has extraordinary powers of musical perception. So how could you …

READ MORE →

Can Augmented Reality Make Real Games, Expressive Media? Inspiration from Georgia Tech

I’ve been blogging effectively every day for nearly five years, so it’s hard to avoid novelty – that’s kind of what we publish. The question is, is it the novelty that’s important, or do you see these as little steps toward something greater that hasn’t happened yet? I tend to favor the latter. Here’s the question: can augmented reality – using computer vision tools to mix computer graphics with stuff in the real world – become a real medium and not just a gimmick? If it works in a game, you begin to think there’s really something to an interactive …

READ MORE →