Elly Jessop and VAMP at the Maker Faire from The Amazing Rolo on Vimeo.

Yann Seznec aka The Amazing Rolo brings CDM his coverage of music tech at the Maker Faire in three episodes today.

Continuing the tradition of computer-augmented vocal performance and interactive gloves, Elena “Elly” Jessop shows off her VAMP system at Maker Faire. Elly is a Masters student at the MIT Media Lab’s Opera of the Future research group, headed by Todd Machover. Interestingly, Elly’s background is in conventional theater, including stage and costume design and choreography.

http://web.media.mit.edu/~ejessop/

VAMP stands for “Vocal Augmentation and Manipulation Prosthesis.” What’s really nice in this demo is that the results sound like more than just effects – they begin to become real augmentation, setting up a complex relationship between the vocalist and the sounds that come out.

It’ll be great to see your work evolve over time, Elly, as you fuse that experience. (And I know what a challenge can be, as I’m still working on fusions of my own, having likewise come from various non-digital backgrounds… heck, I made my way through puppetry class at Sarah Lawrence, even. It’s a lifetime-scale commitment.)

For more on data gloves and such: composer, computer scientist, and futurist Jaron Lanier did lots of seminal thinking about these ideas leading back to the 80s. And you can find some extraordinary work from “augmented vocalists” like Laetitia Sonami and Pamela Z. Here’s a terrific 2006 interview by Sua Constabile for Cycling ‘74 with Laetitia:

David Merrill, working with Jeevan Kalanithi and (for the audio engine) Josh Kopin, wowed audiences at the TED conference with his Siftables interactive blocks. These strike me as what the Audiocubes have tried, sometimes unsuccessfully, to be — physical objects that react to the proximity of other objects, allowing you to manipulate music and media by moving around tangible blocks. Siftables are gifted with multiple expressive controls (tilt helping them break the plane of the surface), and intelligent screens that make them more adaptable and provide more visual feedback.

The music sequencer is very cool, though I think it’s actually the Scrabble-like game that may be the winner among the demos. But while TED celebrates all things cool and futuristic for their easily-digestible novelty, sometimes I think the most important design achievements are as significant in their shortcomings as their successes. Siftables raises some important questions. Sure, you can now use two hands, as opposed to the single mouse pointer. But do those same tangible blocks actually limit the kinds of interactions you can have, even compared to a traditional UI? Does it sound any different/ And note that — a little bit of tilting aside — the interface is still essentially two-dimensional. I’m personally really stumped by the question of how you can make a successful three-dimensional controller. Yet three dimensions is how all of us interact with space and movement daily. Maybe it’s the fact that we do so much of this, comprehend movement so richly, and take it for granted, that makes mapping those gestures so challenging.

That’s not a criticism of the project – or a claim that I can do any better. On the contrary, I think it’s important to do this sort of work because it can raise those kinds of questions. We’re gifted as a generation to try out and test these ideas with flexibility that was never before possible — and the intelligence built into these objects shows the potential of that power.

More of Siftables after the jump. And it’s well worth checking out David’s other projects, too – when I last ran into him, he was showing off the totable, Linux-powered Audiopint sound-processing box. Oh, yeah — and he’s the face control for guitar guy!

Siftables Music Sequencer from Jeevan Kalanithi on Vimeo.

Siftables project page

More Merrill Goodness

Rope and Sound is an installation that uses rope tension to control sound. Pull on a cord, and the change in tension triggers electronic thuds and mellow chimes. The trick is conductive fibers braided into the rope; as the tension changes, the conduction of the rope changes, as well.

I got a chance to try out the installation at New York’s Cooper-Hewitt National Design Museum. The show is up through October 30 and well worth a visit if you’re passing through town. The installation is beautiful and the concept brilliant, but the sound aspect was somewhat disappointing. The sounds themselves were compelling, but the ropes act like simple buttons: sounds are triggered as you cross a set threshold. If the whole point is the ability to monitor stress, why doesn’t that translate into sound? A velocity-sensitive keyboard is more expressive. That said, I think the underlying concept is terrific, so expect to see more use of conductive fibers in new sound interfaces.

If you’re near Emoryville, California, you can meet up with the Squid Labs folks who built this and other projects. (via O’Reilly Radar) And you can even one-up them by showing your own project. If you go, let me know what goes down!

[UPDATE:] I went to the source and asked Ben Recht (MIT Media Lab) about why the strings weren’t sensitive. In fact, they were! The reason they modulated timbre and not velocity was that he felt velocity was too hard to calibrate for different visitors. (And, obviously calibration is an issue, since I didn’t notice the timbre modulation.) This certainly demonstrates the challenges in designing new interfaces. And it also suggests that even with new designs, you need musicians to become adept at using the interface expressively.

As seen on Slashdot: a group of students at MIT have constructed a Disco Dance Floor, with over 1,500 LEDs and covering 128 square feet. Dance on it, and pressure sensors trigger some 4,000 colors. Jeez, I knew I shouldn't have gone to Sarah Lawrence;
these MIT folks don't mess around. Not only are the colored patterns
surprisingly sophisticated, but it interfaces with a Linux audio player
to work with the grooves.

So how do you build your own? Check the detailed construction details,
though consider what they learned: don't ever do this: "Don't try to
build a disco floor in your lounge; it will consume your life. Now
there's a lesson they don't teach in any class." Okay, fine, but when
they say "As far as we know, there is no mention on the internet of
anyone home brewing a dance floor of anywhere near this complexity,"
can't you hear the gauntlet falling? (Hey, stop looking at me! I'm just a keyboard player.)