Touching Beams of Light: An Otherworldly Laser Interaction Prototype

Laser interaction prototype from jayson on Vimeo. Interaction design isn’t just input. Output can transform a simple demo into something that seems to bend reality. Melbourne-based artist Jayson Haebich sends over a laser interaction prototype he’s creating. The results seem like science fiction, as though he’s opening jump gates with his fingers. It’s almost exclusively for aesthetic effect, but that sense of light, sound, and space coming together and then being gently pulled apart is more than enough. Technical details: The software used to control the laser was created using OpenFrameworks and C++ by Jayson Haebich and uses an Xbox …

READ MORE →

Music Performance as Real-Time Special Effect: Kinect Jamming Gets More Futuristic

The V Motion Project from Assembly on Vimeo. It’s all real – in a manner of speaking. And it’s all real-time. But just what is a live performance made with cameras, gestures, and projection? It’s worth watching The V Motion Project and pondering those possibilities, amidst the flashy visual eye candy. It’s certainly optically impressive. It’s music made to be watched (and, in the video, filmed with iPhones and whatnot). Watch a second time, and you wonder: as we reach a new peak of maturity, decades into alternative interface design, what will come next? To say that this is a …

READ MORE →
syntact_action-1

Syntact is a Futuristic Gesture Interface That’s Tactile – Without Touch

Here’s how interfaces normally break down. You’ve got your conventional, tactile interfaces, like a knob. You’ve got your touch interfaces, which lack tactile feedback (you touch them, but they don’t push back). You’ve got your gestural interfaces, which have you waving your hands in the air without touching anything and without any tactile feedback. (They’re generally the most challenging, because your brain has no feedback for what it’s doing.) Syntact creates an entirely new category. It’s a gestural interface, of the “waving your hands around in the air” sort. But while your hand is in mid-air and isn’t touching anything, …

READ MORE →

Projection Mapping, with Robotics, Goes Further to Augmenting Reality: MPS Demo [TouchDesigner]

Okay, great: you can project on facades and surfaces in ways that makes the image tailor-mapped to the surface. What else can you do? Rafal Bielski and a small team from Poland provide a glimpse of a more awesome, more futuristic future. Here, projection mapping isn’t content with a still, static surface, like a building. The surface and the projection can both move, aided by robotic servos. As that image tracks the object, the combined project comes further to the dream of transforming the physical reality around us with digital visuals. How cool is this? Well, for starters, that video …

READ MORE →
Hypo Chrysos live at Trendelenburg AV Festival, Gijon, Spain, December 2011.

From Your Body to Music: Interview with Biophysical Xth Sense Interface Creator

What you’re watching in the video above doesn’t involve cameras or motion sensors. It’s the kind of brain-to-machine, body-to-interaction interface most of us associate with science fiction. And while the technology has made the occasional appearance in unusual, niche commercial applications, it’s poised now to blow wide open for music – open as in free and open source. Erasing the boundary between contracting a muscle in the bio-physical realm and producing electronic sound in the virtual realm is what Xth Sense is all about. Capturing biological data is all the rage these days, seen primarily in commercial form in products …

READ MORE →

FRACT, 3D Adventure Game Played with Synths and Sequencers: Myst Meets Music Making

FRACT is a curious combination of music studio and puzzle game, merging elements of games like Myst with the sorts of synths and pattern editors you’d expect somewhere like Ableton Live. You have to make sounds and melodies to solve puzzles; by the end of the game, say the creators, you’re even producing original music. The work of a small student team out of Montreal, FRACT looks like it has all the makings of an underground indie hit – at least for music nerds. As the creators describe it: FRACT is a first person adventure game for Windows & Mac …

READ MORE →

3D Modular Sound Gets Real: Stunning AudioGL Demos, Crowd Funding, Beta Coming to You Soon

Electronic music making has had several major epochs. There was the rise of the hardware synth, first with modular patch cords and later streamlined into encapsulated controls, in the form of knobs and switches. There was the digital synth, in code and graphical patches. And there was the two-dimensional user interface. We may be on the cusp of a new age: the three-dimensional paradigm for music making. AudioGL, a spectacularly-ambitious project by Toronto-based engineer and musician Jonathan Heppner, is one step closer to reality. Three years in the making, the tool is already surprisingly mature. And a crowd-sourced funding campaign …

READ MORE →

Across the Universe: Mind-Blowing AV Performance Makes Music a Spacey Trip

Turning music and sound into three-dimensional worlds often yields something that fields like a trip through space. But this feels like a real trip. Through pulsing, glowing starfields, “Versum”‘s audiovisual movements are brain-bendingly transformative. Artist Tarik Barri has created an integrated world of sound and image that makes the interface and the compositional realms seamless. It seems as though this really is a musical universe, through whose harmonies of the spheres you can fly like. Boldly going, indeed. Ingredients: Max/MSP/Jitter, Processing, Java, SuperCollider, GLSL [the 3D shading language], and … some serious skill and time, I imagine. The work has …

READ MORE →

Total Immersion: Projection Mapping + Tracking for PS3 Shots, Like Pure Magic

We’re living in an age of the Neo-Baroque/Neo-Rococo, in which technique creates marvelous illusions, when technique and thought can create dazzling effects. And as the technology matures, that work begins to evolve genuine playfulness. It’s not enough to see the novelty: that novelty is now conveyed through real wit. At least, I feel fuzzy, optimistic thoughts like that when I look at work like a series of spots for the Sony PS3. Friend-of-the-site Memo Atken is involved, alongside FND and Flat-e, with the wonder, mixing real-time projection mapping with head tracking and camera tracking (both at once) for a sort …

READ MORE →

Subcycle, Insanely Futuristic 3D Music Interface, Reaches New Levels of Pattern and Sound

Compare the complex model of what a computer can use to control sound and musical pattern in real-time to the visualization. You see knobs, you see faders that resemble mixers, you see grids, you see – bizarrely – representations of old piano rolls. The accumulated ephemera of old hardware, while useful, can be quickly overwhelmed by a complex musical creation, or visually can fail to show the musical ideas that form a larger piece. You can employ notation, derived originally from instructions for plainsong chant and scrawled for individual musicians – and quickly discover how inadequate it is for the …

READ MORE →