Dance and Music: Convert Kinect to MIDI, Free Beta on Mac and Windows

When we first saw movements and dance converted to music in February, it must have sparked some interest. Developer Jesper Nordin tells us popular demand has prompted him to release a free (as in beer) version of his Gestrument Kinect controller. With a beta download and a Windows or Mac machine, you can translate Microsoft’s depth-sensing camera to MIDI events you can use with instruments. Previously (including mention of the iPad version of this idea, if you don’t fancy prancing about in front of a camera): Gestrument, Shaping Music with Kinect, Touch, and Acoustic Ensembles [Videos] Now, you can grab …

READ MORE →

Lawnmower Man-Style Audiovisuals, in Kinect Experiment, Plus a New Kinect

Oculus Rift + Kinect – Audio visual instrument a001 from Ethno Tekh on Vimeo. That window between science fiction and actual interfaces continues to narrow. Here, virtual hands paw at geometric orbs to produce sound, with simultaneous 3D visuals as accompaniment, in the latest artist/hacker experiment. You can thank the popular and surprisingly-accessible game engine, Unity – which recently added free deployment to mobiles, by the way. Description: This is our first Kinect-controlled, virtual reality experiment, using the greatly anticipated Oculus Rift. It’s a simple virtual reality environment built in Unity 3D with our own interactive framework. It allows us …

READ MORE →

Note from the Editor: Music for Dance, Music and Movement

“Dance music” is a term that has lately become maligned all over again. And the press is often fond of deriding the music of machines, as if drum machines and computers are sentient alien technology that climbed out of the smoldering remains of a wrecked UFO rather than the handiwork of someone’s imagination. For me, though, these two materials – movement and machines – are the reason I do what I care about this field, exploring new sounds in a way that is human and gestural, whether the music is in an experimental concert at 8p or a party in …

READ MORE →

Color and Light: Gestures Manipulate Music, RGB Lights [Ableton + Kinect]

Motion, light & sound / Kinect & Madlight from things happen on Vimeo. In a teaser video just released by Spain’s Things Happen, a silhouetted performer uses arm position to sweep through RGB colors and trigger sound cues. It’s the latest effort to integrate the immersive media environment with a performer’s body, part spectacle, part interface. The ingredients, apart from Microsoft’s ubiquitous Kinect depth camera: Motion capture + image = light + sound Software: MadMapper [using MadMapper’s Madlight feature to trigger lighting] Quartz composer Ableton live Music: Sun Glitters x Isan – Snowfall The nice thing about the inter-linked, comment-enabled …

READ MORE →

FL Studio 11: Play it with Touch and Everything and Everywhere, Live or Editing

FL Studio 11 has arrived, hot on the heels of an impressive FL Studio Mobile release. The folks at Image Line have been intensely busy, but what strikes me is that you can now play FL Studio using almost anything, on almost any device. The Mobile version works on Android and touch Windows devices, not just iOS, when most folks target only Apple. And the upgrade to FL Studio 11 is similarly flexible. There’s a clip-triggering performance mode, which already supports a range of input methods: “mouse, touch screen, typing keyboard or MIDI controller. Supports APC20/40, Launchpad, Lemur, Block, Maschine/Mikro, …

READ MORE →

From Gestures to MIDI: Geco Promises Music Applications for Leap Motion

Here we go again. Touchless hand gestures have been part of electronic musical performance ever since the Theremin first hummed to life almost 100 years ago. And those gestures embody the same challenges and promise. We have the ability as humans to think spatially, in three dimensions, and to have a tight sense of control via our muscles of gestures in space. We use gestures to communicate and to manipulate our world. Those same expectations can be disappointed in electronic systems, however, as they lack tangible physical feedback and may misinterpret our intentions. It’s easier to play with these ideas …

READ MORE →

DUO is a DIY 3D Sensor – Like Leap, But Open Source, From Gesture and Vision Veterans

Gestural input is already beginning to make Kinect look crude, offering new three-dimensional sensing approaches that combine low latency with precise gestures. That offers tremendous potential for new interfaces, and could in particular finally help solve the problem of how to intuitively work with three-dimensional interface concepts that don’t lend themselves to traditional touch and physical input. Leap Motion is already speeding toward its mid-May launch, complete with an app store ecosystem for developers wanting to push out new ideas to users. But Leap is a closed box. Apart from any philosophical objection, that means you can’t take it apart …

READ MORE →

Pianist and Piano, Disconnected, in Composition for Kinect and Grand

The piano is a conventional grand, but with digital interface and camera, the composer is separated from it by air, playing without touching. It’s a Theremin interface for a keyboard instrument. Piano post-modern? Gestural post-digital? Whatever it is, in a work composer Benjamin Martinson composed for player piano, computer, and Kinect camera, the piano work holds up as musical content – compositional gesture, not just gimmicky digital hand-waving. Martinson himself looks oddly isolated and awkward, a man making rough mime gestures in unseen water, molasses, and wind. I can’t tell whether this is more about our expectations of human movement, …

READ MORE →

As a Musician Loses Her Sight, A Rush for Music Apps for the Blind [Hack + Listen]

Take a good, long look at your computer screen. Now imagine you can’t see it. That’s the reality Mandy Matz is facing. At age 36, she’s losing her vision to glaucoma. The musician and multimedia artist makes some beautiful, ethereal music, having cut her teeth on Buzz. Listen to the haunting “Alpha Waves,” her first song. EP by Theory Anesthetic And now, because sight is so deeply connected to the way in which music developers map your brain to software, losing her vision could mean losing her ability to work with digital tools. It shouldn’t be this way. As Paul …

READ MORE →

Gestrument, Shaping Music with Kinect, Touch, and Acoustic Ensembles [Videos]

Swiping through clouds of timbre and melody, using Gestrument is an experience of a different musical animal. Jesper Nordin and Kymatica / Jonatan Liljedahl created the iPad version, available now for ten bucks. But it’s worth looking at that side by side with Gestrument for Kinect, as the same metaphors can translate across input methods. Both employ a kind of meta-composition – instrument as conductor of musical structures, more than an object for exclusively solo expression. What’s especially nice is hearing these digital, synthesized environments meld with acoustic instruments. The solution may not convince everyone yet, but there’s clearly potential …

READ MORE →