Cyborg Beatboxer AV: Gloves, Heartbeat, Gesture Merge in Wild Performance

Humanelectro + “∑(SIGMA)” from Ryo Fujimoto on Vimeo. Once, you might see strange sensors or generated graphics as a kind of novelty, used for their foreign, futuristic quality. Now, a generation immersed in such tech exploits these tools because it’s second nature. That’s the message of the creators behind a fantastic trans-media beatbox performance starring Japan’s Ryo Fujimoto. And while you’ve seen each clever gimmick on its own, here they try ticking all the boxes at once. Musical gloves dripping in wires with flex sensors – check. Muscle sensors – check. Glowing-blue heart-rate sensor behind the ear – check. LEAP …

READ MORE →

Wave Your Hands: 3-Axis Gesture Control in New Hot Hand USB Wireless

We’ve been seeing wave-your-hands-in-the-air gestural controls for music since the early part of the last century – thank you, Leon Theremin. But one of the more wholehearted efforts to make it useful has come from the makers of Hot Hand. Initially they peddled the idea to guitarists and bass players, who were already accustomed to adding additional expression to their hand via whammy bars and the like. The Hot Hand USB is the latest iteration, and now hopes to woo computer DJs and producers. The draw: plug-it-in, driver-free control of anything via MIDI, wirelessly. Whereas these sorts of things are …

READ MORE →

Drumactica Augments Percussion with Gestures, Ice Cube Trays; Here’s How it Was Done

Bacon and eggs on a drum snare? Hands-through-the-air gestural control with Leap Motion? Water pianos in ice trays and a hacked Makey Makey, all talking to Ableton Live? Drumactica has a little bit of everything. London-based percussionist Dr. Enrico Bertelli shares with us how he “augmented” percussion for his latest project – with all the details – for a guest post on CDM. Just make sure to give due respect to John Cage.) -Ed. Drumactica 2.0 is a solo, augmented percussion set up, created for Hack the Barbican, London. The piece is about the creative bond between the desire to …

READ MORE →

Hands Off: Apple Wants to Pull Orphion Music App Over Touch APIs

Apple’s devices have earned praise from developers for consistently supporting multiple fingers in predictable ways. But to go further with expression, one developer made use of the size of contact area on the screen. Any time a developer goes beyond “public” or official APIs, there’s a chance Apple will eventually balk. We knew this was a risk to the excellent music app Orphion when we covered it, but hoped, in fact, that if the app were successful, Apple might reconsider. Unfortunately, today we learn from developer Bastus Trump that Apple will remove the app. And that means, at the very …

READ MORE →

Control Music with Cubes Using Your Fingers: AeroMIDI 3D for Leap Motion

Cue the Tetris theme, and start playing music by navigating a field of cubes. So, you’ve seen X/Y touchpads before, many times, in hardware like the KAOSS Pad (or Lemur, or your computer trackpad). But AeroMIDI 3D does something rather different: instead of just a single X/Y area, you get an array of programmable 3D cubes floating in space, all triggered with waves of your fingers using the forthcoming Leap Motion connect. Use one finger, multiple fingers, different parameters, whatever you like, and notes and control messages are sent via MIDI to your favorite software. You get three dimensions of …

READ MORE →

Dance and Music: Convert Kinect to MIDI, Free Beta on Mac and Windows

When we first saw movements and dance converted to music in February, it must have sparked some interest. Developer Jesper Nordin tells us popular demand has prompted him to release a free (as in beer) version of his Gestrument Kinect controller. With a beta download and a Windows or Mac machine, you can translate Microsoft’s depth-sensing camera to MIDI events you can use with instruments. Previously (including mention of the iPad version of this idea, if you don’t fancy prancing about in front of a camera): Gestrument, Shaping Music with Kinect, Touch, and Acoustic Ensembles [Videos] Now, you can grab …

READ MORE →

Lawnmower Man-Style Audiovisuals, in Kinect Experiment, Plus a New Kinect

Oculus Rift + Kinect – Audio visual instrument a001 from Ethno Tekh on Vimeo. That window between science fiction and actual interfaces continues to narrow. Here, virtual hands paw at geometric orbs to produce sound, with simultaneous 3D visuals as accompaniment, in the latest artist/hacker experiment. You can thank the popular and surprisingly-accessible game engine, Unity – which recently added free deployment to mobiles, by the way. Description: This is our first Kinect-controlled, virtual reality experiment, using the greatly anticipated Oculus Rift. It’s a simple virtual reality environment built in Unity 3D with our own interactive framework. It allows us …

READ MORE →

Note from the Editor: Music for Dance, Music and Movement

“Dance music” is a term that has lately become maligned all over again. And the press is often fond of deriding the music of machines, as if drum machines and computers are sentient alien technology that climbed out of the smoldering remains of a wrecked UFO rather than the handiwork of someone’s imagination. For me, though, these two materials – movement and machines – are the reason I do what I care about this field, exploring new sounds in a way that is human and gestural, whether the music is in an experimental concert at 8p or a party in …

READ MORE →

FL Studio 11: Play it with Touch and Everything and Everywhere, Live or Editing

FL Studio 11 has arrived, hot on the heels of an impressive FL Studio Mobile release. The folks at Image Line have been intensely busy, but what strikes me is that you can now play FL Studio using almost anything, on almost any device. The Mobile version works on Android and touch Windows devices, not just iOS, when most folks target only Apple. And the upgrade to FL Studio 11 is similarly flexible. There’s a clip-triggering performance mode, which already supports a range of input methods: “mouse, touch screen, typing keyboard or MIDI controller. Supports APC20/40, Launchpad, Lemur, Block, Maschine/Mikro, …

READ MORE →

From Gestures to MIDI: Geco Promises Music Applications for Leap Motion

Here we go again. Touchless hand gestures have been part of electronic musical performance ever since the Theremin first hummed to life almost 100 years ago. And those gestures embody the same challenges and promise. We have the ability as humans to think spatially, in three dimensions, and to have a tight sense of control via our muscles of gestures in space. We use gestures to communicate and to manipulate our world. Those same expectations can be disappointed in electronic systems, however, as they lack tangible physical feedback and may misinterpret our intentions. It’s easier to play with these ideas …

READ MORE →