Here’s how interfaces normally break down. You’ve got your conventional, tactile interfaces, like a knob. You’ve got your touch interfaces, which lack tactile feedback (you touch them, but they don’t push back). You’ve got your gestural interfaces, which have you waving your hands in the air without touching anything and without any tactile feedback. (They’re generally the most challenging, because your brain has no feedback for what it’s doing.)

Syntact creates an entirely new category. It’s a gestural interface, of the “waving your hands around in the air” sort. But while your hand is in mid-air and isn’t touching anything, it does provide tactile feedback. It pushes back as you move your hand around, giving you interactive feedback. The way it pulls it off: sound. 121 ultrasonic transducers beam sound at a particular point, so that you feel something as you move.

You can see a bit of what this means in the new video, above. I’m hoping to get a hands-on (erm, hands-off) demo soon from the designer. The basic specs:

• Optical analysis of gestures, using a USB camera built into the interface
• MIDI control, for use with any live performance or music making rig (or other media)
• A control panel for selecting different sonic images and adjusting scaling.
• A built-in music solution visualizes sound and makes it easier to map to your own MIDI files.

More information:
http://www.ultrasonic-audio.com/products/syntact.html

Also well worth checking out the directional speaker tech from these Slovenia-based developers – directional sound is another huge area of innovation.
http://www.ultrasonic-audio.com/products/acouspade.html

If you want to try this in person, it’ll be at the Beam Festival in London in late June.

Side note: Yes, I’m looking into that LEAP thing, for more gestures, albeit without tactile feedback. Stay tuned.

“So,” you say, “I’ve got a … and I want to connect it to a … to make music. How do I do that?”

One strong answer to that question, if you’ve got a Mac, is junXion. Developed by the landmark audio research laboratory STEIM – a hotspot in Amsterdam that for years has been imagining new ways of making music by connecting things to other things – it got a big update recently.

It takes lots of the inputs you might imagine (joysticks, mice, touchscreens, MIDI, OpenSoundControl, audio, Arduino-powered hardware and all of its sensors, and video sensing) and connects it to a lot of the outputs you might imagine (using MIDI or OSC). You can set up rules in between the input and output to make that connection musically meaningful.

OSC input and output wasn’t entirely optimal in past versions; a total rewrite now makes it work with useful OSC sources like the iOS TouchOSC and Lemur apps. You get nifty new Actions, like remote mouse control. You can use a Nintendo Wii “Wiimote”‘s infrared-sesnsing capabilities and vibration support. If you’re using video, you can now support multiple “blobs.” And the whole app promises to run faster and look better, with more help tags in the UI, and added stability.

75 € for the full version. You need Mac OS X 10.5 or later, including the latest 10.7 Lion. (Upgrades for version 4 are free; Lite users can upgrade for 60 €.)

http://steim.org/product/junxion/

Of course, talking about this doesn’t really make much sense; it’s better to see it in action. We have a whole bunch of videos from the folks at STEIM showing features like Wii and joystick control and video sensing from a camera – plus a couple of fascinating demo/tutorials submitted by users.

Let’s watch, shall we?

Via https://vimeo.com/steim/videos

Far from the walls of STEIM, though, intrepid users have concocted their own demos. Here’s a look at controlling Reason with a Wiimote:

Here’s a live performance, also controlled by Wiimote, in the modular live environment AudioMulch. The creator writes:

A basic soundscape in AudioMulch controlled by two Wii remotes via JunXion IV.

Buttons in Wii Remotes control: start and stop buttons, presets of the main mixer, transient parameter of the granulator, frequency of the pulsecomb_1 (processing the drum), a junxion-timer controlling the volume of the granulator.

X-Y-Z accelerators control: 10 harmonics of a frequency generator, parameters of the rissettone

And yes, a camera can be a Theremin:

Got your own solution using junXion – or another tool? We’d love to hear about it.

See also two fine Mac-only tools:
Osculator [Much like junXion, supports nearly anything as an input, adds advanced OSC routing]
ControllerMate [not music-specific, but very powerful modular game input utility]

In fact, what’s largely missing is easy solutions on Windows and Linux, though you can roll your own with a free tool like Pd, which also supports HID, Arduino, video, and the like.

Music trade shows are typically full of sensible and useful instruments. They may not always represent something revolutionary, but people find homes for them in their musical lives. Of course, the world’s fair futurist in us may want something really different.

It was a real treat to get my hands on the AlphaSphere, a UK-engineered alternative instrument that maps pitch across touch-sensitive surfaces arrayed in a sphere. It’s what a lot of people were talking about at Messe when people asked “what’s cool?”, as friends rounded up friends to march them over to the booth. (It’s Hall 5.1, stand C27 if you happen to be there this weekend.) The rubbery round sensors are actually really fun to play. I’m not quite ready to sign up for all-spherical playing, but it was a crowd-pleaser, and it’s great to experience a different way of playing.

I hope to catch up with these lads from Bristol either in the UK or back in Berlin, but in the meantime, check out Keyboard Magazine’s video of the demo. It’s not as slick as the promo video, but you get a sense of the co-inventor’s real enthusiasm. (I shot the video as I’m contributing to Keyboard‘s Messe coverage.)

More:
http://www.alphasphere.com/

Previously (not spheres, but a similar idea – minus the continuous pressure):
Dodecahedronists, Unite: An Audiovisual Controller, Gestures and Polyhedra, Open Hardware

Official video (I like the white):

You know the type. The drummer who, even robbed of drum sticks, is tapping on the walls, the car door, the desk… and maybe you are that person. When rhythms and musical gestures are bouncing around your head, the whole world just feels like something you want to play. It seems as natural as breathing.

So, given your computer can make anything an input, why shouldn’t it let you play like that?

A new controller and software combo seeks to make that possible. The work of one enterprising musician and creator, Stephan Vankov, it includes an affordable accessory with a piezo microphone and companion software to map it your taps to MIDI messages, for use with your favorite software musical instruments. Plug in the mic sensor, and you can tap your desk or slap your laptop or play any other surface.

We’ve seen this idea in various iterations before – most recently, at the party we co-sponsored in Los Angeles last month, we witnessed an entire ensemble using the motion sensors in their laptops. (That tool is available as an open source download, if you fancy hitting your computer.) Until now, though, these piezo controller rigs been a DIY affair. Stephan’s solution includes what appears to be nicely-made hardware — so you can dump it in your carry-on without worry. And the software includes a wide array of settings to map more easily to percussion and melodic instruments. (The software is now available for Mac, but with Windows and Max for Live versions on the way.) I hope to get one to test soon.

Intro pricing begins at US$59.

http://www.pulsecontroller.com

Stephan writes:

I wanted to let you know about a product I’ve been developing – the Pulse Surface Controller. The idea behind Pulse Surface Controller is to liberate computer-based musicians from conventional input devices of predetermined form factor and layout, and allow the user to turn a surface of various size, orientation and material into an expressive, flexible, reconfigurable MIDI controller.

The system includes a wired piezo microphone that can be attached to a surface via the integrated suction cup (or the included velcro strips) and connected to any computer audio input, as well as a standalone software application that converts acoustical impulses from the microphone into velocity-sensitive MIDI data. With the Pulse Surface Controller System, controlling percussive instruments has a more visceral, immediate quality, and via a powerful Melodic Generator that can generate notes in various scales the user can easily extend into the melodic domain to tap into an inspiring world of happy accidents.

I am very excited to share this project with fellow musicians and hope that you find this idea to be worth sharing with the CDM community!

More description:

The idea behind Pulse Controller was born out of the belief that as computer-based musicians and performers we should not feel relegated to a grid of small 1×1″ pads or a keyboard to create our rhythms and provide pulse to our music. Controllers once intended to give us the immediacy of playing an instrument often end up feeling more disconnected and distracting. With the Pulse Surface Controller System, controlling percussive instruments has a more visceral, immediate quality, and via a powerful MIDI generator that generates notes in predefined musical scales the user can easily extend into the melodic domain to tap into an inspiring world of happy accidents. Power to the fingers!

System Features:

+ Piezo microphone and powerful software interface
+ Attaches to any surface via integrated suction cup
(velcro strips also provided)
+ Connects to external audio device or built-in audio inputs
(1/4″ and 1/8″)
+ Velocity-sensitive and highly responsive
+ Low-latency performance
+ Compatible with all software that accepts MIDI Note messages (Cubase, Ableton Live, Pro Tools, VST plug-ins, etc)
+ Generate fixed note or random notes in a selected scale,
with control of octave, octave width, root pitch and 21 Scales
+ Fixed note length and note choke modes
+ Store and recall presets
+ Keyboard shortcuts for quick access to presets and important controls
+ Mac OS 10.5, 10.6, 10.7 compatible (Windows / Ableton Live users, please contact us about M4L version)

Side note: interestingly enough, I got to know Stephan in person at a NAMM afterparty we threw in LA, at which Stephan was playing a Karate Kid AV mashup with friends Shane Hazleton and Momo The Monster. So, nice to see what Stephan has been working on!

For the last few decades, generally speaking, we’ve had computers, and we’ve had physical, modular, analog gear. Computers are endlessly patchable, but not using physical cords. Modulars use physical cords, but they lack the flexibility (and affordability) of a computer.

Now, US$25 and an Arduino can change that.

rePatcher is a simple, tangible modular interface for computers. It could work with any software, but right out of the gate it already works with two popular (virtual) patching environments, Max/MSP and the free and open source Pure Data (Pd). You use physical patch cords to make connections, and those connections are reflected in the patch you see on the screen. The patch cords are coupled with requisite encoders for dialing in additional parameter changes. (Reason comes up as a possible candidate for additional compatibility, which would, of course, be really sweet.)

rePatcher is built as a shield for Arduino, so you’ll need one of those, but that still keeps the price low enough to say I absolutely have to have one of these right now.

It’s not the first attempt to do something like this, but it might be the most accessible and affordable – and interesting. And while those cute little patch cords are fun, there’s nothing stopping someone from building on this idea and going to bigger cords and something more extensive than this 6×6 matrix.

Best of all: the magic happens entirely over USB, so if you want to make this work with something else – say, your favorite VJ software – you can do so with anything that can communicate over serial.

More information:
http://www.openmusiclabs.com/projects/repatcher/

Music has always moved forward when people get together to play. Groups of artists in Los Angeles’ Interface LA collective – and other California groups, like LoveTech and controllerism.com – are challenging each other to keep expanding their technique in playing electronics live.

I’m pleased with CDM and some of our friends to support a party Friday night in downtown LA celebrating playing live. Interface LA is a group centered on live electronic music performance and interactions. We’ll be bringing you video coverage after the event here, thanks to talented videographer Charlie Visnic. But we can kick things off now with videos of the artists and work. And if you are in town, be sure to preorder tickets now, as we expect this to sell out really quickly and hope to see you there!

Videos, from top: Mike Slott (Brooklyn), who’s headlining Friday night, in an interview. Second from top, check out the crew in their last event at top, that one centering on the monome grid instrument.

I’m playing, as well (hey, I’ve got to put my money where my very large mouth is). But I’m really thrilled to get to share some time with a bunch of artists I love, many coming from San Francisco’s LoveTech and controllerism.com, and from LA’s own Interface LA regulars. The lineup:

Mike Slott
Moldover
Vass Glenison
Rich DDT
‘House Band’ (Smacktop Ensemble, featuring the awesome force that is the Smacktop laptop-that-you-hit)
Nonagon
Ro and the Interface LA crew
Presented with Novation and Ableton

Friday, January 21
Doors 9pm
18+
$10 cover

We also have an interactive work entitled (con)textile:

A digital installation using the Kinect, stop-motion and digital noise, and interactive audio” by Jeff Aaron Bryant.  Jeff is a composer working in digital media and kinetics. He is pursuing his MFA in music technology at California Institute of the Arts.

Information:
http://interface-la.tumblr.com/events
http://www.ticketfly.com/purchase/event/82413

Facebook links:
https://www.facebook.com/pages/Interface-L-A/316896995011687
https://www.facebook.com/events/351095438239262/

Images

November Interface LA, in photos

San Francisco’s LoveTech crew, including their Burning Man trip

SmackTop, in Video

We’ve seen this before, but it’s still good watching someone hit their laptop.

More Events in LA This Week

I have an early flight Saturday morning back to Berlin, but there are two other great events in Los Angeles this week if you happen to live in the area or are in town for a certain massive trade show down south in Anaheim.

TRASH_AUDIO NAMM BBQ 2012 has closed its RSVP, but if you do make it, let us know how it goes or (with, uh, permission) take photos of any cool stuff you find. Really wish the TRASH_AUDIO folks the best and all our modular and sound-making friends and Matrixsynth and company; I’ll be somewhere like 40,000 feet over Ireland while that’s going on.

Also, Droid Behavior is doing a party Friday night that should go late at an undisclosed location, the fifth anniversary of their Wham Bam series. I thoroughly enjoyed getting involved in that in 2010, and might duck in if I can on my way to LAX; the event here is not related, to clear up any potential confusion.

Look around the room you’re in. Drum your fingers against some of the objects around you. Now imagine that you could turn those touches into any imaginable sound – and all you’d need to play them is a single contact mic. And we’re not talking just simplistic sounds – think expressive, responsive transformation of the world around you, all with just that one mic, thanks to clever gestural recognition.

Bruno Zamborlin has made that idea a reality, with hold-onto-your-chair results. It’s not available yet for public consumption, but it’s coming.

Bruno explains to CDM:

Mogees is a novel way for transforming any surface into a musical instrument.

By putting a (very cheap) contact microphone over a surface, the software can recognise different types of touch and associate them with different synthesisers.

Users can train the software with their own ‘gestures’, using both bare hands and objects. In the video demo we put the microphone over different surfaces such as kitchen tables and balloons.

The sound synthesis is based on two different techniques:

1 – physical modeling, which consists in generating the sound by simulating physical laws. Different materials can be simulated, such as membranes, strings, tubes and plates

2 – mosaicing, that works as follow: first, users load a sound folder; then, the noise coming from the microphone is analysed and the software continuously finds and plays its closest segment within the sound folder.

Mogees has not been realised yet. It could be published as Max4Live patch in some month.

Yes, we’ll be watching for future versions and publication, with bated breath and eager hands.

http://www.brunozamborlin.com/mogees

Update: Readers point to similar earlier work; obviously, contact mics have long been readily available. I’m not always concerned with whether something is new or not – old and cool can be cool. But what does appear to be new here is the additional gestural analysis to work more accurately with location. That takes an existing technique and refines its musicality. -PK

Come on – you know that occasionally you want technology to respond when you slap it.

As my sister watched an episode of the television show Quantum Leap, I thoroughly enjoyed watch Dean Stockwell’s character Al give his pocket computer, looking for all the world like a 7″ tablet, little helpful smacks.

SmackTop does that for music. Yes, we hear, ad infinitum, the complaint that laptop musicians simply stare inertly at blue glowing laptops as if checking their email. Now they get to put a little skin in the game, literally. And a version 0.3 update makes this humorous novelty genuinely useful:

Imagine your laptop as a MIDI drum kit. SmackTop is an open-source application for Mac laptops which translates physical motion into MIDI messages. Through real-time analysis of the built-in accelerometer’s output, SmackTop is able to classify four different ‘smacks’. Now you can control your favorite DAW by simply tapping your computer. Slap samples, ping notes and hit record – SmackTop is the MIDI controller you already own.

Try it yourself, free:

http://code.google.com/p/smacktop/ (they miss the obvious name, “SlapTop,” but…)

Got another motion-sensing laptop that’s not a Mac and feel jealous? Maybe someone can port this.

In January, we also expect to catch up in person with developer Raymond Weitekamp and Interface LA, the awesome live performance collective in southern California. Stay tuned.

Slap that laptop, make it free!

Now, a tribute to slaps we love…

Before the iPad, before the iPhone, and indeed before the masses understood touch interfaces would be a big deal, there was the Lemur. Dazzling people with high-contrast, colorful controls, this boutique hardware, priced well over €2000 and running embedded Linux and custom resistive touch technology, brought the future a bit early to a handful of musicians. Star Trek was what you heard most frequently – sweeping your fingers over black glass was nothing if not reminiscent of Geordi LaForge helming the Enterprise. (By the way, talk about prior art: those conceptual designers on The Next Generation, working initially with all-optical effects, were also well ahead of their time.)

Now, at last, Lemur arrives on the iPad, released by a leading iOS developer, Liine. Swept away by Apple’s more-affordable hardware, with the iPad offering a higher-resolution display, slimmer form factor, accurate touch sensing, and wireless capability, the Lemur hardware suddenly looked dated. With iPad software, it’s available to the masses.

http://liine.net/en/

The first question, of course: will anyone care – and will the Lemur software compete, with various other touch alternatives? At US$49.99 / €39.99 / £29.99 34.99, the Lemur app is far cheaper than a Lemur, but spendier than a lot of other touch software. [Ed.: An early press release incorrectly listed the UK pricing as £29.99. It's actually £34.99. Just don't ask us for currency conversions. -PK]

I’ve gotten to see the Lemur in action, and actually was walked through some interactive template ideas. (Unfortunately, I was unable to talk about that, and could only tease what I knew – I got to see more than I could talk about via folks working with Liine and M-nus Records’ stable of artists – Richie Hawtin and Ambivalent, in particular – and was really impressed.)

Just like other apps, the Lemur app will let you control any MIDI or OSC application on your computer from your iPad. But the Lemur brings a few strengths that I think will make it a contender in the iPad age:

Innovative controls: The Lemur’s array of controls is, simply, the largest and most comprehensive anywhere. And for those who want to push beyond just fake faders and knobs, it has an array of more unusual controls, with features like:

Physics: Simulated physics and dynamic movement were, to me, one of those most interesting features of the original Lemur. Whereas I’d almost always choose a physical fader or encoder over a touch equivalent, adding physics to touch allows the controller to play to its strengths.

Scripting: This is a big one. Right now, the only other tool capable of genuinely-dynamic, interactive scripts that modify the behavior of touch is the open source Control by Charlie Roberts. (That, to me, is probably the most compelling alternative, especially as it relies on familiar Web and JavaScript rendering, but it’ll need more input to be fully mature.)

Scripting on Lemur means you get dynamic templates that actually take advantage of the touchscreen. (Think back to Star Trek: mimicking that would require scripts. They use pages and interactive feedback all over the place.)

A mature editor: Now, here, I’m of a mixed mind. I still want a touch app that lets you edit right on the device – guess I’d better go make the one I want. But if you’re going to be editing templates on your Mac or PC, then the Windows/Mac Lemur editor is now tough to beat in sheer power. I was critical of early versions when I first reviewed the Lemur hardware, but it has evolved and matured since.

An installed User Library: This could well be the thing that puts Lemur for iPad over the top – and make no mistake, it’s the biggest obstacle to any newcomer in touch. The Lemur simply has a whole bunch of templates, ready to go, many of them really sophisticated.

The competition: I imagine TouchOSC will continue to dominate the market for touch apps, though interestingly, for many of the same reasons. It has an installed user base and templates, it has a graphical editor that runs on Mac and Windows that people find reasonably easy to use, good documentation and community, and it covers a lot of needs. TouchOSC’s low price also ensures it has nothing to worry about from Lemur, but the Lemur app will appeal to people with more advanced needs, and I think it’ll be a big hit.

Also unique about the iPad: because US$50 is considered “expensive,” it’s really not a zero sum game. You could buy all of the major touch apps for your iPad, assuming you own one, and still be short of the cost of one plastic keyboard.

As for Android? Look, technically, I’m sure you could port Lemur to Android. The fact that they’re not launching with Android support is no surprise – but the problems with Google’s installed base and market and their inability to get OS updates out on devices is a subject for another post. (Preferably one that involves me writing surrounded by candles in a warm salt bath so my blood pressure doesn’t explode.)

Video: How use Lemur + WiFi

Video: How to use OSC and Lemur

Video: How to use Lemur with USB MIDI

Summary:

- Connect the USB Cable to the iConnect MIDI or similar device.
- Open a factory template in the Lemur.
- Open the settings tab and assign the MIDI Ports

http://liine.net/en/products/lemur/

Postlude: What about Existing Lemur Users

Since it’s a matter of some confusion, I asked Liine to clarify their relationship with JazzMutant (now Stantum), the developer of Lemur, and why existing Lemur owners should spend some cash to upgrade. There’s a half-off deal through the beginning of January if you owned the Lemur hardware, but some Lemur owners understandably feel a bit left out, having invested massive amounts of time and money in the now-abandoned hardware platform. On the other hand, even $50 seems to me not unreasonable for updating to the new software, even if a free release for Lemur early adopters may have been nice. I have yet to test it myself, but I imagine I would have no problem recommending the Lemur app to anyone who owns a Lemur and an iPad, certainly if they’ve nailed the software release.

Updated:

CDM: What is the relationship of Liine to JazzMutant/Stantum?

Liine: Members of Liine have a historic relationship with JazzMutant/Stantum. Richie Hawtin and Gareth Williams were very early adopters of the Lemur and have worked closely with them for years. Nick and Gareth also worked alongside Max guru Mathieu Chamagne on the Mu Ableton Live controller for the Lemur. Axel is the former lead developer at JazzMutant who were are very proud to have on board with us for this venture.

In short, Liine is a young independent company, not affiliated with JazzMutant/Stantum, but with a friendship and working relationship going back many years. We are very proud to be contributing to the future of such a revolutionary controller.

CDM: Why not give Lemur for iPad to existing owners for free?

Liine: It costs time, money and resources for Liine to move Lemur to a new platform and relaunch it. In addition, distributing any product always involves costs. Offering a full rebate of the app price is simply non-viable, we would lose money. The initial release of Lemur on iPad is only the first chapter in this second life of the Lemur. Liine is taking JazzMutant’s code and concept into the future, you are going to see a lot of exciting developments (in-app editing, new objects, streamlined workflows…). This will, of course, continue to cost Liine time and money – the small contribution from legacy owners will help ensure the future of their investment in the original machine. Their early support allowed for many updates of the original software. For this, Liine are hugely appreciative as it means that the product we’re able to bring you is the most mature and powerful solution out there. This is why we want to thank those owners by offering them a 50% rebate. We very much appreciate your support.

What do you do if you can’t find an instrument that you can play the way you want? In the digital domain, you can just invent one.

So, when Brooklyn-based artist Nick Demopoulos wanted a controller that’d allow him to articulate digital instruments more like a guitar and less like a keyboard, he built his own expressive touch controller. It uses arrays of touch-sensing strips on a guitar body. A future version, he says, will incorporate 6 “strings” (touch strips).

New York-based literary/culture quarterly BOMB Magazine shot a video in which Nick walks through his creation.

Nick has also played our Handmade Music series in New York, at Culturefix. (See documentation of that event, from 2010.)

Videos of Nick playing:
http://www.youtube.com/user/nicnut210?feature=mhee

Lots of stuff on SoundCloud, too; I enjoy the rhythms in this one:

Whispers in the Water by Nick Demopoulos

http://soundcloud.com/nickdemopoulos

It occurs to me looking at this, too, that if you could improve the sensing accuracy and physical feedback from the touch strip, you could radically improve the instrument. It’s really the quality of these kinds of sensors that will have the biggest impact on future instruments – that is, the fundamental ideas about these controllers are out there, and now implementation means everything.

Thanks for sharing your work, Nick!