Hands-on, Interview: Stribe Multi-Touch Controller

Once the domain of the few, creating and customizing sophisticated DIY controllers is now more accessible than ever. That means, if you can’t find what you want, and you’re ambitious and knowledgeable enough, you go make your own. Josh Boughey was impressed by the Monome enough to buy one — but the Monome, a grid of on/off buttons, doesn’t provide any kind of variable control. So Josh built his own, combining a series of parallel touch strips with LED indicators. (The lights are the tricky part, requiring an obscene number of connections.)

The creation, dubbed “Stribe” by Josh, could have been a one-off. But instead, he’s working on making it into a tool for others, with completely open source hardware and software. The whole system is built on the popular Arduino platform, making it uncommonly easy to modify. It’s a work in progress, as you can see lacking an enclosure. But ten have made it out into the wild, people are already programming custom software, and more are coming.

I got to hang out with Josh while he was in town this weekend. Luckily, he’s a fan of early music, meaning we met at a concert of a viol consort that was playing my music — an unusual collision of 15th and 21st Century music technology.

Josh gave a demo of the Stribe, for myself plus Phil Torrone of Make and Limor Fried (aka lady ada), creator of the x0xb0x open-source 303 clone. It’s still a project in process– there’s more to be done in firmware and support software and documentation — but it already shows some real promise. I snapped some shots, studied the Max patches, and mostly listened to Limor and Josh talk about the challenges of starting a DIY hardware business. (I hope that DIY builders start to share experiences, even informally, as they work to make the business end work so they can keep building.)

Just what can happen when you let your baby go? Someone else can do stuff with it you didn’t expect. Here’s musician Stretta developing music ideas-in-progress with the Stribe (see blog post, Stribe forum thread):


A Brief Conversation Resulting in One Less Child from stretta on Vimeo.

Some tidbits from the hands-on session:

read more

MidiTron Wireless: Make Your Own Wireless Sensor-to-MIDI Project

OLYMPUS DIGITAL CAMERA

Eric Singer, creator of musical robots and maestro of LEMUR, the League of Electronic Musical Urban Robots, has unveiled a new wireless sensor-to-MIDI interface. It’s quite a bit pricier than the non-wireless MIDI models at US$495, but the payoff is a complete kit for wireless performance that promises to be resistant to both latency and interference. The receiver can be connected via either USB or MIDI, and the sensor unit has 20 inputs which you can mix and match as up to 10 analog ins and 20 digital ins. Put the sensor/transmitter unit wherever you like, then transmit data wirelessly to the receiver — so the sensors could be strapped to a dancer while a computer or synth receives the data elsewhere.

I hope to have a hands-on demo soon, but in the meantime, here are the specs — just in case that wireless project can’t wait any longer.

read more

Meet the Stribe: DIY Multi-Touch Controller and Potential Monome Mate

From ribbons to multi-touch, musicians are looking for expressive controllers, ones that allow continuous control for performance.

Oh, yeah, and it’s like totally super-cool on the original Star Trek when people run their hands over the Transporter controls and the blinky lights move. I mean, like still super-cool, even in 2008. (Hint: try to look completely chilled out like Spock when you do it.)

So, one of the things I noticed when the Monome was first introduced was, excellent as that open controller is, you’ve got buttons and no continuous controls. Ever wished another nice square box could sit next to it and give you multiple touch controllers? Good news: Stribe is here.

The Stribe is an 8-channel multi-touch controller for music or video software. 1024 individually-addressable LEDs provide animated visual feedback.

The low-resolution (16 x 64) LED display is controlled in real time by either firmware or host software, or both. MIDI or OSC communication to compatible hardware and software is achieved via patches written in Max/MSP.
Touchstrips down the center of each channel trigger events in the software and the firmware, which drive the display, creating a haptic feedback loop. Each of these eight “channels” has two 64-led-tall columns, e.g. a left and a right.

The Stribe can act as a touch controlled meter bridge, or as an interactive, animated16 x 64 led display. Oriented horizontally, the Stribe can more intuitively interface with step-sequencer type applications, or allow direct manipulation of granular synthesis sampling, or allow the user to perform “scratch” like gestures

or…?

read more

Censored Video: Max/MSP and Physical Computing Power X-Rated Musical Inventions

Photo: Donald Bell, via Flickr. By the way, USB ankle plugs aren’t just for women; I have one. It’s a huge boon while traveling, though I wish I were getting lower audio latency.

Expressive technologies, like any other media, will say whatever their creators want them to say and do what their creators want them to do. Surveillance? Entertainment? Worship? Porn? You can count on all of the above, and everything in between.

Usually, when you talk about interactive multimedia software Max/MSP and real-world sensor inputs, you expect live music performance. Multimedia artists Matt Ganucheau, Kyle Machulis, and Kelly Moore took their project in a different direction, building a mannequin that would respond interactively to simulate female pleasure.

Donald Bell (aka electronic musician Chachi Jones) describes this among other projects recently shown at the adult-only tech fair Arse Elektronika (a reference to the artsier European new media show Ars Electronica).

It may sound like Weird Science, but Matt promises that Lisa’s technology is nothing mystical. A cutaway in Lisa’s back reveals a Make controller board that works as a hardware router for all the touch-sensitive sensors mounted on the mannequin’s more sensitive areas. A USB plug found on Lisa’s ankle connects to a nearby computer that handles the software end of things. Matt developed Moaning Lisa’s unique software using a visual programming language called Max/MSP. The program uses a neural networking algorithm to monitor all of Lisa’s sensors and determine her state of excitement, which in turn modulates both her volume and number of moans.

More on Donald’s new blog for CNET, MP3 Insider (which I think will be far cooler than that blog name implies):
Weird science: Lisa the foreplay robot [CNET MP3 insider]
Making the ‘Moaning Lisa’ [CNET crave]

Donald also shot a video, but its adult subject matter and mannequin nipples were deemed too hot for CNET. As I said, technology clearly has a full range of possible applications, so I’ll leave it to you to decide. I’m not necessarily building a Lisa, but I assume you can determine on your own whether you find this offensive and choose whether nor not to watch. Not-safe-for-work / those who don’t like nude mannequins and iPod-powered sex toys:

read more

Make the iPhone a Music and Multimedia Controller Instrument, via Max/MSP/Jitter

The day the iPhone was announced at Macworld, some of us immediately wanted to use it as a simple multi-touch controller for music. It’s no substitute for a dedicated, large, expressive multi-touch controller like the JazzMutant Lemur. But it’s also far less expensive, useful as a phone/Internet device/media player, and could easily be a simple, multi-touch controller. Basic multi-touch gestures could be a powerful tool for controlling music. Then, the sad news came that development wasn’t going to be open. Hearts sank.

Good news: Masayuki Akamatsu, the brilliant Max/MSP developer who first bridged the popular modular audio and multimedia environment to the Wii remote (see aka.wiiremote), is on the case. It’s still early in development, and for now is an extremely simple implementation: it only routes buttons and text on a Safari webpage to a Max/MSP patch. What’s cool is that it uses the OpenSoundControl (OSC) protocol to do it (with PHP on the Web end), and it works (you can even use it now if you’ve got an iPhone):

aka.iphone Preview
Discussion on the Cycling ‘74 Forums

Let’s talk about what this is not: it’s not multi-touch.

read more

Wii DJs Scratching with Traktor on Wiij, and Wii, Wii Everywhere?

Is the Wii controller the new mouse? They’re starting to pop up all over the place, with all sorts of applications. As the villain in Pixar’s The Incredibles says at the end of the film, “When everyone’s super, no one is.” The related principle is, “When everyone has a gimmick, it’s not a gimmick any more.” Result: the gimmick disappears, and people focus instead on sounds and (in the case of Wii) the fun of moving around. And that’s a very good thing. (Hey, we got far more mileage out of the darned mouse than we every should have.)

We saw a proof of concept scratching using SuperCollider and the Wii remote a few months ago. I enjoyed that the results were sonically a little strange. But our friends at DJWiiJ now have more practical scratching set up with Traktor.

More details:

Wiij Scratching Now a Reality - Demo Video Provided

Yes, turntablists, I know — it doesn’t sound so much like normal scratching. As one commenter noted here, though, if you want vinyl, just use vinyl. Here, there’s almost a cartoon-like, digital scratching effect, like what turntablism would sound like in a universe with different physics than our own. This also demonstrates what can be possible with a different controller: you can differentiate what you’re doing in terms of custom software or software setups and … well, practice. DJ ! says he’s practicing, for his part.

Keep the examples coming. Oh, and CDM isn’t becoming the all Wii, all the time network — I’m still catching up after a long weekend, but more soon. I’m hoping you’re also catching up on work, so we’re kinda even.

What? You actually still want more Wii DJing? Fine…

read more

Refresh: Asides

Wii Control for Macs: OSCulator, for OSC, MIDI, and Keystrokes

I must make a correction and clarification in regards to OSCulator, the Mac utility for connecting to Nintendo’s Wii remote, which I mentioned in today’s Deckadance story. Despite the name, it supports the broadly-available MIDI as well as (for programs like Max/MSP, Pd, Flash, Director, Traktor, Reaktor, Processing, and others) OpenSoundControl. Simon Balarbe writes us:

It does not just support Osc but It outputs Midi and keystrokes also … Recently I used it with Ableton Live in a live Electro Acoustic Performance at University. I find it more stable than WiitoMidi and it had MIDI output and use of the accelerometer before WiitoMidi.

Fair enough! So there you have it: grab a Mac with Bluetooth support, a Wii remote, and OSCulator, and you ought to be able to communicate with any software you like — even if you can’t do MIDI, you can do keystrokes.

Most of my time I’ve been using the aka.wiiremote external for Max/MSP, just because that’s convenient if you’re a Max user. But for all other Mac users, OSCulator indeed looks like the most versatile choice.

OSCulator Wiki/Project Page [Mac software]

Free Wii Drum Machine for Windows Update, Plus Wii in .Net and Java

Wii Drum Kit

Evan has been hard at work on his free Wii remote drum machine for Windows, and he’s got a fantastic new version with an updated interface, more features, and nunchuk adapter support. All you need is a PC (or Mac) running Windows, a Bluetooth adapter, and Wii remote. (Hey, speaking of which, anyone know if this works with the Mac Bluetooth adapters and Boot Camp?)

My Wiimote Drum Kit [thisisnotalabel.com, Evan's site]

The basic idea: make a hitting motion, get drum sounds. (It uses a straight trigger, meaning it’s likely to be very reliable.)

Advanced Readers: Program Your Own

Just in case you’re interested in programming your own project (yeah, I know, lost 95% of the room there), there are solutions for interfacing with the Wii. Evan used Brian Peek’s managed library for .Net (C#/VB.NET):

Managed Library for Nintendo’s Wiimote [Coding4Fun, a great site for MS-platform programmers]

There’s also a beta-version Java library out there called WiiRemoteJ, though that also seems to be Windows-specific. (Someone who knows about Java Bluetooth support, feel free to chime in; that’s beyond my knowledge level.)

Wiimote via Java [Willi.org, the awesome wiki/community site for all things Wii]

More Wii Music Control

Wii Sound Spatialization, Aided by Pizza
Wii as Lightsaber: More Kyma-Synthesized Goodness, But the Original was Cheaper

Another tool, this with quite a few more options, via looping capabilities from Max/MSP:
Free Mac Looper for Wii Controller, Wii MIDI Hacking Round-up

..and my personal favorite demonstration of Wii remote as musical interface:
Expressive Wii: Open Sound Control - MIDI - Wii - Kyma on Mac

Refresh: Asides

Wednesday: Free Unusual Music Inputs Workshop and Performance in NYC

Ready to start using sensors and unusual interfaces for music, but don’t know where to begin? I’m doing a workshop tomorrow night (Wednesday) here in New York giving an overview of alternative musical inputs, including infrared sensors and barcode scanners. I’ll be on at 9:30pm as part of the Warper Party, a two-level monthly grab-bag of digital music and visuals. It’s free; check the Warper Party site for details. I am working on an online version of these materials, too, with more extensive tutorials, but the in-person event is a convenient way to start alpha-testing the material. And yes, we have the International Conference on New Interfaces for Musical Expression coming to the city shortly — though I find it’s usually helpful to translate some of the more advanced/academic stuff to a wider audience, so stay tuned for more of that!

Maker Faire 2007 in Photos

CDM Maker Faire Photos

Maker Faire this weekend had plenty to offer fans of DIY musical gear, from Theremin karaoke performances to wild, home-built instruments from independent DIYers and academics. I spent most of the weekend tied to my booth, making music by scanning barcodes, manipulating a simple infrared sensor and touch sensor, and running live interactive visuals in Jitter. (The last turned out to be a huge hit with babies and their parents. Seriously.) But I did get out a bit; my impressions are documented on Flickr:

Maker Faire 2007 Flickr Photoset

If you were there and have some images of your own, or have seen a gallery you especially like, send it our way!