DIY 3D Controller: Inspired by Theremin, Powered by Arduino, Processing

DIY 3D Interface: Tic Tac Toe from Kyle McDonald on Vimeo.

The Theremin, not too far off from its one hundredth birthday (start planning now), was a breakthrough in enabling a touch-free gestural control in space. Using the same principle that allows the Theremin to sense hand position, Kyle McDonald has created a 3D interface, and posted the process on Instructables. CDM gave him some of the inspiration:

Your recent post, "Theremin as AV Controller", inspired me to finish an idea that’s been living in my sketchbook. It operates on the same capacitive sensing idea as the Theremin, but in 3D — using just an Arduino, aluminum foil, and six resistors. I’m planning on using it as an instrument, interfacing with a wave terrain synthesis system. In the meantime, I put together a demo video and an instructable so other people interested in alternative controllers can experiment with it. The code is in Arduino outputs coordinates via serial, and the example code is done in Processing, so it’s only minutes from interfacing with your audio/visual tool of choice.

In the spirit of sharing, Kyle says he’d be happy for people to improve on the design: “If you think you can build one that is simpler and equally accurate, or slightly more complex and more accurate, share in the comments!”

DIY 3D Controller @ Instructables: “Make a 3D interface using an six resistors, aluminum foil, and an Arduino. Take that, Wii.”

Here’s the original post, which came from our friend Sarah Angliss, who’s been using the Theremin as a controller for A/V sets in Max/MSP/Jitter:

Theremin as AV Controller: Technical Details from Spacedog

Updated: Kyle writes with some additional details on what he’s doing musically, and from where he draws some of his inspiration:

read more

Theremin as AV Controller: Technical Details from Spacedog

You’ve heard the Theremin as a sound-making instrument. But it can be a MIDI controller, as well – an extremely sensitive and expressive one. Continuing our DIY round-up, here are the details in case you’d like to try it yourself.

When we last heard from Sarah Angliss and Spacedog, we were introduced to their creepy Theremin-playing doll Clara 2.0. Now, they’re using the Theremin as an audiovisual controller, triggering audio and video samples from the 1968 film The Devil Rides Out and my personal favorite, a parakeet training record. The result is a new version of the ballad “Willow’s Song” cult classic The Wicker Man (1973). (Wikipedia understands if you don’t.) Here’s a live performance of the result:

I figured readers might want to know more about how to use the Theremin as a controller, so I asked Sarah for more details.

read more

MachineCollective: Open, DIY Modular Controller Platform Coming Soon

Something very funny has happened in the world of music controllers. It started with the rising popularity of Ableton Live, along with the likes of Reaktor and Max/MSP, as musicians started creating more dynamic, rich live performances with computers. Supposedly, this shift should have created new controller designs. If Live was the killer app, where was the killer hardware?

Instead, what we’ve gotten is a sort of primordial soup of controller experimentation, with people hacking together circuits, appropriating Wii remotes, abusing and warping commercial controllers, and generally resisting any standardization. The results have been, in short, fabulously chaotic. And maybe that’s the point – just as, even with relatively standardized music tools, musical variety remains virtually infinite.

Of course, there’s one little problem: working from scratch might (ahem) not leave you any time to make the actual music. (Doh!) So, if there’s not a killer single piece of hardware, what might a platform for experimentation look like. MachineCollective responds to a pretty nice wish list:

  • Modular components you can mix and match at will
  • Agnostic components that might be picked up by people building instruments, synths, controllers, circuit-bent projects, visual apps, or even non-musical electronics projects
  • Easy combination with platforms like Arduino and Wiring and software like Processing, Max, vvvv, Flash, and other programming environments
  • Rapid prototyping and manufacturing
  • Get stuff shipped, or use your own local tools / local fab facility
  • Fully open source licensed (it’s actually not clear which license – the CC non-commercial license would presumably mean you couldn’t build one of these and sell it, which I think builders might want to do)

That sounds great. So what is it, actually? The “platform” for now is just the physical components: a top panel of acrylic, an aluminum base, and a bottom panel. You do get machined holes and connectors, though, which could help you radically speed through the stuff that’s hard to do on your own – that is, machine solid cases. And if this catches on, it’s not hard to imagine people swapping circuits and software patches and such that puts some life into that case.

Looks great on paper; we’ll have to see what the actual platform is like. But in the long run, could locally-manufactured, open platforms someday stand alongside the conventional musical hardware industry? I think it’s very possible.

Thanks to everyone who sent this my way!

machinecollective.org

Keyboard + Monome = One Crazy DIY Instrument Hybrid by STS9’s David Phipps, Plus New Album/Tour

The Monome is small and elegant, but there’s something to be said for traditional instrumental controllers like a keyboard. So why not combine them? David Phipps of the electronic jam band Sound Tribe Sector 9 did just that, and sends CDM this photo of the project in process. He’s off on a five week tour starting Friday, so it’ll be on hold for a bit, but even not-quite-done I had to share it. David writes:

i hope to bring ‘The Peaceblaster’ on tour in the fall. note the unashamed reference to our album available July 8th:)
i picked up a 5-octave fatar keybed and MKE electronics from doepfer via analog haven.  he carries 2-5 octave bare keybeds with simple channel/octave controls, all fatar (the highest quality italian-made keybeds you can get…and doepfer is the ONLY place you can order a
keybed from fatar without being a manufacturer). the 8 knobs and faders are the doepfer PKE, a super simple plug and play solution that could have been a midibox or arduino. add a edirol midi>usb cable, usb hub, and multi-voltage power supply and i’ve got one power plug, one usb
port, and midi out to drive hardware synths.
i’ve left room in the enclosure for a mac mini (or small form factor pc or linux box)…but that’ll be a stretch of my willpower to get it done.

I’d call it a keynome. (For the record, the product name monome rhymes with Ma Gnome, not Ma No May or ole.)

About that new album: it’s available independently through the artists. Their freebie add-ons are really interesting. The CD pre-order includes a coupon to watch a rehearsal online. But the Fan Pack is even better: aside from the CD, which includes fully-recycled packaging, it adds a 1GB STS9-designed flash drive with the digital album, video from DemocracyNow!, photos, screensavers, and the like, an autographed picture of the band, a handmade doll, a download coupon for a live show, a print with a box of crayons to color in your own design, a poster, a 7" vinyl, and other extras. US$99.99. Even if you’re not an STS9 fan, there are some good ideas for artists looking to make music purchases tangible again — especially if they have a fanbase this loyal. See their merch site for all the goods.

I especially like the crayons.

Previously:

Sound Tribe Sector 9 vs. Monome: Video, 8by16

Building a Custom Monome Controller, with STS9’s David Phipps

Handmade Music Returns: DIY Music Tech in Brooklyn 7/8, Video


Create Digital Music Night at ETSY LABS from Etsy on Vimeo.

Handmade marketplace Etsy.com, DIY "mook"/blog Make, and createdigitalmusic.com again team up for another Handmade Music Night at Brooklyn’s Etsy Labs! For an idea of what it’s about (or perhaps inspiration for starting something similar in your corner of the world), see the video above.

On tap:

Chiptune gaming systems for music, strange alternative MIDI controllers and sound-mangling custom software, repurposed vintage synthesizer chips made famous by the Commodore 64, digital visuals, a musical Nintendo Wii balance board, and wireless sensing controllers…

And more.

Where/when:

7/8/08 - 7pm onward (free!)
Etsy Labs
325 Gold St., 3rd floor
Brooklyn, NY (Map)

You can rsvp to rsvp@etsy.com to give us an idea of who’s coming.

Bring your stuff!

As always, we welcome projects in various states of completion! So bring in your DIY software / hardware / circuit bending / chiptune / hacking / patching creations and share them with a friendly, relaxed crowd of fellow geeks!

If you want to give us some advance warning / do a short performance, you can fill out our summer "call for works" form (assuming you haven’t already). (See previous story and scroll down; direct Google Docs link. If you have trouble with the Google Docs form, try our contact form.)

Elsewhere:

Handmade Music Night returns! - 7/8/08 [makezine.com]

Handmade Music Night Featured on Current TV [Etsy's The Storque]

Wii Rock Band Controllers + Mac: Use junXion, Game-to-MIDI Controller Tool

A new version of Rock Band (for Wii) means still more ways to turn these game controllers into musical or visual performance instruments. Jordan Balagot writes with some hands-on experience using junXion, a wonderful tool for adapting game controllers to MIDI or OpenSoundControl. (junXion also works with Wiimotes and nunchucks, audio inputs and pitch sensors, joysticks and standard USB devices, and much more, so even if this bores you, you’ve probably got some use for it.)

Jordan says:

I tried plugging in the Rockband for Wii guitar and drums into my mac and Junxion recognized them perfectly. This seems to be the easiest solution for turning the rockband instruments into real instruments because it has low latency and the Wii instruments are already USB.

Full instructions at his blog:
Turn Wii Rock Band Instruments into Real Instruments with Junxion

junXion is wonderful, though that EUR75 stings here thanks to the weak US dollar and the fact that we have fewer grants and have to pay for health insurance and hospital visits and whatnot. (Especially any Wii-related injuries.) There are other ways of getting at this data, as it’s USB HID — try Osculator on Mac or GlovePIE on Windows, not to mention HID input in Max/MSP and Pd. That said, junXion remains a very powerful option and worth a look.

Other Rock Band controller tips?

We’re still anxiously awaiting what our friend David Lublin of VJ app developer vidvox does with his — as pictured below. (He was searching through createdigitalmusic looking for tips, so, erm, I’ll be sure to update the site with whatever he finds!) Expect some drum kits triggering videos. (Photo by Todd Thille.)

AirPiano: Touch-Free, Sensing Gestural Music Controller

Omer Yosha has created a beautiful, elegant interface that uses infrared sensors to control music applications. Touch-free interfaces, of course, date back to the Theremin, but Omer is trying some new things here, creating an invisible matrix of controls in the air. And I love the way the physical object looks. He writes to tell us about the details:

I’m an Interface Design student from the FH Potsdam (near Berlin), i have a musical background, and the idea to create an AirPiano developed as i was playing around with the Arduino board, Processing and some IR sensors in my free time. It was fun controlling MIDI through moving my hands in the air, so i eventually found a way to set it all up in a way that makes sense and that is easy to control.
The concept behind the AirPiano is having a matrix in the air, with virtual keys & faders. The location of each key must be very clear for the user and easily learnt. The AirPiano is therefore only one example of an application that could adopt this concept. Since it is only the first prototype i built, it features at the moment a matrix with 3 layers, 8 keys for each layer. As long as a key is triggered, a note plays and an LED underneath the virtual key turns on (unfortunately it is hard to see it on the videos). The LEDs give the user additional feedback. The device is connected through USB and communicates with the AirPiano Software, which allows the user to assign each key/fader with a Note/Controller number, Channel and Velocity as well as transpose and save/load presets. The AirPiano Software can communicate with any MIDI instrument/sequencer. It is of course a polyphonic controller.
The AirPiano is not only fun to play, it also invites to experiment, to explore endless arrangements and develop new playing techniques. It might be useful for DJ performance, as a music therapy instrument or as a toy.
I’m at the moment trying to look for investors and people that could help me take this idea further. I presented the prototype two months ago in the Hannover Messe and received very good feedback. The concept is protected as a Provisional U.S. Patent Application.

If you can help him, chime in! I’d love to see what develops.

Here it is controlling Ableton Live:

More photos and another video to give you a sense of how this works (it’s particularly clear once you see the software interface):

read more

Nintendo DS Goodies: glitchDS Update, repeaterDS, Wireless MIDI, DS-10

Can $130 buy you more versatile digital musical studio hardware than (bizarrely) a Nintendo DS loaded with homebrew software? The software keeps rolling in.

The wonderful cellular automation synth glitchDS has just gotten its 1.3 update, with per-sound volume, a tap-able “pad play” page for triggering samples, quick snapshot saving, and other improvements.

Better still, the author has created a new tool, demoed in the video above. repeaterDS lets you draw on the DS screen to play a looped sample, with the Y axis impacting repeat length and X axis controlling playback offset.

repeaterDS

(Thanks, foosnark!)

dsmcu is an in-progress wireless mix controller, focused on wireless control of the mixer in the affordable Windows production app Reaper. (Eventually Pro Tools, Logic, and other DAW support is planned.) Right now, it works with the mcu protocol to support two-way fader control, VU meters (handily displayed on the top screen), track controls, banks, and scrubbing. Dan warns it’s a little tricky going getting it set up, but it looks well worth it for the brave:

Project page / getting started

Author Dan has also created a drum machine, synth, and sequencer program called bliptracker

If you’re having keeping track of all this goodness, Dan has put together a little list of the best music tools for DS:
DS music apps

And if you like wireless MIDI, be sure to check out DSMI, on which the other wireless implementations are generally based.

Finally, the Korg DS-10 DS cartridge got its launch in the UK last week, although there’s not really any news to report from the launch event and we’re mostly still waiting to get one. In the meantime, though, the 1UP Show has picked up the DS-10 in this video:

Hope to have CDM’s DS-10 hands-on soon, once I can get my hands on a DS-10!

Laser Cello Played by Musician and Animator Helene Berg

Helene Berg is a cellist. She’s also an animator, video artist/filmmaker, and does yoga and water-aerobics. So when she plays cello, it’s fitting she might play more than just any old cello. Enter the lasercello, an augmented rendition of the traditional instrument designed by Jonas Ericsson of the Stockholm design agency No Picnic.

Documentation is scant, but Helene writes us with this video to give you an idea:

I think it beats having just a laser harp.

Her links:
www.helene-berg.com
www.myspace.com/heleneberg

Wii Balance Board Surfs Through AudioSurf Music Game; Music Apps Next


BodySurf :: AudioSurf + Wii Balance Board :: Vegas Demonstration from Chardish on Vimeo.

Never that impressed by people waggling the Wii Remote? Time for some full body-weight control. Enter the Wii Balance Board, the force-sensing hardware bundled with Nintendo’s Wii Fit.

Evan Jones, aka Chardish, has hooked up the balance board to the fantastic Audiosurf, a music/rhythm game that allows you to play through your existing music collection rather than needing special content. (Vive le FFT!) Audiosurf is ten bucks on Steam, Valve Software’s indie-friendly, happiness-packed online service, so Mac users, if your Boot Camp hasn’t been getting any love and you needed an excuse to boot Windows, this is it.

The key ingredient is a script for GlovePIE, the Windows-only software for custom connections to lots of hardware,  including the P5 data glove. I heard a nasty rumor that GlovePIE development is on pause, but I haven’t been able to confirm that.

Of course, I bring this up as it’s not just for gaming. Like the Wii Remote, the Balance Board is a simple Bluetooth device. The force sensors are really accurate – easier to work with, in fact, than accelerometers. Given the relative paucity of good controllers for your feet in music, that makes the Balance Board intriguing indeed. I’m interested in making it work with Java, as well, as that would work across platforms and with Processing. Weekend project: Balance Board hacking. If anyone is interested in joining me, drop me a line; otherwise I hope to have some results for you soon.

Wii Balance Board + Audiosurf + Motion Controls = Awesome [Chardish's site]

Via Joystiq