LA-based bang Fol Chen (Asthmatic Kitty records) wanted to go beyond the computer as the playback and manipulation device for their music. So they worked with collaborators to invent a solution. In a new video, sounds, and an interview, we can share some of how this came into being.

Built with the monome creators (Brian Crabtree and Kelli Cain) and LA research and experimentation center Machine Project, the Tetrafol is a custom, pyramidal sound device. The object warps Fol Chen’s music using gestural manipulation of playback, but can also use your own samples. And with open-source circuit and firmware, the project could be an opportunity to learn or to build your own creation.

Description:

The Tetrafol is a hand-held tangible electronic sound toy. Circuits enclosed by a wooden tetrahedron detect orientation and motion-gestures to modify the playback of a collection of Fol Chen’s micro-compositions, allowing the user to explore sound through physical manipulation.

The battery-powered device has its own internal speaker but can additionally be hooked up to a headphone or amplifier.

The circuit and firmware are based on open-source hardware and is itself published as open-source, allowing anyone interested to learn about its deepest inner-workings.

Here’s a sample of the project, via the Tetrafol-created Fol Chen track “So Good”:
Fol Chen – So Good by WeGetPress

Built by hand in a limited run of 100, the device sells for US$110 direct from Machine Project. We spoke to monome’s Brian Crabtree about the project – and a new, comically-inclined video shows off the project.

Stems from the track “Back on Kent” come preloaded:
Fol Chen, “Back on Kent” by asthmatickitty

CDM: How did this collaboration come about? How did you work together?

brian: kelli and i have a loving and working relationship with machineproject, a phenomenal organization founded by our good friend mark allen. we’re always amazed at the fantastical variety of projects that are born there. a few inspiring works of recent include a cash machine designed for a children’s museum and a workshop on lockpicking. so when mark approached us on behalf of his good friend adam goldman and adam’s band fol chen regarding a possible collaboration we were all ears. the goal was to design and produce some sort of synthesizer-sampler-effect-instrument-toy-object to accompany the release of their new album. that was about a year ago and we’re happy to see it finalized and soon in playful hands.

in the early stages there was much whittling of ideas (too expensive, too complicated, etc). we arrived at some sort of gestural sample player and a demo video was ready to show the proof of concept (we live on opposite coasts so there was much back and forth through internets and mails) the basic build used a waveshield (by adafruit) and an arduino and some very hacky code i modified.

fol chen provided the sound set. kelli and i proposed a series of enclosures– diamonds, stars, ice cream cones, d20. the tetrahedron ended up being the most beautifully minimal, and incidentally the most cost effective. our friend jason voytilla laser cut a prototype from thin birch ply and we sent the “finished” sample to california where it underwent a series of intense focus groups – thanks to the rigorous machineproject laboratories. after more back and forth, and basic design changes here and there we were in agreement. we used our very reliable production chain that we depend on for monome releases… it was nice really helpful to have that all in place and sped up the process considerably.

the tetrafol accompanies the release of some exciting new fol chen tracks, and there will be a release party of sorts in early december at machineproject. should be very interesting, as the current installation is a 30 foot deep window sill of sorts.

What went into the design? The construction of the thing?

the final circuit board is an arduino, [Lady Ada - Limor Fried] waveshield, and accelerometer smashed together and made very small. i really just put existing technologies together– i can’t take a lot of credit here.

the industrial design was more fun. we didn’t want to use plastic so we experimented with felt and wood. coming up with a size, shape, and feel were the main goals- to create something that was pleasant to hold and sturdy enough to be tossed in the air.

What’s the basic notion of the instrument?

it plays sound loops, or “micro-compositions” written by fol chen. when you pick up and tilt the device it modifies playback: in one axis it changes the playback speed, in the other it triggers a variable-speed stutter (playback position jump). sounds are changed by a shaking motion. given the response is immediate, it comes alive very quickly.

i’d also hesitate to endorse it as an Instrument, though it’s very playable. it’s a bit like a responsive buddha box.

Any other documentation?

i posted the firmware/hardware source on github. there is a no “build your own” guide as you’d be much better off just looking at the waveshield documentation (which is very good.)

this was a fun collaborative side project– and it makes me even more curious to see how musicians continue to create tangible objects to accompany their releases.

More information:
folchen.com

Tetrafol @ GitHub (firmware + hardware, under a GPL v3 license)

Dig into humanity’s past, and alongside the earliest tools, you’ll find some of the earliest instruments. Designing objects for expression seems to be an essential part of civilization.

Martin Kaltenbrunner, a co-designer of the Reactable tangible music interface, is also a professor in Interface Culture at the Linz University of Arts in Austria. There, in the land of Mozart and Haydn, he works with students to explore what interface design is.

So, when I got to spend some time with Martin in New York in September, I was interested in more than just the flashy coolness of the Reactable, the futuristic table-with-blocks interface for music. We got a chance to talk about instrument design generally. The funny thing about the Reactable is that it is closer to the experience of working with a modular synthesizer and oscilloscope than anything else, with the sense of physical connections of sound to object you’d get from classic synths. It is something unique, truly, but that’s its pedigree.

Martin and I got to give a talk together at the Austrian Cultural Forum New York, a terrific hub in which Austrian artists frequently are paired with New York-based folks, all in a lean, tall modern landmark building in Midtown. We also performed together, which for me was a real pleasure; Martin claims not to be a musician as such, but was good fun as an improvisation partner.

The next day, we headed to Manhattan music education center Dubspot, where Martin’s creation quickly attracted crowds of interested students and educators. Dubspot filmed our encounter for the video at top. Amusingly, the prominent synth sounds you hear at the beginning are not the Reactable, but our own MeeBlip open source synth, which I brought along to illustrate conventional tangible instrument design with switches and knobs. (If you’ve been impatiently waiting for news on the MeeBlip, believe me, I’m even more impatient – more announcements on that this week and next, following a production quality issue with a contractor that required us to reboot the run of new instruments.)

Reactable Live @ Dubspot! Interactive Sound Design Workshop Video Recap [Dubspot Blog]

YouTube commenters, that subtle and thoughtful bunch, are complaining that the tangible Reactable will set you back thousands of Euros. But at ACF and Dubspot, I was also equipped with the far more economical and portable alternative: Reactable Mobile runs on both Android and iOS. (I was pleasantly surprised to discover the app runs perfectly on a Galaxy Tab 10.1 from Samsung; I’m still a long, long way from being able to recommend buying an Android tablet, but if you’ve got one, I can certainly recommend this app.) Now, don’t get me wrong: the experience was nowhere near as fun as using the table. On the other hand, you can’t fit the table into a seat-back pocket on easyJet, and the savings in cash is proportional to the sacrifice in experience. What impresses me is that the design of the physical Reactable “flattens” so nicely onto the screen; I think it’s a user experience triumph that you can make that translation. And I was able to load up a few loops of my own music and jam along with the MeeBlip and Martin on the (real) Reactable.

Looking beyond the Reactable, Martin addressed these larger issues of tangible interface design at TEDx Vienna – a fitting locale for talking the history and future of music. His whole presentation, and a sweeping concept map of what he discussed, is available.

Martin Kaltenbrunner: Tangible Music

If you just want to get your Reactable on and can’t afford the table, see Reactable Mobile below. (Seen here on an iPad 2, but I’ve run successfully on the original iPad and the Galaxy Tab – the experience is more or less identical, thanks to portable code.)

And if you can afford the table, you rockstar, uh, can we be your friend?

http://www.reactable.com/products/mobile/
[the awesome table version]
Martin Kaltenbrunner website [with plenty of academic links]

A new design launching this week should appeal to keyboardists who want both more expressive touch control and a keyboard – without sacrificing one or the other.

Yes, yes, multi-touch on tablets does indeed give your fingers access to continuous control for added expression and pitch. But there’s a reason keyboards evolved keys: tangible feedback about where pitches are, and the ability to control dynamics with pressure (itself with additional mechanical tangible feedback) just isn’t matched by touchscreens.

We’ll be looking on an ongoing basis at how you can take the flexibility of those touchscreens and match them with more tangible controls. But here’s one example: the German-engineered Evo keyboard really is a conventional keyboard, with all the advantages therein, but combined with capacitive touch on every single key. In other words, it navigates around the very tradeoffs of which I was recently critical in iPad developments, namely, additional expression coming at the expense of tactile feel. (I got some pretty intense criticism for things I said in that article which remain, to me, fairly obvious: a tablet is not a device you can play with your eyes closed, and – in its present form – no matter how hard you hit it, you can’t control dynamics.)

Of course, this does require buying specialized hardware, and it’s a controller only – unlike that tablet, you’ll still need a sound source and (at least for some tasks) a display, both of which are integrated in the tablet. But it is a compelling alternative that introduces a different set of possibilities for playability.

In fact, it’s also not the first time designers have thought in this direction. All the way back to the Martenot, keyboard designers have looked for ways to bend keys or add additional continuous expression – polyphonic aftertouch being the most common (though still relatively rare) solution. But none of those inventions could build on the accessibility of touch on the keys. I’m curious to see what playing this feels like; fans of getting away from the piano keyboard and all its history entirely will likely (and fairly) scoff, but for those of us who want to merge our piano background, something like this merits consideration.

Here’s how the creator describes it; I hope to catch up with this invention soon in person.

Discover the evo. Worlds first keyboard with touch sensitive keys.

With the help of capacitive touch sensors the evo is able to read your fingers movement on top of a keys surface. Next to pitch and velocity there is now a third layer of polyphonic data input.

Think of polyphonic control of pitch and expression. Think of having a pitch or mod wheel integrated into every single key. Think of never ever leaving a key just to turn or push some knobs or buttons.

So, it’s a combination of classic keyboard key and modern touch technology. The best of both worlds combined in a single keyboard. But best of all! The characteristical function of a key remains unchanged. The evo still features traditional pressure-sensitive keys. But in addition there are now all the advantages from a touch-sensitive input device in every single key.

So. At first this might sound like the evo is an all new instrument. But it’s nothing more than a traditional master-keyboard… With capacitive touch inside every key.

http://www.endeavour.de/discover_the_evo/evo.html

Between conventional knobs and hardware controls and “magical” tablets, might we yet see real action in a third category of controller? Keith McMillen Instruments, makers of the SoftStep foot controller and K-Bow controller, are now venturing into fingertip territory. The QuNeo is a “crowd-sourced” project with apparently some open components, available now in preorder form on Kickstarter.

We’ve seen touch controllers that, in terms of basic form factor, followed similar design directions as the QuNeo but that didn’t take off. M-Audio (then Midiman) got only as far as the prototype phase with the Surface One; Stanton’s SCS series went into production but apparently didn’t take to the market.

The KMI design promises more, with velocity response, continuous pressure, and color LED feedback on each sensor. The addition of actual pressure/velocity sensing, and a design that gives you some tactile feedback on where the controls are, would set it apart from a device like the iPad, which has no such usable pressure response and an undifferentiated surface.

The controls themselves:

• 251 multi-color LEDs
• 16 square pads each with X/Y, velocity, and continuous pressure (that should map nicely to rolls, etc., or using them as melodic pads)
• 2 rotary surfaces with position and pressure
• 9 touch sliders, with two-finger touch
• Switches
• iPad-sized form factor
• Class-compliant USB, MIDI, OSC connection

The project is labeled “open hardware” and “open source,” but as near as I can tell, that applies to the development kit for the software to connect with the hardware, not the rest of the hardware itself.

Check out the hardware sensors below.

Kickstarter here serves as a way of “crowd-sourcing” production – just the kind of preorder model for which the service was built. What I find surprising is the promised price: $200 (not including international shipping) includes the controller and some goodies, which seems astounding given the number of parts here. If they really are pulling that off, I’m very impressed.

Right now, we see only the sensor and a mock-up, but certainly the described design shows some significant promise. We’re in touch with KMI, so if you’ve got questions, fire away.

QuNeo, Multi-touch Open Source MIDI & USB Pad Controller [Kickstarter]
http://www.keithmcmillen.com/

In the midst of all this talk of intangible digital intellectual property and arcane licensing and Internet policy, there’s something comforting about thinking of music and art as something you make with your hands and give to someone. It was a discussion of that – even in the context of technology – that first led me to the discussion of “Handmade Music.” (Tip of the hat to my friend, Etsy’s Matt Stinchcomb, with whom this discussion has crossed the Atlantic from Brooklyn to Berlin.)

Via Cool Hunting, here’s an old-fashioned way of making a music object. The music is on vinyl; the book is carved into blocks and hand-printed. Any sense of nostalgia or twee hipness is instantly forgiven once you see the results: the book looks absolutely gorgeous. Kids will have to compete with their parents to get it.

Two stories in a single canvas-covered volume that reads from the outside covers inward, ending at the center. There, a two-song 70 gram 7″ vinyl inside a hand-cranked copper block printed sleeve.

Stories written, illustrated, carved, and printed by Micah Middaugh at Cavern Lantern Wonder Welding (Jordan River Valley, Mich.)

Songs by Breathe Owl Breathe

The story sounds wonderful, too. As CH’s James Thorne tells it:

“The Listeners” is a comic tale of the friendship between an ostrich and a mole who meet by chance one day in a hole. The mole with sightless eyes and the bird with flightless wings join to form a band called “The Listeners,” and perform together in an underground concert for their friends. “These Train Tracks” is a story of metamorphosis, in which a set of train tracks transforms into everything from a caterpillar to the night sky to a set of pajama buttons. Its mood is both whimsical and soothing, a perfect end to a child’s long day.

The Listeners / These Train Tracks: Music and animal hijinks come together in a handmade children’s book by Breathe Owl Breathe [Cool Hunting]

The music is available by Bandcamp, which you’ll see allows you to sell both a digital download and physical copies. Of course, you may want to do a trailer on YouTube to promote it, which means you’ll have to contend with giant lobbying groups and collection agencies trying to destroy the Interne– okay, that doesn’t make a very good bedtime story. Let’s get back to the ostrich and the mole. They’re more likable.

Have a listen to the music:

http://breatheowlbreathe.bandcamp.com/album/the-listeners-these-train-tracks

Streaming live from Dubspot in New York, Martin Kaltenbrunner and I are talking about interface design and music, in the context of his Reactable tangible interface. Join us, ask some questions, and stay tuned for more video after the session is done. For his part, Martin has the enviable title of “Professor for Interface Culture.” Tune in now and he’s making music with blocks. I’ll be talking to him, and talking about performing without a computer, with Reactable Mobile running on Android, MIDI out of an iPad, a MeeBlip, and a Korg KAOSS Quad, hopefully as part of our ongoing discussions about mobile and interface design.

The appeal of new controllers is melding gesture and sound, metaphor – in tangible form – and musical idea. So before talking about this controller, have a listen to the sounds it produces in the hands of one user, even if another user might do something very different. In a demonstration by Richard Devine, sparse percussive sounds reminiscent of early sonic experiments by the likes of Varese echo in clusters of water-like drops and echoing rumbles. (Richard is perhaps better known for dense, sometimes raucously relentless walls of sound; this formally more contemplative, which I really enjoy, even if it’s just a demo.)

Whether this immediate sonic application is your cup of tea, you can then have a look at the controller. Most of it is conventional, if nicely executed: encoders ringed by LEDs, pots, and buttons. But its central controller, looking like the exposed innards of a hard drive, is something else: the Spin is not a potentiometer, not a knob, not a faux turntable. It’s something different. Instead of just responding to rotation, it responds to inertia, built around the rotational movement but allowing new degrees of subtlety and control. As the creator describes it (well worth reading his entire description, but I like the ideas in this bit):

The spin allow the user to change a parameter with another feeling than a simple potentiometer:
large amplitude movement for a small variation.
control of the increment of the variation.
the spin can be launched and stopped, the variation stay under control using the increment parameter.
the spin can be automated, with 2 parameters for time control: increment and speed.
the spin can play a note and change its velocity, while a rotary controls the note pitch.
the spin can be assigned on any rotary and use its MIDI mapping to change his value, while automated or not.
the spin can fight against embedded sequencer.

(Because of a couple of grammatical errors translating to English, we also know that the spin is masculine. Odd – it seems actually kind of feminine to me. I’ll let you reflect on that.)

The notion of using inertia in a rotary controller isn’t entirely foreign to larger commercial projects; Native Instruments touted something like that in their Traktor Kontrol S4 controller. Here, though, freed from having to operate a DJ software and its turntable-derived sound ideas, inertial control can come to the fore as the principal interaction idea, applied to new musical parameters.

Richard Devine, who’s so on top of things I think he already owns musical inventions that I just happened to think about, is of course all over this. From his description:

The timeFrog II is a powerful and flexible MIDI device dedicated to music computer and MIDI applications.

The spin/inertial sensor provides a totally new kind of control surface, which opens new way for playing with parameters.

The 8 endless encoders, 4 potentiometers and 6 buttons form a functional and compact.

There is also a embedded 4 steps sequencer: 4×4 steps x 6 voices

This patch was setup in Ableton Max For Live using only two instances of SonicCharge’s Synplant software synthesizer. These two patches where customized and designed to work with the timeFrogII. Creating for some very unique musical gestures. All sequencing and note generation is from the timeFrog controller.

Richard tells us:

I recently received this really interesting MIDI controller from my friend Oliver over at Undead Instruments. I met Oliver in Belgium last month when I was on tour through Brussels. I was really intrigued by this midi controller he was working on called the timeFrog II. I only recently had the chance to sit down and play with it. Quite interesting and different approach from the other midi controllers I have seen and played with. I hadn’t seen any proper demonstration videos yet of this strange device so I thought I would do one.

More video demos, from other artists, show the gamut of what this instrument can do:

More info:
http://www.undeadinst.com/products/timefrog

Working in open source code for any platform, Brazilian artist and developer Jeraman has produced a charming project that imagines musical interfaces in dynamic, whimsically-simple sketches. Like doodled knobs, cartoons of guitar pedals, interactive devices on the touchscreen control musical activity.

And because it’s open, cross-platform code, everything from a computer-powered multitouch table to an Android tablet could get in on the fun. Jeraman explains:

It is a digital musical instrument that allows the control of real-time recorded loops through collaborative performances based on relationships between sketches and sounds, intended to be ludic and playful.

Developed in Processing and OpenFrameworks, it mixes multitouch technologies with the interaction metaphor of guitar pedals, by using a FTIR DIY multitouch table – built with PVC tubes, tapes… – with a modified old keyboard as pedal, following a high-end / low-tech approach.

Here’s an example of performance using an early prototype. By the way, sorry for the poor musical quality… I’m not a professional musician!

The project is also open source and the code, that may allow the instrument to be ported to others plataforms like Android, iPad and cardboard boxes (yes! using this http://sethsandler.com/multitouch/mtmini/), will be released soon.

This is possible due to the independence of the gui module (developed in processing) and the looper module (developed in openframeworks).
for the communication between both, it was used OSC protocol.

Some pictures can be found at:
http://www.flickr.com/photos/jeraman/sets/72157626935130739/

For further informations, check this site (sorry, in Portuguese):
http://jeraman.info/illusio/

It’s a fascinating-looking project! Do keep us posted, Jeraman — and readers, if you happen to play with the code, let us know! Oh, and never apologize for Portuguese – it’s a gorgeous language!

See also some nice examples of Jeraman’s previous work:

See, previously:
Robotic Twitter Songwriter Generates Tweet Poetry

You may have seen it already as it makes its viral rounds, but an advertising video for Japanese mobile giant NTT Docomo is a poetic model of how musical events are encoded, whether through means tangible or digital.

A track of pitches makes a wooden ball into a mallet, traversing a track as it is driven by gravity. The keys of that track become a xylophone, the traversal of space sequencing notes in time, and you hear Bach Cantata 147, “Jesu, Joy of Man’s Desiring.” While there’s a clever take on a trill, the only disappointment is that we don’t get polyphony – I’ll let you work out the Rube Goldberg-style machination necessary to make that happen. This being Bach, though, a single line itself contains contrapuntal motion and sounds just beautiful on its own.

But it’s also remarkable how the idea of Bach, the essence of the musical information, can be so neatly encoded in a simple machine. Computing, after all, owes its very existence to tangible, mechanical constructions first developed for textile manufacture. We get punchcards because these devices were built for automated clothing makers, containing logic in mechanical form. MIDI is often derided for being simplistic, but in that same simplicity is the elegance with which we can store a musical idea – a simple representation of relative pitch in time is often enough. And whatever the source, there is a relationship, as in this video, between the simple stored event and the complex sound that can result once triggered by that event.

As you watch the track extended through the forest, you also see the way in which a single melody line is spatial. There, against a forest, there’s a wonderful sense of the conceptual against the organic, artificial thought against a deeper universe.

Oh, and, uh, you’re supposed to by a phone or something, but I’ll ignore that part since most of us aren’t even in a part of the world that’s getting the phone.

It is, however, all real. Filmed in Kyushu, Japan, it’s the work of acclaimed director Morihiro Harano, who insisted on doing all of this record in the field. In fact, it’s too bad we don’t know more about the recording, as that in itself is a story — and requires careful balancing of natural sounds to create the final mix. There’s more information in a lovely blog post by Lia Miller, for The New York Times:
Doe, Xylophone, Cellphone

Also, great headline. A doe’s a deer, a female deer, right?

While not the intent of the ad, I know I’ll return to this image the next time I’m reflecting on encoding music, scores, time, and space. And maybe I’ll be fortunate to do so in the woods.

Thanks to Liz McLean Knight (Quantazelle) for the inspiration.

And, via Nick Inhofe, a making-of video is available for viewing!

Moving beyond touching a screen as two-dimensional plane, Roger Linn’s concept music controller, the Linnstrument, adds tactile response and expression. Roger calls it “3D Note Expression,” but in lay terms, it means pushing harder on the controller makes it respond differently, as you’d expect from a physical instrument.

Roger this week posts an update on how his development is going and what he imagines – good timing, as this week we also saw another design on the same lines, the Soundplane. The sensing methods are different, enough so that I can easily see room for both, but the upshot is the same. Randy Jones in that story also reflects that, once these things are invented, what will really be essential is musicians to play the things and develop lots of interesting software that can use the controllers. See, previously:

A Glimpse of the Soundplane Controller, Innovative Tactile Multi-Touch, in the Lab; Call to Action

The major change in Roger’s latest update, apart from adjusting the form factor to something longer and more spacious, is the addition of different overlays, including traditional keyboard “manuals,” fret-style grids, and honeycomb-patterns hexagonal grids like the one at top.

It isn’t just a blank slate any more – certainly not in Roger’s mind, at least. Linn, a guitarist by training, has an extensive schema worked out for a grid that would function like the frets on a guitar neck. Movements in any direction can make an adjustment, impacting timbre (perpendicular to the front edge), pitch bends (parallel to that edge), and loudness (pressure).

It’s still all concept, with one working prototype; Roger’s professed style is to work in big-picture concepts. But I’d love to see some of these ideas reach fruition.

I’m still hopeful that a simple, inexpensive, open source option could evolve from this landscape. I hope for that not necessarily even because of a philosophical belief in open source so much as the sense that such an open field could lend itself to experimentation by, say, the people who read this site, not only in creating software but building the instruments. In the case of Roger’s design, unlike the more novel approach used by Randy, patent questions are less of an issue. And a community of people experimenting in such a way could simultaneously yield software that could be compatible with the proprietary and commercial projects.

Lots more ideas and reflections – including detailed notions of how you’d play this thing – on Roger’s site:
Preview: LinnStrument – A New Musical Instrument with 3D Note Expression

And here’s a new video, entitled, cheerily, “Gloomy Sunday” (the music of Rezső Seress):

For review, Roger’s original demo video: