Mobile computing has already had an enormous impact on music making. A modern phone or tablet (and yes, most often, these come from Apple) is capable of out-performing a lot of dedicated hardware and easily runs the synths and workstations that required state-of-the-art desktops just a decade or so ago.

But what if this same computing power – low-energy, low-cost chips – could be in other music gear, too? They could offer significant advantages. Bare boards, while on their own not quite road-ready, can wind up in music-friendly housings. (Think stompboxes – without stomping on your phone, or buying a big, silly dock.) You’ll never have to sign a contract with a phone company to get one, or stop your latest song sketch to take a call. And they could be significantly cheaper: the Raspberry Pi isn’t quite ready for mass consumption yet, but it has already begun shipping at US$25, meaning the entire computer costs what a phone car charger might.

In fact, much as the original personal computing revolution took computing to masses of new audiences, this could extend music computational power worldwide. We’re not just talking strange DIY software, either – these boards run Linux, meaning a lot of off-the-shelf music software will “just work,” including even some fine commercial entries.

If you’re ready to stop dreaming and start making music, now’s a great time. CCRMA at Stanford in the United States and STEIM in Amsterdam, NL have each been working on development. STEIM even has a workshop scheduled for June, taught by Edgar Berdahl (CCRMA) and Florian Goltz (DE):
Satellite CCRMA: Interactive design with open embedded computers

The instructors offer some great inspiration about what this is all about in their description:

These small computers combine the connectivity of a laptop with the computational power of a high-end smartphone; however they are less expensive than either and fit inside a cigar box. We will dedicate much of the workshop to prototyping new functional artworks, for example: musical instruments, effects processors, interactive installation works, and anything else you can imagine that requires high computational power in a small, inexpensive footprint.

In the broader sense this workshop deals with interaction design: What happens when human behaviours meet those of machines?

But even if you’re not able to get to California or Holland, you can give the software a try. The BeagleBoard is now supported by a custom distro; the Raspberry Pi seems a logical next frontier once it starts shipping. With Pd (Pure Data) included, you can even copy-and-paste instruments and effects like synthesizers, step sequencers and drum machines, and granulators built by a broad community – even without necessarily being a master patcher yourself. (And then, when you do want to modify the way it functions or sounds or gets controller, you can.)
https://ccrma.stanford.edu/~eberdahl/Satellite/

It’s not all beginner-friendly yet, but these hacklabs seem the perfect way to begin to move in that direction, as more people test the solutions, gather data on how different patches perform, and make tweaks and write documentation.

How do you visualize the invisible? How do expose a process with multiple parameters in a way that’s straightforward and musically intuitive? Can messing about with granular sound feel like touching that sound – something untouchable?

Music’s ephemeral, unseeable quality, and the ways we approach sound in computer music in similarly abstract ways, are part of the pleasure of making noise. But working out how to then design around that can be equally satisfying. That’s why it’s wonderful to see work like the upcoming Borderlands for iPad and desktop. It solves a problem familiar to computer users – designing an interface for a granular playback instrument – but does so in a way that’s uncommonly clear. And with free code and research sharing, it could help inspire other projects, too.

Its creator also reminds, us, though, that the impetus for all of this can be the quest for beautiful sound.

Creator Chris Carlson is publishing source code and a presentation for the NIME [New Interfaces for Musical Expression] conference. But this isn’t just an academic problem or a fun design exercise: he also uses this tool in performance, so the design is informed by those needs. (I’m especially attuned to this particular problem, as I was recently mucking about with a Pd patch of mine that did similar things, working out how to perform with it and what the interface should look like. I know I’m not alone, either.)

The basic function of the app: load up a selection of audio clips, and the software distributes them graphically in the interface. Next:

A “grain cloud” may be added to the screen under the current mouse position with the press of a key. This cloud has an internal timing system that triggers individual grain voices in sequence. The user has control over the number of grain voices in a cloud, the overlap of these grains, the duration, the pitch, the window/envelope, and the extent of random motion in the XY plane. By selecting a cloud and moving it over a rectangle, the sound contained in the rectangle will be sampled at the relative position of each grain voice as it is triggered. By moving the cloud in along the dimension of the rectangle that is orthogonal to the time dimension, the amplitude of the resulting grain bursts changes.

You can see how Chris is imagining this conceptually in a sketch he shares on his site:

An extended demo shows in greater detail how this all works:

Chris is a second-year Master’s student at Stanford University’s Center for Computer Research in Music and Acoustics [CCRMA] in California. The iPad version is coming soon, but you can get started with the Linux and Mac versions right away, and even join a SoundCloud group to share what you’re making. You’ll find all the details, and links to source code, on the CCRMA site. (And if someone feels like building this on Windows, you can save Chris the trouble.)

https://ccrma.stanford.edu/~carlsonc/256a/Borderlands/index.html

I also love this Max Mathews quote Chris shares as inspiration:

Max Mathews, in a lecture delivered at Stanford in the fall of 2010
“Any sound that the human ear can hear can be made by a sequence of digits. And that’s a true theorem. Most of the sounds that you make, shall we say randomly are either uninteresting, or horrible, or downright dangerous to your hearing. There’s an awful lot to be learned on how to make sounds that are beautiful.”

Beyond the technology, beyond this design I admire, anything that sends you on the path to making beautiful sound seems to be a worthy exercise. It’s a challenge you can face every day and never grow tired.

http://modulationindex.com/ [Chris' site, with more information]

Thanks to Ingmar Koch (Dr. Walker) for the tip!

Is there anything genuinely new in digital instruments? Isn’t it just a load of repeated novelty, without the ability to actually make useful musical noises? Hasn’t the technology just gotten in the way of the music? Isn’t … (sigh) .. all you see … all you get … (repeat ad infinitum)

Even among technologist futurists, skepticism about the iterative process of new digital design runs rampant. But if you yearn for a bit more optimism, here are four strong counter-examples, projects that, building upon previous research, begin to reach a level of maturity and expressivity that could inspire. They’re inventions that you might want to pick up and spend time learning, play into late evenings for the joy of the challenge of them, creations with which you’d build a relationship. They’re not alone, but you can catch all four in the Bay Area starting today through this weekend, and I hope that they help kick-start a new conversation about what instruments can be. In place of the novelty of new invention, they might just start to raise questions about what could really last.

None other than our friend Roger Linn, creator of the LinnDrum, MPC, and new designs, is hosting the event. Geert Bevin of Eigenlabs fills CDM in on the details, and has some reflections on what’s special about these four examples:

One thing that makes these instruments so uniquely expressive is their ability to sense the precise movements of each finger in 3-dimensional space (for example, pressure for note expression, left/right for pitch, and forward/backward for timbre), and to do that for all fingers simultaneously. But each instrument also presents many other innovative ideas and improvements over the limitations of traditional mechanical-age instruments.

The instruments:

The Eigenharp, demonstrated by Geert Bevin, Senior Software Developer from UK-based Eigenlabs.
http://www.eigenlabs.com

The Continuum from Haken Audio, demonstrated by Bay Area pianist Ed Goldfarb.
http://www.hakenaudio.com

SLABS, a new instrument designed by David Wessel, director of Cal Berkeley’s CNMAT computer music department.

SLABS: Arrays of Pressure Sensitive Touch Pads

The LinnStrument prototype by Roger Linn.

http://www.rogerlinndesign.com/products/linnstrument

If You’re Going to (Be Near) San Francisco…

Live event details, from Geert – if you make it and can help document for CDM, we’d be hugely grateful (hello from, for the moment, Montreal)

Here are the events:

Thursday, May 5 from 7 to 9 p.m.
Stanford University’s Center for Computer Research in Music and Audio (CCRMA)
660 Lomita Dr. Stanford, CA 94305
Directions: https://ccrma.stanford.edu/about/directions
At this event, the Eigenharp, Continuum and LinnStrument will be demonstrated and discussed.

Friday, May 6 from 7 to 9 p.m.
University of California Berkeley’s Center For New Music and Audio Technologies (CNMAT)
1750 Arch Street, Berkeley, CA 94709

http://cnmat.berkeley.edu/

At this event, the Eigenharp. SLABS and LinnStrument will be demonstrated and discussed.

Saturday, May 7 from 2 to 4 p.m.
Guitar Center San Francisco, Pro Audio Department
1645 Van Ness Avenue, San Francisco, CA 94109
At this event, the Eigenharp and LinnStrument will be demonstrated and discussed.

Monday, May 9 from 4:45 to 5:45 p.m.
SF Music Tech Conference
Hotel Kabuki, 1625 Post Street, San Francisco, CA 94115
At this event, the Eigenharp, Continuum and LinnStrument will be demonstrated and discussed.
Note: Conference entry fee is required–see www.sfmusictech.com

Please join us to see, learn about ~ and even try out for yourself ~ these radical new instruments that are changing the way music is made.

Please note that these instruments are not otherwise available in the bay area to see or try out.

Additional events might still be added, keep an eye on http://eigenzone.org/events

Enjoy if you make it. Aside from these four, what new instruments would make your short list?

For many, mobile technology and developing for the iPhone and the iPod touch is a fad and a Gold Rush. Good designers, though, take a longer view of how interaction can be expressive. And there are few people with a better sense of the big picture of small devices than Dr. Ge Wang. The co-founder, CTO, and Chief Creative Officer of Smule has a background that goes well beyond the latest Apple platform. Along with Perry Cook at Princeton, Ge Wang is the co-originator of ChucK, a real-time programming language for synthesis so efficient some people use it live onstage. (ChucK, as an open source project, now has a terrific team of people behind it.) ChucK is the sonic engine that powers Smule’s projects. Ge Wang also teaches at Stanford, working with students and fellow researchers to explore new ways of interacting with music technology.

Ge Wang joined me for a lengthy phone conversation recently. He really contextualized why the iPhone is important in the grand scheme of things, but also how the people at Smule and Stanford (and Princeton) can approach technology for musical interaction, focusing on what devices are rather than what they’re not.

(The audio here, believe it or not, is extensively edited – Ge Wang is that easy to talk to. I hope the next time it’s over beers rather than Skype.)

The full interview can be played below, or downloaded directly.

[podcast]http://createdigitalmusic.com/files/media/podcasts/2009/07/gewang.mp3[/podcast]

Download MP3 of the interview

Thanks to KORG and the Nano Series for their support of programming on createdigitalmusic.com.

Lastly: a video of the Smule team headquarters and playing around with Leaf Trombone for a Zelda duet!

More information:
The Mule Chronicles [Smule Blog]
http://smule.com/
Center for Computer Research in Music and Acoustics (CCRMA), Stanford University

Previously, for more on Ge Wang and CCRMA:
Make:TV Meets Stanford Musical Inventors, Feedback Piano

Video + Audio Subscriptions, iTunes Podcast

CDM is now launching regular audio content on the artists and inventors we cover as part of our series CDM Sounds. You can subscribe (and review the podcast) via iTunes, where you’ll also find our new video series:

cdm Sounds Podcast [audio]
cdm TV

Or using your software of choice, subscribe directly to RSS. (I like to follow podcasts with Banshee and Winamp this way.)

We’ve fixed some transcoding issues for iPod touch/iPhone on the video podcast. Please do test this and let us know if you have any issues on your software/hardware.

Make:Television has done a really lovely piece on CCRMA, the research center at Stanford University that works on problems ranging from acoustics and sound to musical instrument design. CCRMA is really just one microcosm of the whole music tech making scene around the world – a lot of increasingly beyond the walls of academia. But what a microcosm it is: I don’t think it’s understatement to say this is just the kind of institution a lot of us dream of. Among the highlights from the MAKE video that I could pick up:

• Ge Wang, professor and creator of ChucK programming language and certain popular ocarina-themed iPhone apps, and Stanford Laptop Orchestra director
• Carr Wilkerson: Electronic “Rub Board”(?) with a nice accompanying Pd synth patch
• A very nice Max/MSP app that everyone seems to be using for signal analysis
• Edgar Berdahl: a one-handed drum that “hits back”
• Nicholas Bryan building the legendary hemispheric speaker (incidentally, no one seems to be able to tell me who invented that)
• A giant interactive musical playground, with a Wii-powered teeter-totter (with one somewhat silly patch, and then another very lovely bowed-sounding patch)

Thanks to patospurlock on Twitter for the tip. I know at least some of you CCRMA students read this site, so feel free to chime in and identify your colleagues.

The featured Feedback Piano project is a hybrid with a bit of acoustical design (a piano), electronics/recording (mics), and digital/computer design (the Max patch that completes the circle). The results are really striking, and while it’s a lot less portable than a convolution reverb, it’s certainly very different having an actual piano into which you can play your saxophone.

Make followed up with directions on the Feedback Piano (please use a truly broken piano, thanks!) and we’ve got some video, as well:

HOW TO – build a feedback piano [MAKE Magazine]

feedback piano #1 from Alloy Electric on Vimeo.

Alloy Electric has more Vimeo videos of the feedback piano and other projects. (Nice footage, as well! Actually, I think, a bit artier than what Make:TV shot!)

More on Chris Warren’sblog and project website.

By the way, does anyone know why educational programs about Science always have to have some geeky-sounding guy shouting at you? (See the condensed history of all music tech at the end.)