Musicians and artists now have the power to fuse visuals, sound, and interaction, to make a spectacle, an album, and a game all at once. But with the blank canvas of three different media before you, what form should that fusion take?

Space shooters with pounding electronic beats behind them have cleared some of the way. Now it’s ambient music’s turn. In the game Osmos, you become a mysterious particle, floating amongst gravity wells in various fields of material. By carefully navigating, applying just the right vector force to move through the shifting landscape, you merge with other particles and escape to safety.

http://www.hemispheregames.com/osmos/

The move from “shoot stuff” to “move” or “eat” seems to be rising in popularity, with games like fl0w and Spore’s initial “cell stage” encouraging nonviolent navigation. To me, there’s something happening to the zeitgeist, perhaps a renewed awareness of cosmic (micro- or macroscopic) being, and of movement that draws on free-floating physics.

Even amongst a wave of games in this mode,when you actually play Osmos, you realize that it is something different and special. The design makes ingenious use of different kinds of movement and pacing through its different modes, at one point calling upon you to hurtle around a black hole, then move at nearly imperceptible speeds through a seemingly impossible-to-traverse petri dish of massive particles. No less than a shooter, it connects to the id and survival instinct. Pac-Man, the most successful arcarde game of all time, and one of the few that sucked in men and women in equal measure, was noted for its emphasis on eating as the mechanic. Consuming stuff appeals to everyone.

Of course, this is on a music site, and with good reason: what makes Osmos work is that Osmos is musical. It’s immediately beautiful and delicate, a perfect aesthetic union of the texture of the music and the on-screen arrangements of particles. More importantly, the music is woven directly into game play, providing subtle cues for dangers, and underscoring the pace of gameplay. You can only solve a level by managing speed and motion, and the music helps provide both the literal indications of speed and help your head get into the right zone to lose yourself in the world. If blips in early arcade games helped create a zone of play trance, now we have spectacular ambient soundtrack of music by Loscil, Gas/High Skies [Microscopics], Julien Neto, and Biosphere.

The music isn’t simply a beautiful soundtrack to the game. The game really feels like an extension of the world of the music. Put it all together, and something magical happens in this $10 game: you hear the music in a new way.

I spoke to the lead designer behind the game, programmer/animator Eddy Boxerman, along with musical-sonic collaborator Mat Jarvis aka Gas aka High Skies.

Peter: I found it amusing that some of the game press have stumbled around looking for a name for a new genre here, the "eat other stuff" category. To me, the basic game controls could be traced back to early titles like Asteroids. What are the games that have inspired you, either specifically or generally?

Eddy: Some people are dubbing the gameplay type as "eat ‘em up", as opposed to the classic "shoot ‘em up". But it’s true, the physics/controls have more in common with classic games such as Asteroids and Gravitar. The only "modern" game that otherwise influenced me was Katamari Damacy. It’s funny: when I sent out the first prototype to friends, I was concerned they would think the game was too similar to Katamari. That’s when I heard about flOw, which I’ve tried to steer stylistically clear of ever since. I guess it’s an archetype though, and the comparisons have been inevitable. As for Spore, Osmos was about one year into development when I saw the first preview footage of its "cell stage". On top of that, I learned that Will Wright had hired Brian Eno to do the music! I definitely had a "why should I bother?" moment at that point. But here we are, a couple years later, and I think we’ve managed to put out a unique game with a great mix of gameplay, sound, and visuals.

Peter: Ha – well, I’m glad you “bothered”! One thing that I think is really unique about Osmos is the gravitational mechanic. How did this come about?

Eddy: I was (and probably still am) a sci-fi kid. And when I read about real phenomena like colliding galaxies, retrograde planets, and the like, my mind goes to stange and wonderful places. That said, the Spacecraft Dynamics course I took during my engineering degree definitely played a large part in putting those mechanics and levels together. Thanks, Professor Misra! :)

Peter: How are the physical mechanics of the game constructed? This is essentially two-dimensional vector math, yes? Were there refinements you needed to make in order to keep performance up, or to keep the levels playable?

Eddy: That’s a big question! But yes, essentially it’s 2D vector math, though we make use of some 3D math (including quaternions) on the particle systems. The majority of the physics is quite simple though — first year bachelor’s stuff: F = ma, conservation of mass and momentum, gravitational laws, basic time integration, etc. We follow the spirit of the laws, but not always the letter. For instance, if you look at the Earth’s solar system in its entirety, you wouldn’t even see most of the planets; that doesn’t make for a very playable game though. As such, we took many liberties when it comes to scale, constants and exponents in the equations. The majority of the work was in the tweaking of those values to make the game /feel /good.

Peter: How did you prototype the game? What was the process of evolution like? Were there any failed attempts along the way?

Eddy: I put together the first prototype starting from a NeHe OpenGL tutorial. I added some basic physics, mouse controls, some highly unoptimised collision detection code, and voila, I had something to play with. After that, I immediately integrated [cross-platform 3D audio API] OpenAL, as the game was just begging for sound and music. I then hunted for some good sounds (discovering freesound.org in the process), put together a simple looping song (my first rough and humbling attempt to create digital music), and sent it out to a few friends. I’ll make that version available for free someday… when I’m feeling brave.

As for failed attempts, there were tons of shelved experiments and features that were cut. One interesting problem was the difficulty curve of the gravitational levels. In fact, the first gravity levels looked a great deal like the "Warped Chaos" levels do today: several free-floating Attractors in a sea of regular motes. I found it incredibly difficult, however, to make a "beginner" version of those levels. If the gravity was too weak, the Attractors had little apparent effect; too strong, and the level became incredibly difficult. I stuggled with this for a long time, until I hit on the idea of putting one, immobile Attractor in the center, with everything else orbiting around it. This allowed for the creation of systems with strong gravity effects, but long-term stability. It seems so obvious now, especially given the example of our solar system, but it wasn’t back then. In the end, these are some of the coolest levels in Osmos — practically its "signature" level type. Moral of the story: necessity really is the mother of invention.

Peter: What is the visual engine like? The sound engine?

Eddy: As I mentioned, I bootstrapped from a NeHe tutorial, but that’s all been replaced at this point. It’s now a homegrown engine using OpenGL. It doesn’t make any use of pixel/vertex shaders, so it runs on a wide variety of hardware. The majority of our texture work is done in Photoshop.

[The sound engine is] a wrapper we’ve built around OpenAL. At a basic level, all we ever do is mix and adjust the gain and pitch of our sounds and music. This allows us to run on generic sound hardware. But we do make extensive use of those "effects", and it’s possible to get a great deal of variety and feedback with them. In the end, it’s all about the quality of our sound sources, and the algorithms that adjust and smooth the gain and pitch of each.

Peter: For pitch shifting, were you able to do that natively in OpenAL?

Eddy: Yes, OpenAL supports pitch shifting at the software level. I ported our sound engine to use DirectSound at one point, and found that it’s pitch shift range is rather limited. We reverted back to OpenAL.

Peter: One thing that really strikes me about the game that is its use of pacing. Even without the obvious technique of allowing the user to control speed, there’s this extraordinary contrast between levels that require you to move quickly, that require you to anticipate the rate of movement along a vector of other objects, or that require you to move almost imperceptibly slowly. Was this an early goal, or something that evolved out of developing the game concepts?

Eddy: It evolved from the game concepts themselves. We tried to fully explore the fundamental controls and game space of Osmos, and converged on a number of interesting regions and structures that were fun to play with/in. Some people actually "complain" that the pacing of the game isn’t consistent across levels — some are fast, some slow — but that wasn’t our goal. In a sense, we’re merely presenting the results of a great deal of research and exploration into the space, with our sole requirement being that the levels are fun and interesting. We wanted it to be a game of concepts and understanding, not speed. The addition of time-warping allowed us to break free from that, expand our scope, and include a much larger variety of levels, as some have both fast and slow moments in them; we wanted the player to be able to control the pace and difficulty to their level of comfort.

Peter: Connecting the action to music, how important is the use of music in conveying time?

Eddy: I think pitch-shifting the music and sound effects helps players track time-warping in an inutitive way. Without these aural cues, the mental connection would be incomplete. That said, I sometimes test the game without sound, and it’s totally playable — just much less immersive.

Peter: At what stage did you involve the musical element? How was that relationship established?

Mat: Eddy first contacted me two or three years ago about using one of my tracks on Osmos (“Gas – Discovery”). He sent me a basic alpha version where the game was literally flat circles on a plain background, but even back then with the simple graphics and no sound it was compelling. I think it was at this early stage that I sent him a copy of another High Skies track, “The Shape of Things to Come,” which he also used a section from. It wasn’t too long later that he sent me a version of Osmos with most of the music that made it to the release version and it all just complimented each other beautifully.

Eddy has done a great job choosing music that compliments the game and graphics, and they also compliment the music. I think he’s done a great job overall as well, keeping his vision consistent for the look and feel of the Osmos world. Even though some of the levels are quite varied; some are quite chilled, others fast paced, nothing seems out of place. He has created a new world that’s both microscopic and macroscopic.

Peter: The musical and sound effect elements really do blend effortlessly. Mat, I know you made substitute sounds – how did this help blend the aesthetic?

Mat: I made the rebound noise when you bounce off the walls/ boundary. The original sound was quite hard and metallic with a lot of reverb, and I suggested a softer echoey sound. There was nothing wrong with the original, but it made the boundary feel quite hard and cold like being in a metal tank. I sent Eddy some analogue samples, using a [vintage Roland keyboard] Jupiter 6 with varying delays/ echoes. Because the tones are so pure and tuned, Eddy pitched them slightly to fit with the various keys of the different music.

Eddy: In general, it was a matter of searching and experimentation for the "right" set of sounds that fit well together — which can be a lengthy but rewarding process. Once integrated, minor gain and pitch adjustments helped fit it all together.

Mat provided the bounce sound, as well as the continuous absorb/being-absorbed sounds. The other sounds were created/shared on freesound by the users Elektrocell, fran_ky and Jovica. (Check out the Osmos credits in the readme.html for details.)

Peter: I recently spoke to Crystal Method, and while they’ve done some notable game scores, they actually said they wouldn’t want their music to be placed in a game context at which the speed changed, that it’d lose something. This seems like the opposite of that. Now, maybe it’s easy to take for granted with ambient music as opposed to something beat-driven like Crystal Method, but do you think there’s something special that allows this music to be adaptive in that way?

Mat: I think that in the right circumstances music with drums could work well and may even highlight the time-shifting more. Of course with the wrong game and wrong music it could sound terrible too.

Eddy: It’s a delicate issue. Out of the context of the game, I think it would seem wrong. There were also some pieces of music I tried which didn’t lend themselves well to this kind of manipulation, and which didn’t get included as a result. But with these songs, and everything working together in-game, I feel the whole experience is stronger as a result. I’m just glad Mat and the other artists agreed — or at least… didn’t object. ;-)

Peter: Hey, I think if you can write music that sounds good played at a different speed, that’s nice.

Osmos seems to me a musical experience, in that the sense of the music is transformed by the visuals and the interaction with them. Do you think it’s possible that audiovisual interfaces could go even further in terms of their impact on the music?

Mat: Yes, it almost seems as though Osmos creates a world for the music to exist.

I’ve always liked music visualisers like the Processing and Cymatics stuff, they’re quite compelling to watch how they react to the music, so it would be interesting to go the other way; by manipulating/ sculpting abstract shapes which then modify or even create sounds and music, especially using the new controllers like the Wii, [Microsoft’s] Project Natal and Sony’s Motion Controller instead of the mouse.

Eddy: I totally agree with Mat. Yes, please! More feedback between music, visuals and interactivity — in all directions. I’d love to experiment more on all of these fronts. In general, I think games such as Audiosurf and Auditorium, while great, have only begun to scratch the surface of what’s possible. Interactive musical "toys" such as [Nintendo/Toshio Iwai’s ]ElectroPlankton or Dub Selector are another great direction; and Rock Band Network is about to expand the market in a huge way. It’s exciting!

Peter: Along those lines, this is obviously a new take on music distribution in a way that goes well beyond what titles like Rock Band have done. Are there other cases in game history that to you have done that? Is there potential in these new outlets, outlets that are more accessible to independent developers (Steam, Direct2Drive, Xbox Live Arcade, iTunes App Store), to really change game development?

Eddy: Wow, that’s another big question. Really, I just felt the music was such an important part of the experience in Osmos that we should show the artist and track names during the game. But now that you mention it, I can’t think of another game that has done this, besides games like Rock Band where the song /is/ the game/level. That said, one way I’d love to push this evolution is to "augment" music videos with interactivity: ie. into music video-games. (The term "game" could be used rather loosely here.) Everyday Shooter does this, though Jon Mak actually created the music /for/ the game in that case — which rocks — but collaborations could lead to some really amazing things in this direction.

Peter: Eddy, Mat, thank you. Whether it’s in the form of a game or an audiovisual performance, we’ll certainly continue to explore these areas. And – hint, hint – Osmos 2, with multiplayer? Just a thought.

Osmos Trailer from hemisphere games on Vimeo.

I’ve never been big on idol worship or celebrity; it’s my feeling you can draw inspiration from any musician as a fellow artist – it’s really the point of music. But that works both ways; for all that can be said of him, and for all that people may be suffering from Michael Jackson fatigue, the man’s talent can still be stunning.

My editor at Keyboard, Steve Fortner (via Twitter), sends along this trailer for an upcoming Michael Jackson documentary. It features some of the rehearsal footage prior to the artist’s death. You can also spot keyboardist Michael Bearden, Friend of Keyboard Magazine – who has, in turn, been featured on Keyboard TV. Check out his incredible bio. And on the same note, it’s often these lesser-known artists, the people playing next to all the famous artists everyone has heard of, who can be equally inspiring. Their sounds and musical imagination is woven into a lot of the popular music of the last half century, even if their names may not be as imprinted on people’s brains. They also typically have to have the ability to quickly sit in with artists of radically varying styles and “make it work.”

I think it’s possible to be a champion of the lesser-known or obscure without being allergic to the well-known. To do anything else would deprive you of the experience of some great musicians. And the documentary looks like it could be terrific.

Here’s a switcher story of a different color: from the Mac, to Linux. It’s one thing to talk about operating systems and free software in theory, or to hear from died-in-the-wool advocates of their platform of choice. In this case, we turn to Kim Cascone, an experienced and gifted musician and composer with an impressive resume of releases and a rich sens of sound. This isn’t someone advocating any platform over another: it’s an on-the-ground, in-the-trenches, real-world example of how Kim made this set of tools work in his music, in the studio and on tour. A particular thanks, as he’s given me some new ideas for how to work with Audacity and Baudline. Kim puts his current setup in the context of decades of computer work. Even if you’re not ready to leave Mac (or Windows) just yet, Kim’s workflow here could help if you’re looking to make a Linux netbook or laptop more productive in your existing rig.

Stay tuned, as I’ll have some other stories on how to make your Linux music workflow effective creatively, particularly in regards to leaping over some of the setup hurdles Kim describes. -PK

Historical Evolution

I’ve been working with computers since the 1970s. Inspired by the work of composer David Behrman, I taught myself assembly language and programmed a simple digital sequencer on a KIM-1, single-board microcomputer, controlling an Aries modular synthesizer I had built. I discovered a then-new magazine called Computer Music Journal at the local computer shop and bought every copy I could get my hands on. (I still have them, too.) Later, I helped a friend’s father, an executive at IBM, unpack and set up the first personal computer IBM made. The manuals alone took up two or three feet of bookshelf space.

Fast-forward through a couple of decades of owning Commodore 64s, Apple computers, and PCs. In 1997, I purchased my first laptop: a woefully-underpowered Compaq Presario. It wasn’t fast enough for real-time audio, so I had to render sound files to hard disk using the audio programming language Csound. I created many of the sounds this way for my CD ‘blueCube( )’. But the capacity to work anywhere was enough for me to give up ever owning another desktop computer.

Frustrated with the ‘code-compile-listen’ process of working with Csound and wanting to work in real-time, I switched to the graphical multi-media programming language Max/MSP, which necessitated a move back to Apple hardware, so I bought a PowerBook. Having Max/MSP running on a laptop was the perfect environment for me. I could build the tools I needed whenever an idea presented itself. The computer functioned as both sound design studio and stage instrument. I worked this way for ten years, faithfully following the upgrade path set forth by Apple and the various developers of the software I used. Continually upgrading required a substantial financial commitment on my part.

Apple Seeds of Discontent

When I’m on the road, I use my laptop as a music studio, performance instrument, and administration office. I don’t like surprises on the road. Having a computer fail means a loss of income, and makes for an embarrassing moment if the failure happens during a performance. If watching laptop music bores some people, watching a musician reboot is even worse. So to be safe, I stress-test all new hardware or software in my studio for at least a month before I take it on the road. Max/MSP patches run for hours, software is used for weeks, and hardware is left on for days at a time to help induce failure before I leave home. But as fate would have it, an iBook I was touring with died a few years ago. I brought the laptop into an Apple repair shop in Berlin, where a technician diagnosed the problem as a faulty logic board. The failure rate on logic boards was high for that model of iBook, and in response to public pressure, Apple instituted a logic board replacement program. Luckily, my laptop qualified and the logic board was replaced for free. But the failure and ongoing buggy behavior impacted my work schedule and added to the stress of touring.

I’ve now replaced logic boards on three computers; the other two I paid for out of pocket. The out-of-warranty cost of replacing a logic board on an Apple laptop is around six hundred dollars — cheaper than buying a brand new laptop, but still significant.

If you make your living with applications that run on OS X, there are no options if a laptop fails. You either repair expensive Apple hardware or buy new expensive Apple hardware. This is called ‘vendor lock-in.’

Then, during my 2009 spring tour, my PowerBook G4 exhibited signs of age, with missing keystrokes, intermittent backlighting, the failure of a RAM slot, and reduced performance. As an alternative to repairing the PowerBook, I investigated what a new MacBook Pro and upgrades for all my software would cost. A quick back-of-a-napkin estimate came to approximately $3,000, not including the time it would take tweaking and testing to make it work for the tour. If the netbook revolution hadn’t come along and spawn a price-wars on laptops, I might have proceeded to increase my credit card debt. But as a wise uncle once advised, “you invest either your time or your money; never both.”

Meeting Ubuntu

I had tried Linux in 2005 on PowerPC-based Mac laptops, though at the time I couldn’t get audio working, even after extensive tweaking. But I had kept an eye on Ubuntu ever since. After considering MacBook Pro prices, I checked out the new netbooks coming to market and picked up a refurbished Dell Inspiron Mini 9 with Ubuntu pre-installed.

I loaded up my Dell with all a selection of Linux audio applications and brought it with me on tour as an emergency backup to my tottering PowerBook. The Mini 9 could play back four tracks of 24-bit/96 kHz audio with effects – not bad for a netbook. The solution to my financial constraint became clear, and I bought a refurbished Dell Studio 15, installed Ubuntu on it, and set it up for sound production and business administration. The total cost was around $600 for the laptop plus a donation to a software developer — a far cry from the $3000.00 price tag and weeks of my time it would have cost me to stay locked-in to Apple. After a couple of months of solid use, I have had no problems with my laptop or Ubuntu. Both have performed flawlessly, remaining stable and reliable.

Getting Past Ubuntu Audio Complexities

There are a few differences between how audio works on Mac OS X and how it works on Ubuntu Linux. OS X uses the Core Audio and Core MIDI frameworks for audio and MIDI services, respectively. All applications requiring audio services on OS X talk to Core Audio, which mixes and routes multiple audio streams to the desired locations. Core Audio is simple, monolithic, and easy to set up, and all the end-user controls are accessible from one panel. You can even create a single aggregate device from multiple sound cards if you need more inputs or outputs than one sound card can supply. To Apple’s credit, Core Audio and the applications that make use of it are the reason why you see so many laptop musicians seated behind glowing Apple logos on stage.

On Ubuntu, audio is a rather different story. Apple’s slogan ‘Think Different’ would be good advice for musicians encountering Ubuntu’s audio setup for the first time. Audio in Ubuntu can appear at first to be a confusing jumble of servers, layers, services, and terminology. Go to System->Preferences->Sound, click on the Devices tab, and check out the pulldown menu next to ‘Sound Events’ at the top of the panel. You will see various acronyms, possibly including cryptic-looking technologies like OSS, ESD, ALSA, JACK, and Pulse Audio. These acronyms represent a byzantine tangle of conflicting technologies that over time, and due to political reasons or backwards compatibility, have ended up cohabiting with one another. ‘Frankenstein’ might be an accurate metaphor here.

Thankfully, there is a simpler way, which is the combination of ALSA [a high-performance, kernel-level audio and MIDI system] and JACK [a system for creating low-latency audio, MIDI, and sync connections between applications and computers]. The battle-scarred among us have learned to ignore all the other audio cruft bolted on to Ubuntu and just use ALSA and JACK. One can think of the ALSA/JACK stack, the heart of most pro Linux studios, as the Core Audio of Linux and in my opinion Jack should be the first thing installed on any musicians laptop. I’d go so far as to suggest placing it in the Startup Applications so it’s always running.

The ALSA/JACK combination is a little more complex to set up and tweak than Apple’s Core Audio, but there’s a lot of good information online. [Ed.: ALSA, JACK, and the real-time Linux kernel also have some advantages over Mac OS X that can be worth the effort. While JACK has been ported to Mac, Linux has more JACK-aware tools, which is necessary for transport sync. Just as importantly, once configured, you can build rigs with Linux that have greater low-latency performance than may be practical on Mac or Windows. In other words, while it may require an investment of time, it can be both free and better! -PK]

Workflow

Over the past ten years, I’ve developed a workflow that has worked well in the studio and on the road. Since I created most of my tools in Max/MSP, they could shape-shift to fit any musical task I encountered. A sound mangling tool I’d written for studio use, for instance, I could then adapt for a performance with Tony Conrad. I modified parts of my performance patch for sound installations. This environment served me well over the years – until recently, when my aesthetic focus changed from using randomness in my work to taking a more deterministic approach. This happened to coincide with my change of operating systems.

I do a lot of location recording while on tour. My rig consists of an Olympus LS-10 digital recorder and an Audio Technica AT-822 single-point stereo microphone. I record at 96kHz/24-bit to a 16GB SDHC card in the LS-10. When I want to audition sound files in the field, I use my netbook’s SDHC reader, renaming sound files directly on the card. I can look at some of the files in Baudline if I need to check for low-frequency rumble or technical anomalies. I have come to use Baudline on a daily basis.

Back in the studio, using the sound editing program Audacity, I remove voice slates, trim heads and tails, adjust gain and EQ as needed, then save them to a project folder. And because I don’t like surprises in the studio, either, this folder gets backed up onto a remote network drive as well as a local USB drive.

Building my sound library takes weeks or months. During this time, I start filling a notebook with ideas, drawings, plans and marginalia, from which a score emerges. I import all my project sound files into the open-source Digital Audio Workstation Ardour, arranging them to loosely resemble the score in my notebook. Once my Ardour session is set up, I move sounds around, try different effects, create new textures by layering, then render and re-import sub-mixes until the piece starts to take shape. I use a KORG nanoKONTROL as a mixing surface. I assign faders, pans and switches assigned to the DAW allowing me to quickly play around with different mix ideas.

Once the piece sounds finished, I mix down to a stereo .WAV file at 24-bit/44.1kHz, without using compression or EQ on the mix bus. Tip: mastering engineers really appreciate getting a raw 24-bit master that hasn’t been fiddled around with by the musician. For performances, I also use Ardour and the nanoKONTROL to do an acousmatic presentation. This version of the Ardour session will have compression and/or EQ on the mix bus, since I want the material to sound more polished. As a side note: I am looking into using the mastering tool JAMin [JACK Audio Mastering Interface] for this purpose in the future.

Sayonara, Apple

After ten years of working on Apple laptops, I’ve left the fold. Not only was the expense of owning and maintaining Apple hardware a key factor in my switch, but the operating system had become a frustration to me. Details like not having a tree-view in the right hand panel of the Finder window slowed me down. Ubuntu, on the other hand, feels more like an operating system made for grown-ups. And what’s especially nice is that Ubuntu scales nicely to the expertise of the user. Your cousin the computer geek or your Grandma can install and use Ubuntu and get as deep as they like. Combine this with the recent rash of cheap, powerful laptops, and Ubuntu’s market share is bound to grow.

A Request

It’s important that kernel and audio application developers (1) ensure all audio creation software has support for JACK, (2) improve and update tools for JACK to make it easy for musicians to install, configure, and use, (3) ship distros with the realtime kernel already tested and configured for use, (4) to integrate the real-time kernel patches into the mainline kernel. [Ed.: On each of these points, distributions and kernel builds are steadily improving, partly thanks to feedback from communities like the music production community. The realtime kernel likely won't be the default, mainline kernel, but it's important to have well-maintained optional packages at the very least. That doesn't mean you have to wait for improvements to happen, though, and in future articles I'll talk a bit about how you can configure your system now to take advantage of this functionality. -PK]

Most importantly, consider paying a subscription to support developers of JACK and your favorite Linux audio software, or, if you can write code, proofread text, write a manual, do a translation, contribute graphic design, or create content; please help by contributing something to the development of the software you use.

I would like to thank Ken Restivo, Mike Rooke, Paul Davis, Philip DeTullio, Jörn Nettingsmeier and Matt Griffen at Canonical Ltd. for advice and inspiration in the writing of this article.

Kim Cascone is a composer, sound artist, touring musician, lecturer and writer. He lives in the San Francisco Bay Area with his wife Kathleen and son Cage.

Links:
http://www.osnews.com/story/6720/Introduction_to_Linux_Audio
http://www.alsa-project.org/main/index.php/Main_Page
http://ardour.org/node
http://audacity.sourceforge.net/
http://www.kokkinizita.net/linuxaudio/
http://www.baudline.com/
http://jackaudio.org/
http://drobilla.net/software/patchage/
http://www.ladspa.org/
http://lv2plug.in/
http://dssi.sourceforge.net/
http://jamin.sourceforge.net/en/about.html
http://linuxaudio.org/
http://www.ubuntu.com/
http://code.goto10.org/projects/puredyne/
http://www.bandshed.net/AVLinux.html
http://rt.wiki.kernel.org/index.php/Main_Page
http://www.pulseaudio.org/
http://developer.apple.com/audio/overview.html

Corrections / clarifications:

Ed.: I originally claimed that JACK Transport sync is not possible on the Mac OS X port of JACK. As kindly pointed out by a reader, this is not correct. JACK Transport-aware applications on the Mac will work.

Secondly, Kim argued that you could pull out a drive without having to go to a lot of trouble unmounting it first. At least one commenter argues that risks data loss, and given that users may be using something like FUSE to access foreign file systems like NTFS or the Mac’s own HFS+, I don’t yet know what the exact details will be. As I said in comments, however, Nautilus and the command line eject function for me are quicker and more effective than similar unmounting on Windows and Mac, so I still notch this one for Linux. -PK

Enough of all this nonsense about how the Western Empire is crumbling. In our new “world” in which Mumbai is as powerful a cultural compass as Berlin or New York, one thing is guaranteed: it’s going to be a great party.

One stalwart Western-based advocate of a more pluralist electronica scene are the folks at Indian Electronica. Pumping out regular live events, podcasts, radio streams, and festivals, the crew is keeping music south Asian-flavored and eclectic. They’re truly inclusive: previous festivals spotlighted the likes of DJ Spooky, artists who are not connected to India by birth but love the music. It’s “Indian” in a loose sense, covering the thread of musical influence instead of just the geography.

The good news is, the excellent Indian Electronica Festival is returning with dates in New York, Toronto, and Vancouver. (Sadly, Mumbai didn’t make the list this time, but North America gets a good dose of great music.) They’re looking for artists to sign up, too, and possibly even other sessions.

http://www.indianelectronica.com/
http://www.indianelectronica.com/festival

Part of why I still like the term “electronica” is that the history of electronic music is by its very nature trans-cultural, eclectic, and global. Those are buzzwords, I know, but in this case I think they’re backed up by actual reality – by music spreading instantly across thousands of miles to the other side of the planet. It’s odd to me that people malign Berlin’s scene and history for being somehow restrictively bound in Germanness. It was Berlin’s pioneers who were smart enough to bring over artists from North and South America, from Detroit and Sao Paolo, and to arrange cultural intersections that changed the course of music.

But anyway – back to the music. The video quality is poor, but here’s the kind of highlight of their previous festivals, from Mumbai in 2007. Tablatronic Violence is the duo of Amsterdam-based tabla player Heiko Dijker and Sharat Srivastava, Hindustani musician who plays both strictly classical music and rock, as well as teaching Indian Violin in Glasgow. It doesn’t get much more international than this.

Trent Reznor posted yesterday that the Beastie Boys’ Ill Communication reissue is “how you sell music today”. As a rebuttal to the usual “that only works for established artists” replies, he’s followed this up with an extended post on what artists who haven’t reached the Beasties or NIN level of profile can do to get established.

NIN’s $300 deluxe edition of Ghosts sold out in under two days, grossing $750,000. The first week combined sales grossed $1.6million, despite being released for free under a Creative Commons license. (Photo CC Nick Humphries)

Having been part of a reasonably high profile band with an album released through the label system, Trent’s post reads like a list of “how I wish it had been”. Every point he makes is absolutely spot on. The article is filled with active verbs. Make. Give. Sell. Share. Release. Start. Engage. Film. This is the crux of how creators succeed in the digital age: They do things. Rather than waiting for someone else to tell them how to make money from a product that can be easily garnered for free, the people who are doing well are making it up as they go along, trying new things. You know… being creative.

As a web developer, director and general creative tech geek, Trent’s closers are especially poignant:

The database you are amassing should not be abused, but used to inform people that are interested in what you do when you have something going on – like a few shows, or a tour, or a new record, or a webcast, etc.
Have your MySpace page, but get a site outside MySpace – it’s dying and reads as cheap / generic. Remove all Flash from your website. Remove all stupid intros and load-times. MAKE IT SIMPLE TO NAVIGATE AND EASY TO FIND AND HEAR MUSIC (but don’t autoplay). Constantly update your site with content – pictures, blogs, whatever. Give people a reason to return to your site all the time. Put up a bulletin board and start a community. Engage your fans (with caution!) Make cheap videos. Film yourself talking. Play shows. Make interesting things. Get a Twitter account. Be interesting. Be real. Submit your music to blogs that may be interested. NEVER CHASE TRENDS. Utilize the multitude of tools available to you for very little cost of any – Flickr / YouTube / Vimeo / SoundCloud / Twitter etc.

Check out the rest of the article.

For digital artists, a lot of the web and technological networking comes easier than to rock bands. When a laptop is part of your rig, hopefully you understand computers better than someone who exclusively hits their instrument with sticks (SPD20s aside), because you use the computer for music regularly. Ed.: This is a simple fact – if you’re a digital artist, regardless of your instrument, you spend more time behind the screen than people who are conventional instruments – so you should have no excuse for making the most of that technology once the production and performance phase are done. -PK We’re also in the middle of a huge mobile web expansion phase. Now that everyone has web enabled computers in their pockets, what you can do while you’re out there playing shows is getting better and better; I just spent the evening configuring an online store which can be administered via its own iPhone app. If this had been available two years ago, a whole lot more CD orders would have been delivered on time.

Giving some solid metrics to bolster Trent’s advice, Michael Masnick’s (founder of Techdirt) recent presentation at the NARM 2009 conference is truly fantastic.

NARM 2009 State Of The Industry: Michael Masnick from NARM on Vimeo.

The presentation is quite long at 31 minutes, but he breaks it up with 515 slides, so it feels punchy. It expands on many of the points Trent makes, and touches on some themes we’ve been interested in here at CDM. Interestingly, he gives some revenue and sales statistics on the Nine Inch Nails “Ghosts” release: $1.6 million gross in the first week, from an album which was released for free under a Creative Commons license.

Having been quite deeply involved in the “old” way of doing things, and having experimented in the last year with faster, cheaper live performance videography and similarly streamlined “studio” production, I feel that I’m replete with the kool aid, and comfortable with a future in which I’m not looking for “a contract”. In fact, this evening I called my bandmate over and convinced him that the album we’re about to record and shoot will be released entirely under a Creative Commons Attribution license. Finished tracks and stems, music videos and source files, animation sprites, live footage, album artwork, and whatever else we create.

I’ve long believed that “free” and “open” is a big part of the future of creative industries. The label system has kept creators and fans at arms length. Last year I was a rightsholder on an album which spent a week in the top 5 sellers on iTunes in Australia. I know nothing about any of the listeners who put it there. Next album release, I want to know all of those fans by name.

Should you quit your day job and go on tour with a rock band?

That’s the question answered by cellist Zoe Keating at Ignite, the 5-minute hyperpresentation series put on by O’Reilly. (At an NYC event, I gave a talk explaining why understanding basic programming concepts was as important as calculating your tip on a bill.)

Zoe Keating on Should you join a rock band? [Ignite's Brady Forrest]

Zoe debunks the myth of the glamorous tour with some sobering realities with which I’m sure at least some readers here are already far too familiar. The presentation is snappy, sharp, and more than occasionally hilarious, a perfect Igniter.

If that’s got you down, though, the same post points to this brilliant “Quantum Cello” piece in which Zoe explains how she works with loops, blending electronic techniques with a 17th-century instrument. That’s the kind of old meets new sensibility we love. And by the way, when Zoe tours with a rock band, she does have good taste — she hit the road with the Dresden Dolls’ fabulous Amanda Palmer.

Quantum Cello, WNYC Radio Lab [Audio podcast / interview]

Inside a computer, digital music is entirely unseen. But translate it into the tangible world, and it can be anything you imagine – not limited by acoustic reality or practicality, music can become three-dimensional sculpture.

For artist Christopher Bauder and composer Robert Henke, ATOM’s light and sound sculpture found a three-dimensional matrix of balloons as its medium. Flashing in hypnotic patterns and moving into different configurations, accompanied by live laptop music from Henke (aka Monolake), music and visuals become an inseparable fusion.

ATOM received its North American premiere at Montreal’s MUTEK in May. That turned out to be perfect programming, as it placed ATOM in a week that featured complementary work from artists Artificiel. Henke says some of his matrix manipulations – and even the specific Max/MSP patches from ATOM – came from collaboration with Artificiel and their light bulbs. For their part, at MUTEK they unveiled a new audiovisual etude called POWEr Play involving a live-sampled Tesla Coil. The science fair ethos of ATOM and POWEr Play could have been gimmicky or overly fixated on spectacle, but in these pieces, it was anything but. Both works contemplated their subject matter so thoughtfully that balloons and electrical coils seemed perfectly natural media for the audiovisual imagination, and audiences were left marveling at phenomena in a way too rare in 2009.

Video episode at Blip.tv [includes mobile/desktop video downloads]
YouTube Part 1 and Part 2 (if you prefer YouTube for viewing)

It’s worth downloading the video above and really getting to soak up some of this piece when you have time. I also have an audio interview of a conversation with Robert and Christopher immediately following one of the performances.

You’ll hear Christopher’s voice first, followed by the unmistakable percussive enthusiasm of Robert. For me, the best part of the interview was hearing them discuss whether you should notice some of the unintentional randomness of drifting balloons or technical hiccups, and how they structured the work formally with a palette of possible balloon patterns.

Download the audio interview

For more on POWEr Play, see my Montreal flat mate Greg Smith writing for Rhizome – and stay tuned for the CDM audio interview, coming next week:
power play – artificiel at mutek [Serial Consign Blog]
Variable Frame Rate: Multimedia Performance at MUTEK 2009 [Rhizome]

More information:
Atom project Information at monolake.de
Text interview by Bertram Niessen for Digimag magazine, October 2007, also at monolake.de

We talk about tools a lot, but it’s really learning how to make tools expressive in your productions and performances that matters. DubSpot, the music tech production and DJ educational center here in New York, brings its multi-city Ableton Live Sessions tour to its hometown for several days of parties and workshops. If you’re in NYC and on a budget, we have a discount on the paid events and also some free events you can check out. If you’re not in NYC, we’re working on bringing free video coverage to the global CDM community shortly after the event.

This really isn’t a pitch for Live, either – part of why I’m excited to be able to hang out for the weekend is that I expect to learn quite a lot from some of the world’s most skilled Live users and producers.

Headlining the event is none other than global techno star Richie Hawtin – the Minus impresario some of our readers love to love and others love to hate. I hope we get to hear more about his unique Plastikman live rig – see the controller at top, with more details from our friends at visualist corps Derivative, whose TouchDesigner live visual tool powers 3D imagery in those sets. Hawtin will join in a conversation with Ambivalent about what the Minus musical process is about. Hawtin and friends will also play a real gem of New York’s club scene, Love on MacDougal Street – it’s a fantastic space that lives up to its name.

On the dub side, Scientist aka Overton Brown, one of the world’s real stars of dub, a King Tubby protégé out of Jamaica, will return us to the roots of electronic dance music and show off his own take on the use of this technology. Scientist and Dub is a Weapon play Le Poisson Rouge and Scientist will close out the Live Sessions with a dub battle versus Badawi.

KJ Sawka – Hell, Yes, Chops

Before we get into the lineup, here’s just an example of how cool the faculty of this event is – KJ Sawka. Sawka is, of course, what we dream of in live laptop music. His musicianship is fantastic unplugged (see a rooftop set video, apparently sponsored by PBR), so the laptop becomes simply an extension of that.

KJ Sawka will have a full Drums workshop on Saturday as part of the paid program. If you’re new to Live, though, he’s doing a free intro on Thursday evening.

Here’s what to see and how to get the exclusive CDM discount.

By the way, if you’re in Los Angeles, that’s the next stop on this tour; stay tuned for details.

Schedule, Free Events, and Discounts

Thursday

7-9p, FREE KJ Sawka Live 8 clinic, 675 Bar
9p Funk Aid for Africa benefit release party, 675 Bar

Friday: Richie Hawtin @ Love

Saturday

11-6: Ableton Live and Production Sessions: The first day focuses on moving a project through the production process, with KJ Sawka talking live recording of drums, DJ Kiva and Jon Margulies on developing and finishing materials, and veteran engineer Daniel Wyatt on mixing and mastering. The day finishes up with a chat with Richie Hawtin and Ambivalent.

6:30-9p FREE CDM Live Lounge party Saturday evening, we meet up at former sex club / former horse stables (really) turned chilled-out Meatpacking District lounge 675 Bar. We’ll have some surprise unusual Live controller rigs and music.

Sunday

11-6: Performing with Live, Live Onstage: The second day of workshops focuses on live performance, with Jon Margulies, DJ Rupture, and myself talking about working with performance-ready live sets, controllers, and Akai’s APC40. (With Jon covering the APC, I’ll focus instead on alternative and unusual controllers.) Barry Cole of Blue Mountain Publishing will go a different direction entirely – how to understand licensing and distribution and actually make money on your tracks.

7-9p: Scientist will talk about miking and live setup with Dub is a Weapon – and will mix them live.

9p: DubSpot Sessions party, Le Poisson Rouge, with live and DJ performances from Scientist, Dub is a Weapon, Badawi, Kiva, Rupture, etc.

CDM DISCOUNT: Enter promo code ‘CDM’ for $25 off the tour, or follow this link:
http://www.dubspot.com/pages/abletontour.jsp?aff_ref=CDM

The weekend is US$225 for both days ($200 after our discount); $125 for one day.

Here’s a wrap of what happened in San Francisco:

And if you’re there, do come say hi! It’s always nice to meet readers.

Deadmau5 interview with Dancetracks from Dancetracks on Vimeo.

Our friends over at Dancetracks Digital send along their video of Deadmau5, the top mouse-headed act on the planet right now. Deadmau5 may surprise you, with some good things to say about playing the open-source, sustainable, OSC-savvy monome controller – the controller that had big grids of buttons before big grids of buttons were cool. He also talks about not being a DJ, which means, I suppose, he’s one of us.

Say it with me – M-O-U-S-E! Or, um …five.

Okay, enjoy your weekend.

Download MP3

Liz McLean Knight aka Quantazelle catches up with one of our laptopist idols: edIT, the talented solo artist and Glitch Mob member. I won’t insult what he does by giving it a dumb name (”Glitch Hop?”). Suffice to say, edIT is adept at bringing insane musical chops to live laptop performance.

Liz got to geek out with edIT about the details of his live setup, which now drops the M-Audio Trigger Finger for the visual feedback and fluid multi-touch flexibility of a JazzMutant Lemur. (All due love to the Trigger Finger. But I think that would have been like, when I was a child, trading my Knight Rider Big Wheel for the full-sized KITT.)

edIT tells Liz just what this is all about, how he puts together his live set, and what the technical setup means for him musically. He also talks strategy. Sometimes, that means keeping the integrity of the tunes by loading changes into Ableton Live’s pre-composed Arrange View rather than triggering relatively mundane changes of loops manually. At the same time, that frees him up to work with more radical changes with effects and the like – stuff that may actually be interesting. So, no, just glimpsing the Arrange View will not land edIT on deadAct.com — in fact, edIT and Glitch Mob are just the kind of antidote we need.

Interview audio quality is low, but it’s well worth the listen for all the details.

While we’re at it, here’s more insight into edIT’s unique IDM and Hip Hop-inspired world, including the greatest anti-electronic music quotes of all time.

XLR8R TV in one of their nicest episodes ever got to play a street gig in San Francisco on Haight with the Glitch Mob. Now, playing outdoor gigs in San Francisco isn’t exactly that big a deal – hey, it’s not New York City, where you’ll last about 2 bars before meeting the NYPD. But it’s fantastic to see what the Mob are all about, and the performance is terrific.

Most importantly, this video includes this poetic diatribe by An Angry Man, which I will transcribe here in the hope that someone puts it on a t-shirt for us:

Nobody is playing an instrument.
You have technicians here, making noise – are you taping this?
No one is a musician.
They’re not artists because nobody can play the guitar.

For more insight into edIT’s thoughts on music in general, here’s an extensive video interview. This comes from an apparently defunct show called The Craft. The show title has certain unfortunate associations with bad girl-witch movies, and pops up odd bits of trivia that make it seem as though it was targeted at old people or kittens. (Turntables, associated with hip hop? Who knew!) But the production itself is lovely, and edIT has some great things to say. And the show producers got one thing very right: edIT is part of the future of music.

More on edIT’s music and edIT and Glitch Mob touring to a town near you (NY tomorrow, LA 4/30, Arizona, Detroit, Alberta…):

edIT