For all the focus on clever little music apps on your phone, it’s the slate/tablet form factor that seems to hold the greatest promise for live performance. Thanks to a larger screen area, these devices look far more usable for control – equipped with multi-touch, they could be reasonable substitutes for hardware control surfaces, a la the Lemur.And with greater horsepower under the hood, you might not need to use them as a controller – you could run an entire live gig off them.

With this week’s Consumer Electronics Show (CES), many onlookers expected news on these devices, particularly as industry buzz anticipated a big announcement during Microsoft chairman Steve Ballmer’s keynote last night. And we got that news – sort of. Unfortunately, manufacturers teased “concepts” and prototypes, without much in the way of details – a repeat performance of 2009′s fuzzy glimpse at this device category.

That said, having been wrong about when it’ll happen, I’m still convinced we’re about to see a flood of new PC devices with interesting potential for music performance. Here’s what we’ve got so far:

Dell has a tablet “concept.” Dell’s own keynote included a brief mention of a five-inch tablet. That could make a nice form factor to stow on a keyboard or music stand as a controller. That’s about all it’ll do, as the pictures show only an audio output jack. But it will evidently have multitouch. This is only a “concept,” with no details publicly released; I’ll be following up with Dell if they announce an actual product. Photos:

Dell Tablet Concept [Flickr]

More on Dell’s new lineup (the rest of it is shipping, and may interest you more, anyway — Dell is taking advantage of wildly cheaper PC component prices to deliver some amazing machines under $1000)

HP’s Slate: Seen briefly in Ballmer’s CES keynote, the Slate is a “consumer notebook” in a slate form factor. The only good news relative to Dell’s model is that this is supposedly hardware that will ship. The bad news is, HP isn’t saying much else. The device does have a nice, sizable screen, at at least 10″ or larger (if my ability to tell the scale of things relative to Steve Ballmer’s torso is correct). That could make this an appealing alternative to other devices and form factors.

And, oh yeah, Apple: Here’s the power of Apple: PC makers, who have been shipping tablets for years, and who have shipped alternative form factors for years more, are accused of ripping off an Apple product that isn’t yet public, and about which most of us know nothing about (including, indeed, if it actually exists in the form we think it does). Not only that, but sight unseen, I’ve heard many people who assume that the Apple model of this currently-nonexistent product category will be superior, even though they don’t know what OS it’ll run, what it’ll do, what it’ll look like, what size it’ll be, or what it’ll cost. PC vendors, of course, had the opportunity to provide a clear alternative, and instead made their picture somewhat murky, too.

I don’t just mean Mac fanboys, either, who could be excused the pre-emptive positive review. Even The New York Times got in the act. Ashlee Vance of the NYT Bits blog wrote in advance of Ballmer’s speech:

It could be one of Steve Ballmer’s riskiest trade-show moves in years.

On Wednesday, Mr. Ballmer, Microsoft’s chief executive, will unveil a novel take on a slate-type computer … This product better be good because Apple is expected to unveil its take on the slate/tablet form factor later this month … The last thing Mr. Ballmer wants to hold up is a me-too device.

Yes, how dare he … announce … a product … that might compete with a product that no one has seen yet? What a risky move! (Deep thought: can a product be “me-too” even before there’s a “me,” or in this case, an “i”?)

That said, yes, most industry analysts expect an Apple announcement later this month. I’m skeptical about whether such an announcement will be useful to our audience, however. If Apple chooses its relatively locked-down iPhone-style operating system over the Mac OS, and if there’s no hardware input and output, and if the focus is buying magazines and books from iTunes, I think I’ll pass. Of course, some PC vendors may go a similar route.

And, in fairness, I’m sure part of what has prompted PC makers to unveil prototypes of non-shipping products is fears of what happens if Apple gets there first. It’s too bad Apple doesn’t leak a secret plan to solve global warming, or give away chocolates.

Android is a big winner. Murky as the slate announcements were, the one message that has been clear out of CES is that we’re going to see more of Android.
HP may even ship a version of HP Slate running the OS, says TechCrunch. Ordinarily, this would be relatively bad news; on Windows, you can run any music software, whereas Android is relatively limited. But I think that could improve, with open source controllers and work on porting free multimedia tools like Pd (Pure Data) and Processing.

Just keep in mind…

Don’t forget “traditional” tablets for multi-touch. Sure, these smaller slates are interesting, apparently an attempt to blend the appeal of e-readers like Kindle and Nook with handhelds like the iPhone. But why carry a tablet and a laptop when a multitouch laptop could be both? Yep, tablet PCs are back, now with multi-touch input as well as pen. And their convertible form factor means you could have multi-touch control without your arms getting tired.

Case in point: Dell’s Latitude XT2 joins entries from Lenovo and HP. HP’s TouchSmart tm2 (as seen on Engadget) finally improves on HP’s previous, somewhat underpowered entry; I’ll be looking more closely at it. Also appealing: the HP is the first of these devices I’ve seen to pack discrete graphics, which could give you a machine with enough graphics muscle to do live visuals and video, plus music, all with multi-touch control and the I/O ports you’d expect on a laptop. It could be an all-in-one live performance beast if it pans out; I hope to check it out soon.

More analysis of the options – and why the upcoming battles could be a battle for computing’s soul:

Gotta Be Mobile has long been a stalwart analyst of, and advocate for, the tablet PC. Here’s the surprise: even die-hard Tablet PC fans are skeptical about just what the new “tablet” or “slate” means. And the bigger surprise: even outside of the world of music and visualist sites like CDM, people are asking the question about whether the future of slate/tablet computing is passive consumption. Here’s Tablet PC MVP Warner Crocker writing for the blog:

Then there’s the question of what do we do with these things now that we seem to be on the threshold of seeing them everywhere? That boils down to content and in most cases that means consuming it, not creating it.

Floating on a Sea of Tablet Paradoxes

Christophe Stoll of precious, the Hamburg-based design firm responsible for everything from familiar soft synth user interfaces to rock band graphic looks, has similar skepticism. His take is even more far-reaching: in the midst of rabid gadget consumption, what about affordability, ecological impact, and truly open, community development? His first story looked at some of the shiny possibilities in the future:

The tablet innovation race: Three commented examples of what Tablet Computers could look like in the near future.

A follow-up story, however, responding to comments by me and others, wondered if a more open, sustainable, hype-free future could apply more intelligent design:
Tablet innovation race II: Some more critical thoughts regarding the ongoing hype around tablet computers.

Bottom line: by this time next year, I do expect that we’ll have some powerful, new, affordable solutions for multi-touch control and portable music and visual performance. Just what form that will take, though, isn’t much clearer now than it was this time last year. I hope that situation will change soon – and I hope Apple doesn’t prove to be the only company able to articulate a vision for the category.

Here’s a switcher story of a different color: from the Mac, to Linux. It’s one thing to talk about operating systems and free software in theory, or to hear from died-in-the-wool advocates of their platform of choice. In this case, we turn to Kim Cascone, an experienced and gifted musician and composer with an impressive resume of releases and a rich sens of sound. This isn’t someone advocating any platform over another: it’s an on-the-ground, in-the-trenches, real-world example of how Kim made this set of tools work in his music, in the studio and on tour. A particular thanks, as he’s given me some new ideas for how to work with Audacity and Baudline. Kim puts his current setup in the context of decades of computer work. Even if you’re not ready to leave Mac (or Windows) just yet, Kim’s workflow here could help if you’re looking to make a Linux netbook or laptop more productive in your existing rig.

Stay tuned, as I’ll have some other stories on how to make your Linux music workflow effective creatively, particularly in regards to leaping over some of the setup hurdles Kim describes. -PK

Historical Evolution

I’ve been working with computers since the 1970s. Inspired by the work of composer David Behrman, I taught myself assembly language and programmed a simple digital sequencer on a KIM-1, single-board microcomputer, controlling an Aries modular synthesizer I had built. I discovered a then-new magazine called Computer Music Journal at the local computer shop and bought every copy I could get my hands on. (I still have them, too.) Later, I helped a friend’s father, an executive at IBM, unpack and set up the first personal computer IBM made. The manuals alone took up two or three feet of bookshelf space.

Fast-forward through a couple of decades of owning Commodore 64s, Apple computers, and PCs. In 1997, I purchased my first laptop: a woefully-underpowered Compaq Presario. It wasn’t fast enough for real-time audio, so I had to render sound files to hard disk using the audio programming language Csound. I created many of the sounds this way for my CD ‘blueCube( )’. But the capacity to work anywhere was enough for me to give up ever owning another desktop computer.

Frustrated with the ‘code-compile-listen’ process of working with Csound and wanting to work in real-time, I switched to the graphical multi-media programming language Max/MSP, which necessitated a move back to Apple hardware, so I bought a PowerBook. Having Max/MSP running on a laptop was the perfect environment for me. I could build the tools I needed whenever an idea presented itself. The computer functioned as both sound design studio and stage instrument. I worked this way for ten years, faithfully following the upgrade path set forth by Apple and the various developers of the software I used. Continually upgrading required a substantial financial commitment on my part.

Apple Seeds of Discontent

When I’m on the road, I use my laptop as a music studio, performance instrument, and administration office. I don’t like surprises on the road. Having a computer fail means a loss of income, and makes for an embarrassing moment if the failure happens during a performance. If watching laptop music bores some people, watching a musician reboot is even worse. So to be safe, I stress-test all new hardware or software in my studio for at least a month before I take it on the road. Max/MSP patches run for hours, software is used for weeks, and hardware is left on for days at a time to help induce failure before I leave home. But as fate would have it, an iBook I was touring with died a few years ago. I brought the laptop into an Apple repair shop in Berlin, where a technician diagnosed the problem as a faulty logic board. The failure rate on logic boards was high for that model of iBook, and in response to public pressure, Apple instituted a logic board replacement program. Luckily, my laptop qualified and the logic board was replaced for free. But the failure and ongoing buggy behavior impacted my work schedule and added to the stress of touring.

I’ve now replaced logic boards on three computers; the other two I paid for out of pocket. The out-of-warranty cost of replacing a logic board on an Apple laptop is around six hundred dollars — cheaper than buying a brand new laptop, but still significant.

If you make your living with applications that run on OS X, there are no options if a laptop fails. You either repair expensive Apple hardware or buy new expensive Apple hardware. This is called ‘vendor lock-in.’

Then, during my 2009 spring tour, my PowerBook G4 exhibited signs of age, with missing keystrokes, intermittent backlighting, the failure of a RAM slot, and reduced performance. As an alternative to repairing the PowerBook, I investigated what a new MacBook Pro and upgrades for all my software would cost. A quick back-of-a-napkin estimate came to approximately $3,000, not including the time it would take tweaking and testing to make it work for the tour. If the netbook revolution hadn’t come along and spawn a price-wars on laptops, I might have proceeded to increase my credit card debt. But as a wise uncle once advised, “you invest either your time or your money; never both.”

Meeting Ubuntu

I had tried Linux in 2005 on PowerPC-based Mac laptops, though at the time I couldn’t get audio working, even after extensive tweaking. But I had kept an eye on Ubuntu ever since. After considering MacBook Pro prices, I checked out the new netbooks coming to market and picked up a refurbished Dell Inspiron Mini 9 with Ubuntu pre-installed.

I loaded up my Dell with all a selection of Linux audio applications and brought it with me on tour as an emergency backup to my tottering PowerBook. The Mini 9 could play back four tracks of 24-bit/96 kHz audio with effects – not bad for a netbook. The solution to my financial constraint became clear, and I bought a refurbished Dell Studio 15, installed Ubuntu on it, and set it up for sound production and business administration. The total cost was around $600 for the laptop plus a donation to a software developer — a far cry from the $3000.00 price tag and weeks of my time it would have cost me to stay locked-in to Apple. After a couple of months of solid use, I have had no problems with my laptop or Ubuntu. Both have performed flawlessly, remaining stable and reliable.

Getting Past Ubuntu Audio Complexities

There are a few differences between how audio works on Mac OS X and how it works on Ubuntu Linux. OS X uses the Core Audio and Core MIDI frameworks for audio and MIDI services, respectively. All applications requiring audio services on OS X talk to Core Audio, which mixes and routes multiple audio streams to the desired locations. Core Audio is simple, monolithic, and easy to set up, and all the end-user controls are accessible from one panel. You can even create a single aggregate device from multiple sound cards if you need more inputs or outputs than one sound card can supply. To Apple’s credit, Core Audio and the applications that make use of it are the reason why you see so many laptop musicians seated behind glowing Apple logos on stage.

On Ubuntu, audio is a rather different story. Apple’s slogan ‘Think Different’ would be good advice for musicians encountering Ubuntu’s audio setup for the first time. Audio in Ubuntu can appear at first to be a confusing jumble of servers, layers, services, and terminology. Go to System->Preferences->Sound, click on the Devices tab, and check out the pulldown menu next to ‘Sound Events’ at the top of the panel. You will see various acronyms, possibly including cryptic-looking technologies like OSS, ESD, ALSA, JACK, and Pulse Audio. These acronyms represent a byzantine tangle of conflicting technologies that over time, and due to political reasons or backwards compatibility, have ended up cohabiting with one another. ‘Frankenstein’ might be an accurate metaphor here.

Thankfully, there is a simpler way, which is the combination of ALSA [a high-performance, kernel-level audio and MIDI system] and JACK [a system for creating low-latency audio, MIDI, and sync connections between applications and computers]. The battle-scarred among us have learned to ignore all the other audio cruft bolted on to Ubuntu and just use ALSA and JACK. One can think of the ALSA/JACK stack, the heart of most pro Linux studios, as the Core Audio of Linux and in my opinion Jack should be the first thing installed on any musicians laptop. I’d go so far as to suggest placing it in the Startup Applications so it’s always running.

The ALSA/JACK combination is a little more complex to set up and tweak than Apple’s Core Audio, but there’s a lot of good information online. [Ed.: ALSA, JACK, and the real-time Linux kernel also have some advantages over Mac OS X that can be worth the effort. While JACK has been ported to Mac, Linux has more JACK-aware tools, which is necessary for transport sync. Just as importantly, once configured, you can build rigs with Linux that have greater low-latency performance than may be practical on Mac or Windows. In other words, while it may require an investment of time, it can be both free and better! -PK]

Workflow

Over the past ten years, I’ve developed a workflow that has worked well in the studio and on the road. Since I created most of my tools in Max/MSP, they could shape-shift to fit any musical task I encountered. A sound mangling tool I’d written for studio use, for instance, I could then adapt for a performance with Tony Conrad. I modified parts of my performance patch for sound installations. This environment served me well over the years – until recently, when my aesthetic focus changed from using randomness in my work to taking a more deterministic approach. This happened to coincide with my change of operating systems.

I do a lot of location recording while on tour. My rig consists of an Olympus LS-10 digital recorder and an Audio Technica AT-822 single-point stereo microphone. I record at 96kHz/24-bit to a 16GB SDHC card in the LS-10. When I want to audition sound files in the field, I use my netbook’s SDHC reader, renaming sound files directly on the card. I can look at some of the files in Baudline if I need to check for low-frequency rumble or technical anomalies. I have come to use Baudline on a daily basis.

Back in the studio, using the sound editing program Audacity, I remove voice slates, trim heads and tails, adjust gain and EQ as needed, then save them to a project folder. And because I don’t like surprises in the studio, either, this folder gets backed up onto a remote network drive as well as a local USB drive.

Building my sound library takes weeks or months. During this time, I start filling a notebook with ideas, drawings, plans and marginalia, from which a score emerges. I import all my project sound files into the open-source Digital Audio Workstation Ardour, arranging them to loosely resemble the score in my notebook. Once my Ardour session is set up, I move sounds around, try different effects, create new textures by layering, then render and re-import sub-mixes until the piece starts to take shape. I use a KORG nanoKONTROL as a mixing surface. I assign faders, pans and switches assigned to the DAW allowing me to quickly play around with different mix ideas.

Once the piece sounds finished, I mix down to a stereo .WAV file at 24-bit/44.1kHz, without using compression or EQ on the mix bus. Tip: mastering engineers really appreciate getting a raw 24-bit master that hasn’t been fiddled around with by the musician. For performances, I also use Ardour and the nanoKONTROL to do an acousmatic presentation. This version of the Ardour session will have compression and/or EQ on the mix bus, since I want the material to sound more polished. As a side note: I am looking into using the mastering tool JAMin [JACK Audio Mastering Interface] for this purpose in the future.

Sayonara, Apple

After ten years of working on Apple laptops, I’ve left the fold. Not only was the expense of owning and maintaining Apple hardware a key factor in my switch, but the operating system had become a frustration to me. Details like not having a tree-view in the right hand panel of the Finder window slowed me down. Ubuntu, on the other hand, feels more like an operating system made for grown-ups. And what’s especially nice is that Ubuntu scales nicely to the expertise of the user. Your cousin the computer geek or your Grandma can install and use Ubuntu and get as deep as they like. Combine this with the recent rash of cheap, powerful laptops, and Ubuntu’s market share is bound to grow.

A Request

It’s important that kernel and audio application developers (1) ensure all audio creation software has support for JACK, (2) improve and update tools for JACK to make it easy for musicians to install, configure, and use, (3) ship distros with the realtime kernel already tested and configured for use, (4) to integrate the real-time kernel patches into the mainline kernel. [Ed.: On each of these points, distributions and kernel builds are steadily improving, partly thanks to feedback from communities like the music production community. The realtime kernel likely won't be the default, mainline kernel, but it's important to have well-maintained optional packages at the very least. That doesn't mean you have to wait for improvements to happen, though, and in future articles I'll talk a bit about how you can configure your system now to take advantage of this functionality. -PK]

Most importantly, consider paying a subscription to support developers of JACK and your favorite Linux audio software, or, if you can write code, proofread text, write a manual, do a translation, contribute graphic design, or create content; please help by contributing something to the development of the software you use.

I would like to thank Ken Restivo, Mike Rooke, Paul Davis, Philip DeTullio, Jörn Nettingsmeier and Matt Griffen at Canonical Ltd. for advice and inspiration in the writing of this article.

Kim Cascone is a composer, sound artist, touring musician, lecturer and writer. He lives in the San Francisco Bay Area with his wife Kathleen and son Cage.

Links:
http://www.osnews.com/story/6720/Introduction_to_Linux_Audio
http://www.alsa-project.org/main/index.php/Main_Page
http://ardour.org/node
http://audacity.sourceforge.net/
http://www.kokkinizita.net/linuxaudio/
http://www.baudline.com/
http://jackaudio.org/
http://drobilla.net/software/patchage/
http://www.ladspa.org/
http://lv2plug.in/
http://dssi.sourceforge.net/
http://jamin.sourceforge.net/en/about.html
http://linuxaudio.org/
http://www.ubuntu.com/
http://code.goto10.org/projects/puredyne/
http://www.bandshed.net/AVLinux.html
http://rt.wiki.kernel.org/index.php/Main_Page
http://www.pulseaudio.org/
http://developer.apple.com/audio/overview.html

Corrections / clarifications:

Ed.: I originally claimed that JACK Transport sync is not possible on the Mac OS X port of JACK. As kindly pointed out by a reader, this is not correct. JACK Transport-aware applications on the Mac will work.

Secondly, Kim argued that you could pull out a drive without having to go to a lot of trouble unmounting it first. At least one commenter argues that risks data loss, and given that users may be using something like FUSE to access foreign file systems like NTFS or the Mac’s own HFS+, I don’t yet know what the exact details will be. As I said in comments, however, Nautilus and the command line eject function for me are quicker and more effective than similar unmounting on Windows and Mac, so I still notch this one for Linux. -PK