Laptop musicians are feeling out of sync — literally. But we can work together to help the situation.

Computer music making can be an isolating experience. But when users try to use their eminently-mobile tools to play together in the same room, they often find that the technology resists. MIDI, as a serial protocol, isn’t designed for networked environments. Software interfaces are designed to be visible to only one user. Sharing between users rarely figures into designs. Input points are made to be single-user only.

And most importantly, just getting a couple of computers to sync can be a Herculean task — one that seems to have gotten worse with advanced computer software rather than better. In short, for all the technology we have today, we’ve actually regressed from the state of interoperability 20 years ago.

I’ve been hearing more and more frustration over sync, as people begin to collaborate with multiple computers as they would with a small ensemble of instruments. Ableton Live is the most frequent example, but it’s only one case – and I suspect part of the fault is that people are more likely to try to sync multiple copies of Live. When I spoke to Depeche Mode’s Martin Gore in the spring for Keyboard, Martin complained that they had trouble syncing his Apple Logic sessions with other band members using Pro Tools and Ableton. This weekend in Los Angeles at the DubSpot sessions, Glitch Mob’s Justin Boreta talked about the issues that group has had with multiple copies of Live.

Synchronization is, by definition, a tough thing to do. But musical engineering is replete with challenges; it’s no longer acceptable to simply say “live with it” and walk away. It seems we need both better shared knowledge about what sync is how to make it work, and better engineering solutions on the software and protocols side to support the way users want to work. And yes, we need a new sync standard that goes beyond what’s presently available in MIDI alone.

Focusing this discussion, I just got an essay in my inbox that I think focuses the issue. I will try to speak to Ableton’s engineers about the matter, but this isn’t really about Ableton alone, so I’m posting it here first. We could use more data about how you’re working with various software and hardware, what techniques you’ve developed, and what frustrations you’ve had. We have a wide community here of users and developers (and a whole lot of you are both).

Mark Kunoff writes:

I’m writing to you today about an issue which I believe has been a sore spot for many Ableton Live users – *reliable* syncing of two or more computers – particularly for those of us who are attempting to sync for the purposes of *live performance*.

My musical partner Patrick Petro and I (together we perform as “Othership”) have been struggling with this issue for several years now. At present time, we have a decent solution using midi time code. Initially we attempted to use Midi “clock” but our friend Steve Duda (partner of Deadmau5 in BSOD) informed us, “using Midi clock is as reliable as syncing to a boat motor.” He informed us that in BSOD, he and Deamau5 have reliable sync between their 2 laptops using MTC, although the main drawback is the inability to fluctuate tempo – you must run at a consistent tempo the whole time. (You may be aware of this already, but Steve is the person responsible for ‘Molar’ the incredible step and loop sequencer for the Monome, was a programmer for Devine Machine and has worked for many renown artists in the music industry such as Trent Reznor. We are very fortunate to benefit from his consultation!)

Currently we are both using Macbooks and syncing via Ethernet with Audio File Engineering’s “Backline” app to generate MTC. This method has been about 95% reliable, but after reading an article on Ableton Tweets (http://abletontweets.com/post/126300941/why-midi-sync-over-ip-may-not-be-a-good-idea and our response – http://abletontweets.com/post/224247258/midi-sync-in-ableton-live-why-so-complicated) we are going to acquire a dedicated external device to generate MTC such as a Motu Timepiece.

I feel strongly that Ableton has not addressed these issues sufficiently and could do a better job of educating their user base as to the challenges that face performers in achieving reliable sync. I’m not expecting a walk in the park, but as of yet Ableton has not provided comprehensive documentation regarding these issues and places most of the responsibility on users to figure it out for themselves. We are (and have been) perfectly willing to educate ourselves but for the most part this issue remains elusive to the majority of Ableton Live users.

The Ableton Live forum posts regarding sync are fraught with dissension and are excruciating to read to say the least. I feel I’m empathetic to the complexities of programming audio applications, but in my estimation Ableton tech support’s explanations toward this issue have been mostly open ended. Many users report these issues only to report back that Ableton’s tech support doesn’t respond. I have experienced this as well. Certainly there are enough customers who want a better solution.

I feel it’s time to launch a concerted effort to organize users and demand that Ableton addresses this issue once and for all. Perhaps this solution wouldn’t even involve midi at all. Ideally this would be an open protocol such as OSC, but I wouldn’t be opposed to a proprietary solution – just as long as there is a reliable one.

The main purpose of this correspondence is seek your and CDM’s assistance in sponsoring an effort to encourage Ableton to address this issue once and for all. I feel CDM could be quite helpful in garnering leverage toward this effort (a simple blog post, or ideally a dedicated section) to organize users and to demand better sync ability between two (or even multiple) laptops running Live – even from unlike computer manufacturers. I’m sure you know artists with valuable expertise in this area.

Even if the issues regarding sync via midi are insurmountable, there have to be CDM readers who have developed reliable methods of two or more persons performing with Ableton Live and it would be great to have one centralized portal where discussions of working methods can be discovered.

Thank you for your time.

Again, my personal intention is not to single out Ableton — I’ve heard similar complaints about other scenarios, and moreover, I think the “open-ended” tech support response occurs when there isn’t an easy solution. Tech support alone often can’t deal with something as multi-faceted as sync, so it’s time to engage other users in this, as well.

I’ve also spoken to Owen Vallis and other folks about how sync could be executed more effectively over network protocols, and specifically how the time stamp feature in OpenSoundControl might be used in conjunction with MIDI clock messages.

To kick things off, let’s comment here, but I’m also setting up a special Noisepages group for users to share experiences and tips:

Sync or Swim Group [noisepages]

(Incidentally, CDM contributor Matt Ganucheau is joining me Saturday at a WordPress developer intensive here in New York, so we’ll be picking up development techniques to work on the Noisepages community, too.)

Jump in, say hello, and let’s talk about how we can make sync work in real-life musical situations.

I’ll also be talking to more artists and developers about their experiences and suggestions, and will pass along your feedback, so expect a report back. In the meantime:

1. Are you routinely trying to sync multiple musicians?
2. What software (and hardware) tools do you use?
3. What have been some frustrations?
4. What techniques have worked, or what have you learned you might want to pass along to other users at various skill levels?

Critics frequently attach the phrase “lock-in” to Apple’s iTunes Store – iTunes – iPod/iPhone combination. But, in the post-DRM age, what does that mean, exactly?

First, you have to recall that while for many of us the manual drag-and-drop music management is appealing, it isn’t so for many average consumers. They want sync. That means that music will be stored in iTunes and synced to Apple devices and nothing else. Apple is serious about locking you to their store and their devices, enough so that they frequently update their software with special keys that prevent the use of devices. iTunes is “free,” but Apple determines which mobile devices you can use and which you can’t. And Apple has gone after anyone who dares give you the ability to use your own music software or own devices, including efforts (ironically) to make their iPhone and iPod work with Linux and open source players.

These efforts don’t protect the music or prevent privacy – they protect users of Apple’s software and mobile devices from using anything but Apple’s tools. Yet Apple has used the Digital Millenium Copyright Act to take legal action over anyone who dares to even talk about how to use legally-purchased music and hardware:

OdioWorks v Apple

Perhaps suspecting their case was too thin to defend, Apple eventually backed off that particular claim — after, says the Electronic Frontier Foundation, “7 months of censorship and a lawsuit.”

Apple Withdraws Threats Against Wiki Site

But the software and hardware locks are unchanged. And Apple has won, in my view, an even more important battle: they have a monopoly over mindshare.

Here’s an example from a recent review by Gizmodo of the Android 2.0 mobile operating system from Google, as implemented on the Verizon-distributed Motorola Droid. They have some fair points about Android’s maturity and strong and weak points. But note what they say about music sync:

The only way to get your music and videos on the phone is to manually drag and drop the files. There is no syncing, no easy way to get your music library onto your phone. How are normal people supposed to figure this out? Verizon reps actually joked about how putting music on the Droid is sure to make for a lovely Saturday afternoon. What. The. Shit.

In fact, this is technically accurate, to my knowledge, only if you’re using iTunes. That incompatibility is engineered specifically by Apple. It’s a “feature”: other vendors could make other devices sync with iTunes, but Apple engineers regular updates to prevent them from doing so. In fact, while Apple was conceding defeat in its efforts to censor the Web over its iTunes lock, it was simultaneously busy blocking the Palm Pre from working with iTunes. This should be especially sad to long-time Mac watchers, who saw a Mac community railing against Microsoft’s effective office software and operating system monopolies in the 90s. Those Mac historians should also recall the early development of iTunes and shareware predecessor SoundJam, both of which worked with a variety of hardware. Now, some members of the same Mac community cheer market share numbers and anti-competitive practices by Apple.

But, engineering aside, it’s really the mindshare battle that’s most impressive. Gizmodo, in saying the Android “doesn’t sync,” really means that it “doesn’t sync with iTunes.” And given iTunes’ massive market share, Gizmodo is not alone – I’ve seen similar complaints from other press outlets and, anecdotally, many, many users.

In fact, Android sync is supported by a variety of applications. In my tests, it works with the open-source players Songbird (Mac, Windows, Linux), Banshee (Mac, Linux), Rhythmbox (Linux), Winamp (Windows), Media Monkey (Windows), and yes, even Microsoft’s own Windows Media Player. Microsoft may restrict the use of its Zune media player, but ironically its music playback software is far more open than Apple’s.

By “sync,” incidentally, I mean automatically – it’s no harder to use these applications with Google Android than Apple’s iTunes and iPhone/iPod. I personally find most of them more flexible and intuitive than iTunes. And I can show someone in a couple of minutes how to manage their device via the file system, too – even “normal people.” (I definitely don’t count as “normal,” so no argument there. But presumably “normal people” can learn to use the Mac Finder, right? Apple certainly argues they can – then locks users out of that tool when they connect an Apple mobile player.)

This is not a pro-Android argument, despite the screenshot. Any music player or phone that supports normal disk mounting will work the same way.

Why should all of this matter to musicians? The reasons monopolies are a concern in the first place has to do with pricing, and media monopolies add to that control of culture and speech. Even if your music isn’t distributed through iTunes, pricing and consumption patterns, and even the kinds of music people listen to and where they discover it are now being deeply impacted by Apple. Apple, in turn, by convincing users that there are no other options and engineering interoperability out of their products protect that control, just as digital music is growing by leaps and bounds. (For statistical evidence of the resulting trends, see today’s other story, linked below.)

I spoke to the Electronic Frontier Foundation’s Senior Staff Attorney Fred von Lohmann in April about the paper-thin (literally) arguments from Apple, when Apple was trying to prevent websites from talking about the database lock between iTunes and mobile devices:

All Apple has told us about this is in the letter they sent to us in December, as posted on the website as an exhibit to our complaint. Apple simply cites the fact that the iTunesDB page authors said that the obfuscation mechanisms used to create the iTunesDB has “may reside” in the FairPlay DRM code.

…The important thing here is that the iTunesDB pages were simply discussions about what might need to be done to reverse engineer the iTunesDB hashing. There was nothing to indicate that the efforts had succeeded. So even if understanding the iTunesDB hashing mechanism somehow magically unlocked all of FairPlay (which would seem to be far fetched), nothing on the pages suggests that the authors were anywhere near that goal.

Note that at the time, the EFF did not claim Apple lacked the right to make these kind of locks. The EFF told CDM at the time, “They have every right to do – to try to block it. Apple can certainly try to block it. What they can’t do is use inapplicable federal law to use legal threats to get them to stop.” And Apple backed off those claims.

The issue is whether you should invest in a product that limits your freedoms to use it. And the issue for musicians is whether this kind of a behavior from a company with an effective monopoly is limiting the potential power of digital music listeners in the future.

This is not to say that there aren’t reasons to choose to use an Apple device or its iTunes software. As reader “low resolution sunset” says in comments on the previous story:

This is pure conjecture: but I tend to think that slick interface design, trust, and loyalty for the Apple brand identity is what’s winning them the dominant market share of downloads.

Indeed. So, why not rely on that design, trust, and natural loyalty? Why force loyalty through engineering? And even given these qualities, isn’t there a danger when one company becomes so dominant that people don’t so much as consider alternatives? What’s to keep Apple competitive on good design if they have no competitors?

I certainly can’t answer those questions. And in the meantime, I’m looking to other alternatives, alternatives that have made me quite happy.

More on what this can actually mean:

Digital Sales Up, But is Apple Monopoly the Price? NPD, Mint Data, Editorial Analysis

four tiny drum machines from ALH84001 on Vimeo.

Cybernetics is poised to make a comeback. The theory is, everything from electronic circuits to plants and animals can be understood in terms of feedback loops, as organisms – mechanical or organic – respond to input from their surroundings. The father of modern cybernetics, MIT mathematician Norbert Weiner, was inspired by working on the guidance systems of missiles. His writing was picked up Louis and Bebe Barron, informing their organism-like sonic circuits, as used in the film Forbidden Planet. The word cybernetic itself comes from Plato. Plato was talking about human self-governance. But designed with cybernetic ideas in mind, technology, too, becomes self-governing and autonomous – and the sonic circuits, too.

Young designers like Eric Archer are to me the newest continuation of work like the Barrons’. Inside his lab, Eric and others are creating hardware that behaves like intelligent life. In the video at top, four tiny drum machines, equipped with insect-like brains and reflexes, network together wirelessly over infrared, responding to light by way of photocells. These tiny devices form a colonial consciousness.

Eric may be a mad scientist, but he isn’t keeping his work secret or proprietary. He’s sharing the tools, sharing his methods, and with a whole growing crew of sonic DIYers in Austin, Texas, inviting anyone to join the revolution under the banner of the Handmade Music series. (More on the upcoming event shortly.) If you’re not from Texas, a lot of this documentation is also appearing online.

Here are more of the creations, plus the simple but powerful circuit that makes it all happen.

And yes, there’s a lot of potential to wireless IR sync.

The drums have names:

Drum Machines (Eric Archer)
ASR mk I “pops”: two analog damped sine oscillators with photocell pitch control, 16 presets
ASR mk II “snappy”: analog white noise, photocell controlled filter, envelope + VCA, 16 presets
ASR mk III “twiki”: photocell tuned analog osc, photocell tuned LPF, envelope + VCA, programmable
ASR mk IV “boomer”: analog damped sine oscillator, long decay, photocell pitch envelope, programmable

But drum machines are just the beginning of what could eventually be wirelessly synced. First up, this autonomous bassline generator, created by 4ms Pedals

The Autonomous Bassline Generator creates deterministic bassline patterns in a sci-fi retro sound by generating melodies on the fly, based on a knob. It’s just an AVR (attiny44) chip doing all the work, plus an opamp to act as the filter (photocell). The blue button is Tap Tempo, or if you hold it down for 1 second, it syncs up to the pulses on the IR receiver (this lets you beat-sync multiple Andromeda Space Rocker modules). The red button lets you edit a single note in the melody. Pulse-width modulation is currently pre-set to a certain envelope, but that will become user-controllable soon!

Part of the “Andromeda Space Rockers” series of modules, see www.ericarcher.net for drum modules.

The 6-pin header board dangling to the right is an ISP header. Totally hackable!

“Ah,” you say. “But I have computers and things. I don’t just want a bunch of little drum machines running around my studio like so many electronic beetles while I furiously tap my tap tempo in Ableton. Can’t I sync thing up?”

Yes. Yes, you can. There’s already a MIDI-to-IR prototype in the works.

Four analog drum machines are synchronized with a desktop computer running Logic. Logic is playing a loop with TR808 samples. MIDI timecode from Logic is converted to IR Sync with a PIC microcontroller. The PIC flashes an infrared LED, providing wireless clock to a chain of analog drum modules. Each drum module has an onboard sequencer, analog sound generator, and IR Sync repeater. At the end of the video, the tempo is increased to almost 3000 BPM. In a separate test, the system played OK at 1000 BPM. Of course this tempo is ridiculous but it is a nice “torture test” of Nathan’s PIC code.

PIC stuff: Nathan Wooster
drum machines: Eric Archer

Our friends at Bleep Labs also have projects in the works.

Eric and 4ms have contributed the circuits at the heart of this.

This simple circuit handles infrared clock networking. (Click for the full circuit.) I’m assuming you know how to read this; we may have to put together an actual how-to tutorial for those new to electronics, too.

And 4ms has a version for interfacing with microcontrollers.

The Barrons would be proud.

For more on the Handmade Music series as it spreads around the planet, visit http://handmademusic.noisepages.com.

Here’s a superb reader tip: DJ Josef Prusa has been using SugarSync to synchronize Native Instruments’ Traktor Pro DJ software, so that he and his brother have their full music collection at the ready at gigs. (Naturally, this same technique means that if one of their MacBooks should die, bro to the rescue!) Not only does music get synced, but playlists, collections, MIDI mappings, and settings do, too. Now, you could use something like the ubiquitous free command line utility rsync to do the same thing, but SugarSync has the advantage of giving you cloud storage, too, so you have an additional backup and always-on access to your files.

Traktor is just one example. You could do the same with any other essential files. Josef also syncs Max/MSP patches for monome, plus a promising-looking, in-progress wifi controller. File sync in SugarSync works across Mac, PC, and now iPhone, Windows Mobile, cell phones, and Android. (One gripe: no Linux support, something DropSync can muster.)

Synchronize multiple collections of Traktor PRO automatically

Before this becomes a SugarSync ad, though, I am interested in what other solutions people are using. There are various cloud storage and sync services. SugarSync is fairly unique in providing both true sync/remote access with cloud storage. But maybe you have added your home server to the mix, or found another solution.

Josef seems to be the perfect geek DJ – check out his iPhone-MIDI hack and (while not musical) iPhone R/C car control.

Readers have complained that we’re doing so much mobile music coverage that it’s hard to wade through it, specifically in regards to the iPhone. I’ll be consolidating that news into a more manageable weekly post. The goal is to make this information more manageable both to those who love mobile music making, and those who don’t. Unfortunately, in my haste to do so, I got something wrong, and I think it deserves a separate correction.

Update: The iDrum mobile app available today will indeed allow you to use your own samples and exchange files with your desktop computer. The original story has been updated:

iPhone News: iDrum, BtBx In; Mixtikl Out Citing Apple Rules

That’s important, because the fundamental issue that determines whether a handheld music app is a toy or something that matters to your music is workflow. If you can complete something musically meaningful on a handheld device, or you can work on something related to what you’re doing on your desktop/laptop computer, then obviously, it’s useful, and that’s what we care about on CDM.

Developer Art Gillespie explains:

With iDrum for iPhone, you can do full round-trip editing of beats–including sending samples back and forth–with iDrum (desktop) for Windows/Mac.

As for audio export, it’s pretty easy to grab the ringtone bounce and use that. (If you don’t already have iDrum)

If you’re currently using the app, the build of iDrum.app with this feature isn’t out just yet; we’ll have an update when it becomes available. It’s not documented, either, but we have confirmed this functionality.

This also explains something that confused a reader, which is why the iPod Touch version of iDrum still has a ringtone bounce, even though you can’t load ringtones on the iPod.

Of course, part of why we don’t simply copy and paste press releases on CDM is that I like to understand the real message of new tools , even if that means first getting it wrong. (The round-trip workflow didn’t seem to be fully documented when the story first ran.)

So, apologies to Art, and now back to your regularly-scheduled programming. We’ll have another iPhone update at the beginning of next week.

1895 Edison “Kinetophone” Test, shot by William Dickson [Internet Archive]

The restoration is a story in itself, employing the collaborative efforts not only of Mr. Murch, but the Library of Congress, the Edison National Historic Site, the incredible sonic restoration capabilities of the Rogers and Hammerstein Archive of Recorded Sound at Lincoln Center, and Skywalker Sound and Industrial Light & Magic. Most strikingly, the archive was able to repair and re-record the broken cylinder, while Murch managed to perfectly sync the sound with the video. Edison’s experiment worked, only just over a century later than anticipated.

The film itself is a surreal dance with violin accompaniment, dwarfed by the giant cone used for recording. Since Mr. Murch and Sean Cullen donated the film to the Internet Archive, it’s also Creative Commons-licensed, meaning you can create your own audiovisual experiments with the footage. I expect the fully remixed version in my inbox within the week.

A playback note: the MPEG2 I downloaded didn’t properly reproduce sound in QuickTime 7, ironically enough. In the open source MPlayer (Mac; also on Linux and VLC (cross-platform) players, I had no trouble.

Now we’re talking. Tascam’s upcoming HD-P2 is finally a portable Compact Flash recorder that doesn’t skimp on pro features. Incredibly, its street price will be under US$1000, but the preliminary specs read like a device costing a lot more, and by providing timecode input on a cheap device, it’s an indie filmmaker’s dream recorder:

Up to 192 kHz / 24-bit

Absolutely silent (no transport noise, cough, DAT!), latched CF slot (so it doesn’t pop out accidentally)

Broadcast WAVE recording

FireWire for connecting to PC/MAC for instant file access

Data loss protection (continually re-saves data)

XLR mic inputs with phantom power and analog peak limiting

Unbalanced RCA I/O plus S/PDIF digital I/O

Built-in mic and speaker

Runs on AA batteries for 5.5 hours (battery pack could be an accessory in the future, a la the DA-P1)

Timecode input, video clock input, input chasing

Let’s focus on that last one for a moment: a $900 street recorder will have timecode input for sync in video shoots. That’s something even most DAT recorders don’t have. Edirol’s R-4 recorder is great, and has a 40GB hard drive instead of a CF slot, but it costs $600-700 more and lacks sync.

Timecode in has never been this cheap before. People might actually start syncing their audio recordings. Wow.

I got a chance to handle this box at AES, and quite simply, it’s beautiful. It’s got the same solid, crisp feel as Tascam’s DA-P1 portable DAT I’ve used a zillion times. It’s simple and inexpensive enough that amateurs and education will pick it up, but with serious enough features that it could become a hallmark of video shoots. Bravo, Tascam.

Tascam HD-P2 Recorder [Product Info]

Portable digital recording is great — import is as simple as dragging files to your hard drive, they’re mobile, they’re non-linear, and they write to increasingly cheap storage formats like CompactFlash. But what about synchronization for video applications? I have found one portable field recorder that’s CompactFlash-based, records up to 192kHz, and optionally can be configured with a SMPTE timecode reader/generator:

Fostex FR-2 CF field recorder

This is definitely a “if you have to ask, you can’t afford it situation,” but boy, check those specs and you’ll see what a CF recorder should be.

Video pros / post production gurus out there: what are you using? Seen anyone recording audio on synced field recorders yet?

For me, the solution has been just to use a standard consumer recorder and sync manually — though I definitely don’t trust those cheap MiniDisc recorders.