Critics frequently attach the phrase “lock-in” to Apple’s iTunes Store – iTunes – iPod/iPhone combination. But, in the post-DRM age, what does that mean, exactly?

First, you have to recall that while for many of us the manual drag-and-drop music management is appealing, it isn’t so for many average consumers. They want sync. That means that music will be stored in iTunes and synced to Apple devices and nothing else. Apple is serious about locking you to their store and their devices, enough so that they frequently update their software with special keys that prevent the use of devices. iTunes is “free,” but Apple determines which mobile devices you can use and which you can’t. And Apple has gone after anyone who dares give you the ability to use your own music software or own devices, including efforts (ironically) to make their iPhone and iPod work with Linux and open source players.

These efforts don’t protect the music or prevent privacy – they protect users of Apple’s software and mobile devices from using anything but Apple’s tools. Yet Apple has used the Digital Millenium Copyright Act to take legal action over anyone who dares to even talk about how to use legally-purchased music and hardware:

OdioWorks v Apple

Perhaps suspecting their case was too thin to defend, Apple eventually backed off that particular claim — after, says the Electronic Frontier Foundation, “7 months of censorship and a lawsuit.”

Apple Withdraws Threats Against Wiki Site

But the software and hardware locks are unchanged. And Apple has won, in my view, an even more important battle: they have a monopoly over mindshare.

Here’s an example from a recent review by Gizmodo of the Android 2.0 mobile operating system from Google, as implemented on the Verizon-distributed Motorola Droid. They have some fair points about Android’s maturity and strong and weak points. But note what they say about music sync:

The only way to get your music and videos on the phone is to manually drag and drop the files. There is no syncing, no easy way to get your music library onto your phone. How are normal people supposed to figure this out? Verizon reps actually joked about how putting music on the Droid is sure to make for a lovely Saturday afternoon. What. The. Shit.

In fact, this is technically accurate, to my knowledge, only if you’re using iTunes. That incompatibility is engineered specifically by Apple. It’s a “feature”: other vendors could make other devices sync with iTunes, but Apple engineers regular updates to prevent them from doing so. In fact, while Apple was conceding defeat in its efforts to censor the Web over its iTunes lock, it was simultaneously busy blocking the Palm Pre from working with iTunes. This should be especially sad to long-time Mac watchers, who saw a Mac community railing against Microsoft’s effective office software and operating system monopolies in the 90s. Those Mac historians should also recall the early development of iTunes and shareware predecessor SoundJam, both of which worked with a variety of hardware. Now, some members of the same Mac community cheer market share numbers and anti-competitive practices by Apple.

But, engineering aside, it’s really the mindshare battle that’s most impressive. Gizmodo, in saying the Android “doesn’t sync,” really means that it “doesn’t sync with iTunes.” And given iTunes’ massive market share, Gizmodo is not alone – I’ve seen similar complaints from other press outlets and, anecdotally, many, many users.

In fact, Android sync is supported by a variety of applications. In my tests, it works with the open-source players Songbird (Mac, Windows, Linux), Banshee (Mac, Linux), Rhythmbox (Linux), Winamp (Windows), Media Monkey (Windows), and yes, even Microsoft’s own Windows Media Player. Microsoft may restrict the use of its Zune media player, but ironically its music playback software is far more open than Apple’s.

By “sync,” incidentally, I mean automatically – it’s no harder to use these applications with Google Android than Apple’s iTunes and iPhone/iPod. I personally find most of them more flexible and intuitive than iTunes. And I can show someone in a couple of minutes how to manage their device via the file system, too – even “normal people.” (I definitely don’t count as “normal,” so no argument there. But presumably “normal people” can learn to use the Mac Finder, right? Apple certainly argues they can – then locks users out of that tool when they connect an Apple mobile player.)

This is not a pro-Android argument, despite the screenshot. Any music player or phone that supports normal disk mounting will work the same way.

Why should all of this matter to musicians? The reasons monopolies are a concern in the first place has to do with pricing, and media monopolies add to that control of culture and speech. Even if your music isn’t distributed through iTunes, pricing and consumption patterns, and even the kinds of music people listen to and where they discover it are now being deeply impacted by Apple. Apple, in turn, by convincing users that there are no other options and engineering interoperability out of their products protect that control, just as digital music is growing by leaps and bounds. (For statistical evidence of the resulting trends, see today’s other story, linked below.)

I spoke to the Electronic Frontier Foundation’s Senior Staff Attorney Fred von Lohmann in April about the paper-thin (literally) arguments from Apple, when Apple was trying to prevent websites from talking about the database lock between iTunes and mobile devices:

All Apple has told us about this is in the letter they sent to us in December, as posted on the website as an exhibit to our complaint. Apple simply cites the fact that the iTunesDB page authors said that the obfuscation mechanisms used to create the iTunesDB has “may reside” in the FairPlay DRM code.

…The important thing here is that the iTunesDB pages were simply discussions about what might need to be done to reverse engineer the iTunesDB hashing. There was nothing to indicate that the efforts had succeeded. So even if understanding the iTunesDB hashing mechanism somehow magically unlocked all of FairPlay (which would seem to be far fetched), nothing on the pages suggests that the authors were anywhere near that goal.

Note that at the time, the EFF did not claim Apple lacked the right to make these kind of locks. The EFF told CDM at the time, “They have every right to do – to try to block it. Apple can certainly try to block it. What they can’t do is use inapplicable federal law to use legal threats to get them to stop.” And Apple backed off those claims.

The issue is whether you should invest in a product that limits your freedoms to use it. And the issue for musicians is whether this kind of a behavior from a company with an effective monopoly is limiting the potential power of digital music listeners in the future.

This is not to say that there aren’t reasons to choose to use an Apple device or its iTunes software. As reader “low resolution sunset” says in comments on the previous story:

This is pure conjecture: but I tend to think that slick interface design, trust, and loyalty for the Apple brand identity is what’s winning them the dominant market share of downloads.

Indeed. So, why not rely on that design, trust, and natural loyalty? Why force loyalty through engineering? And even given these qualities, isn’t there a danger when one company becomes so dominant that people don’t so much as consider alternatives? What’s to keep Apple competitive on good design if they have no competitors?

I certainly can’t answer those questions. And in the meantime, I’m looking to other alternatives, alternatives that have made me quite happy.

More on what this can actually mean:

Digital Sales Up, But is Apple Monopoly the Price? NPD, Mint Data, Editorial Analysis

Mint.com, the online financial management tool, has put its numbers together with market researchers NPD Group to analyze music spending. The results: when it comes to consuming recorded music, digital music continues to rise. At the same time, so does Apple’s grip on the music consumption market, a combination that includes proprietary control of a music store, a music player, and the leading mobile device.

The NPD data should look familiar. Digital music is growing, and clearly it’s at the root of the record industry’s loss of revenue as consumers shift from physical to digital media. Also, Apple’s iTunes remains the lion’s share of the market – enough so that they effectively control distribution, pricing, and consumption patterns, the very definition of monopoly by most measures. (That’s even before you get to Apple’s effective monopoly over the computer player and mobile device, though my suspicion is that an all-out attack on the portable device could start to chisel away at all three.)

Even in the NPD data, though, there’s an interesting indicator: note that the “Other” category is roughly the same size as Apple’s main competitors. That suggests that there’s a plurality minority. And oddly enough, it’s right in the middle of this mysterious “Other” category that a lot of unknown music artists make their dollars, selling direct to listeners or going through niche sites. Artists I’ve talked to in the electronic genre have almost universally said they make nothing on Apple, while they do very well on a site like electronic-specific Beatport. And unlike physical media, it’s not a big deal for someone who loves electronic music to drop their favorite tunes manually from the Beatport store into iTunes and an iPhone.

Dig into the Mint.com numbers, and you see just how different stores can be. Per-transaction spending differs by an enormous margin. Brick-and-mortar retailers sell a lot more per transaction. True, this could include accessories like headphones at stores like Sam Goody, but it’s also interesting to note the gap between stores like eMusic, Rhapsody, and CD Baby, and the smaller per-transaction buy at iTunes.

While Apple buyers aren’t spending as much per visit, they’re visiting more often, and Apple’s move to variable has made a big difference. Buyers have gone from purchasing an average of 2-2.5 transactions to well over 3, coinciding with the introduction of variable pricing.

If you’re not a fan of monopolies, there’s just not much to be done to spin this data. As digital consumption has grown by an order of magnitude, nothing has happened – thus far – to change Apple’s dominant share of the market. And as you can see in pricing statistics, within the Apple ecosystem, Apple has been enormously effective in controlling the pricing of the product and spending habits of the consumers.

On the other hand, looking at the inverse situation, a lot of the most interesting activity is happening outside either the former brick-and-mortar or new digital iTunes economies. We don’t have data on a lot of these niche stores (Dancetracks, Beatport, Bleep, and so on), which grow in number and variety. We don’t have data on direct-to-consumer sales by artists. And we don’t have much data on legal free music consumption, music released as Creative Commons or pay-what-you-will. Just criticizing Apple for their popularity could miss out on what’s happening in these alternative channels.

Many of these channels have no obligation to share their statistics, but to any who are interested, I’d love to talk to you. (And I think CD Baby winds up being the most interesting stat here.)

This is also an excellent illustration of what online analytics can do with financial data. It certainly won’t ease anyone who prefers that this data remain private, but fans of analytics might also see potential for collective learning experiences from shared data. Data like this had long been privileged only to banks and credit cards; a service like Mint allows users to share such data with one another.

So, how are you spending on music?

And would you find it useful – or disturbing – to have that kind of data shared anonymously with other consumers?

The iPhone’s glass touchscreen may be a thing of beauty, but despite its multi-touch capabilities, it would seem this device is incapable of responding to how hard you tap it. But the developers at Wave Machines Labs apparently didn’t want to take no for an answer.

The iGOG drum suite for iPhone provides drum pads and sample triggering in unique ways, most notably in its velocity-sensitive VelAUcity. How do you get velocity response from a device that’s supposedly not pressure-sensitive? Presumably there’s additional data in the touch events that makes this possible, but for now Wave Labs aren’t saying:

iGOG’s proprietary VelAUcity technology does the unthinkable and turns the iPhone’s screen into touch sensitive drum pads. Play loud, play soft, or play a full-blown crescendo on a crash cymbal, iGOG will capture every nuance of your performance. Just plug in your headphones and start playing.

Here’s the interesting twist: generally, when any of us say “iPhone,” what we really mean is “iPhone or iPod touch.” That’s not true in this case: “NOTE: VelAUcity is only available on iPhone devices. if you’re using an iPod Touch, VelAUcity is disabled.” That seems to suggest that the trick is the built-in mic, or at the very least some private API that’s iPhone-specific. (Audio triggering is most likely, as this app comes from a developer with drum replacement experience.) That would also suggest to me that you might be able to pull this off with non-Apple mobile devices and controllers in the future.

As a result, though, I can’t test it – I have only the iPod touch.

Unconvinced or uninterested? iGOG has some other approaches to how the small Apple handheld can be made more useful as a set of pads:

• Multi-positional pads that assign articulation based on location
• A mic trigger mode — which may be more useful than the VelAUcity. This mode assigns any nearby sound (like rapping a table) as a trigger. (That’s possible, of course, with a variety of software, but having the device itself be portable could be handy, so to speak.)
• Multi-samples, file management, and sequencing for doing more with the samples.
• No, real multi-sampling — 384 multisamples per drum!

Even if you’re skeptical of yet another iPhone app, I think there are some great ideas here for music software (mobile and otherwise). Here’s a look at the mic trigger mode in action:

Oh yes, and speaking of all this audio triggering, the same developer makes the superb Drumagog drum replacing plug-in. With pricing at US$199-379, you have to be pretty serious about drum replacement, but I know people who are who swear by it. There’s really nothing stopping you from whipping up your own solution, but Drumagog has a lot of niceties that make the process easier, quicker, and more powerful.

http://www.drumagog.com

If you are a Drumagog user, you can bring those files into iGOG. That makes this app all the more interesting – it can be both a fun toy for someone new to the idea, and a companion to a more serious (and more expensive tool).

More on iGOG:
http://www.wavemachinelabs.com/igog/

Part of the beauty of the iPhone from its launch date was the notion of a Mac you could fit in the palm of your hand. That makes it ironic that, for so many developers, mobile platforms in general have turned into a way to fragment software, to make it run fewer places instead of more. There’s something to be said for designing to a specific mobile device, but on the other hand, how many developers would want to restrict where their creations run? And particularly in music, isn’t the appeal of mobile creation the ability to have your tools work in more places? Maybe targeting just one gadget is the right choice for a given tool, but it shouldn’t be the only choice.

On the iPhone, the application Thump has plenty in common with a range of mobile music making tools. It’s simple but fun, a groove box with sequencing, subtractive synths, drums, and a set of basic effects, plus the ability to load your own samples and export songs.

Thump also demonstrates how simplifying sonic capabilities can produce musically-beautiful results, by focusing on the essentials and creating something with personality. Here’s a track by its creator showing off its sounds:
thump soundreel by mazbox

Well worth checking out the app on your platform of choice:
http://www.mrkbrz.com/thump/

What might not be immediately apparent is that under the hood, Thump makes use of the open source environment openFrameworks. As a result, the same code runs on iPhone, Mac, and Windows, as well as Linux. (It’s not distributed for Linux, but it could be. Hint, hint.) Creator Marek Bereza gives back, too – he ported the openFrameworks audio library to the iPhone, where it’s available to anyone.

Updated Marek notes in comments just what this means. The video below is, essentially, the same app. In place of the iPod screen, he has used a massive lattice of physical controls. A separate installation at the same show used a large touchscreen and simplified interface. And this really demonstrates what cross-platform means. Guy Kawasaki in the 80s mocked “ports” as a cheap wine. The idea is not to simply dump your code on a different platform and hope for the best – in fact, in this case, the changes from one platform to another were radical. The key is maximizing what’s essential, what really is not specific to a single device.

Physical Sequencer from Marek Bereza on Vimeo.

Creative Applications has a detailed write-up of the installation with more documentation.

If you’re interested in creating your own projects, oF has an elegant syntax based on Processing, but adapted to C/C++ coding paradigms and libraries.

I would recommend trying desktop development first as you’re learning, but when you do want to go mobile, setup is absurdly easy:

Setup instructions for iPhone

Having this as a foundation means more freedom for users and developers alike, the ability to run where you want, and a shared community of artists helping one another out. It does not mean sacrificing revenue, either – which is important, because revenue is often what enables (and encourages) developers to make new things. Here, we see a commercial mobile tool and distribution via the iTunes store, with free-as-in-beer distribution of desktop apps. But even the Free Software Foundation actually encourages charging for distribution – and to many people, the FSF is the most extreme example.

The bottom line is, you’re free to create what you want, where you want – and it doesn’t even have to have a price of free.

The use of openFrameworks is possible because the iPhone allows the execution of native code. Apple does not allow the Java virtual machine, which locks out many useful platforms and tools — including Processing. Naturally, that should not be the case with forthcoming non-Apple platforms based on Linux; more on that soon.

Thanks to Memo Akten for the tip — and for his exceptional documentation of iPhone openFrameworks development.

GPU-tiful and Cross-Platform

Updated Another framework I left out is the lovely libnui. The tagline says it all: “C++ API, multiplatform (Mac OS X, iPhone, Win32, Win64, Linux), 3D hardware accelerated GUI and more…”

On the iPhone, Intua’s elaborate Beatmaker software and David Wallin’s bleep!box have both been made with libnui. I want to single out bleep!box because of its UI – note how UI elements are simplified and scaled to the size of your fingertip. That’s something that, speaking of multiple platforms, could be equally important with touch hardware coming to Mac, Windows, and Linux platforms (some of it here already). I saw a huge fan of Windows tablets loving Propellerhead Reason on a tablet. He probably would be less enthused running Reason or Record on a touch interface; the UI elements are way too small.

bleep!box is also worth a look for the same reason as Thump: elegant UI, simple functions, and a lot of fun.

Pd, too

Pure Data, the open source patching cousin of Max/MSP, can also run on mobile devices. It’s currently powering the application RjDj, but because Pd is free, that could be just the beginning. In May, I wrote about the work being done by Hans-Christoph Steiner, who has been porting Pd even to ancient PDAs and iPods – including those, notably, without native floating-point capabilities (the kind of number crunching usually associated with sound).

Well, now Hans-Christoph is looking toward other, current-generation devices, too, kicking off with a workshop on making interactive sound on the iPhone using Pure Data. Here’s a taste:

OK, kids, you won’t believe how easy this is. Once you have Pure Data installed on your your iPhone or iPod-Touch, creating and uploading your own sound-processing and sound-generating patches is as trivial as copying a text file to your device! You’ll still need an Apple Developer License, but because Pd patches are treated as media files, they don’t have to go thru Apple’s elaborate code review — so, you can just dive right in, turning your phone into a pocket synth within minutes. In this 3-hour hands-on workshop, interactive sound whiz and Pure Data developer Hans-Christoph Steiner will lead you through all the steps.

Hans-Christoph will be talking Pd on the iPhone at a conference next month at Carnegie Mellon University in Pittsburgh. That will also include Memo Akten and Zach Gage talking about openFrameworks. And for nearly-entirely open source hardware, there’s a tantalizing-looking workshop combining Android with Arduino, too.

http://artandcode.ning.com/

There’s quite a lot more to say about this, but I hope this whets your appetite.

And, of course, riding the train to Pittsburgh or your nearest university or open source workshop, now you’ll have Thump which which to make some thumping tracks on your iPhone.

The novelty of the iPhone or [your favorite device here] may fade. But part of what matters in mobile design is thinking about how to create interfaces and uses that can scale to the size of your palm. That can mean embracing radical simplicity, and reducing an interactive, digital musical object down to its essential noise-making functions. In acoustic instrument design, that means economizing sound production in a form. In the digital world, it means finding the interactive role you’d want to bring with you onstage, in the length roughly equivalent your fingertips to your wrist.

I’m a few weeks overdue actually writing about it, but one design I really admire is Star6, developed by Jason Forrest and Agile Partners. There are no awkward, gimmicky emulations of hardware interfaces here; it’s clear this was an interface that was illustrated in two-dimensions. It has funky nerdster chic color combos, with neon pink atop wood grain. It demonstrates that, in the space of a grid, you can fit triangles. It makes use of computer wifi capability to easily load samples without mucking around with over-designed clients – or record right on the iPhone. And it’s – surprisingly – one of the few apps to make heavy use of the accelerometer, which means rather than looking like you’re trying to text message someone, you can move it around. There’s a “grain” mode so that you can randomize sounds and not have everything synced all the time. I also enjoy the “reset” button. These are all design decisions that could make sense in more commercial software – and our own home-brewed Max/Pd patches and such, too.

Apparently Agile Partners were also influenced by the brightly-colored, handheld fun of the Buddha Machine, too; see their interview with the creator.

Star6
A lovely lineup of free samples, including the Buddha Machine

It’s not a perfect app (no mobile app really can be – that’s the fun of it), and it doesn’t do everything, but I find Star6’s personality rather irresistible. The real test of all of this is whether you can use it in real music-making. And, while my inbox is full of cheezy bands trying to ride the iPhone wave, I love the offbeat Star6 music launch party from Berlin, as documented in the video below. It ranges from Jason’s own work to Warp Records artist Jackson and ex-Chicks on Speed Kiki Moorse. And there’s a crazy iPhone + banjo + accordion cover of Katy Perry’s “I Kissed a Girl.” There are even some genuinely experimental sounds – not the sort of thing you’d expect at a launch event, sadly. (I wish we could have more of that.)

An Evening With Star6 – Berlin (Compilation) from Star6 on Vimeo.

More on the artists, and some of Star6 creator Jason Forrest’s own unique work:

Jason’s own artistic aesthetic, as seen in this video for “War Photographer,” does have this quirky efficiency to it, the sense of cut-out animation (in both visuals and music, I’d argue), and saturated, rich, retro colors.

The eclectic Berlin launch.

Jackson (Warp, FR)
Kiki Moorse (ex-Chicks On Speed,DE)
Song Band (US)
Jason Forrest (CRD, US)
Guido Mobius (Karaoke Kalk, DE)
Ben Butler & Mousepad (SCT/DE)
DJ’s: Finkobot & Marius Reisser

Jacki Terrasse / Joseph (@ Maria)
An Der Schilling Brücke
10243 Berlin

For more on the artists:
myspace.com/moorse
myspace.com/jacksonand
myspace.com/benbutlerandmousepad
myspace.com/guidomoebius
myspace.com/jason_forrest
myspace.com/songbandmyspace
myspace.com/finckobot
myspace.com/mariusreisser

Video shot by Martin Sulzer
Photos by Marco Macrobi

Complete sets:
Ben Butler and Mousepad
Guido Mobius
Kiki Moorse
Jason Forrest

LaDiDa Demo from khush on Vimeo.

There’s no question iPhone/iPod touch development – really, just clever mobile development – has gotten a bit overhyped lately. But that’s all the more reason to do a round-up of genuinely interesting stories, real innovation happening on the platform. So, I’m clearing out my inbox with some of the more creative tools appearing recently on Apple’s mobile gadgets. There’s no better way to kick off today’s festivities than with this unusual “reverse karaoke” creation.

Sure, people may think they’re tone-deaf. But even the layperson has extraordinary powers of musical perception. So how could you train your iPhone to perceive and respond to music? That’s the question asked by LaDiDa for iPhone, the first of a new line of “intelligent” music applications for mobile devices. A “reverse karaoke” tool, the idea is to listen to singing and fake accompaniment, rather than having you sing along to canned backing tracks. Nothing is pre-programmed; everything is generated on the fly on the device.

It’ll even make up a Bollywood accompaniment to your singing:

LaDiDa Bollywood Duet from khush on Vimeo.

Of course, to me, it’s interesting not only what the iPhone is able to musically, but also what these algorithms are unable to make sound musical. Both reveal a whole lot about how we hear and conceptualize music. I think the team deserves real credit for making this fun, though, and on constrained hardware.

The app’s creator Khush follows in the footsteps of Smule in that it takes hard-core academic music research and uses mobile devices as a vessel for getting that tech in the hands (literally) of the general public. (See my interview with Smule founder and ChucK originator Dr. Ge Wang.)

Parag Chordia, developed at professor at the Georgia Institute of Technology and the gentleman you see in the video, spoke to CDM about what’s happening behind the scenes. He tells us about how this application was developed, and how the intelligent algorithms work (or at least try to work, as music analysis and auto-accompaniment remain at early stages).

First, an explanation of the app.

Khush CEO Prerna Gupta explains how it works:

1. You sing into the phone, and LaDiDa will compose music to match.
2. LaDiDa’s patent-pending technology analyzes the pitch and structure of the melody to compose a unique accompaniment for each recording.
3. To be clear, we do not query a database of pre-recorded songs. That is, LaDiDa has been designed to work with any music.
4. After recording your song, you can hear it with different styles. LaDiDa comes with three styles — E Piano Pop, Rhythm Synth Pop and Dub Tone — each of which has been developed using high-quality instrumentation to work specifically with our algorithm.
5. We will be launching new styles every month that will be made available through in-app purchases.
6. LaDiDa also works on rap! This month we’ll be adding three new rap styles.
7. After choosing your style, you can save the song and share it on Facebook, Twitter and email.
8. LaDiDa also has a Discover page, where you can hear songs recorded by other users from all over the world.
9. Khush was founded by music technology enthusiasts from the Georgia Tech Music Intelligence Lab. You can read about us here and also find out more about the research at our lab here.
10. LaDiDa went live in the iTunes store last week and is currently priced at $0.99.

Prena, the woman you see in the video, has some Web experience to boot, too, including founding a popular Indian dating site. Oh, and she’s a better singer than the music researcher, but, hey, that’s why we all went into computer music, right?

In case you’re wondering how you take a research idea and make it run on the iPhone – or how the algorithm works (and might get smarter in the future) – I turned to Parag for those details:

The initial code was developed in my lab in c++. Since the core algorithms are basically mathematical, that portion was relatively easy to port. However, we spent significant time thinking about how to optimize for the iphone and every aspect of the app, from the interface to sound design, has been built with the iphone in mind. For example, there are significant limits on sampler performance — samples have to be short and effects are more or less out — but we thought it was important for our styles to have a rich sound. So we
put great effort into designing light styles that sound realistic.

Another significant challenge was making the analysis robust to external noise; iphone recordings are lo-fi and corrupted with tons of background noises, which makes robust (and again computationally efficient) pitch detection essential.

Our approach to reverse karaoke is somewhat different than what’s been done before. A significant limitation of previous work was a lack of fine-grained key estimation, a problem that we felt was critical to successful vocal accompaniment (most people are not anywhere near a piano or an instrument with fixed tuning when singing into the app).

We also worked on trying to give some larger structure to the
accompaniment, which can often sound locally reasonable but notably lacking in direction. Again, a difficult problem particularly when people are singing snippets. Still it is sometimes possible to detect phrases, and we have tried to incorporate that information as well.

Auto-accompaniment is an endlessly fascinating and deep problem. As we learn more about human perception and cognition of music, as well as improve our tools for machine listening, our systems will become more musical. While we still have a ways to go, we believe that, with LaDiDa, we’ve created a product that is engaging and allows regular people to express themselves creatively.

If all of this talk about musical perception recalls the questions about how culture and background versus neurology can be used to explain music – as seen at the Notes & Neurons conference – that’s no coincidence. Researcher Parag played sarod with a fascinating ensemble at that same conference. Bobby McFerrin sings a really beautiful solo with the ensemble.

In fact, it’s absolutely worth contrasting the elegance and beauty of these all-human musical responses to the somewhat clumsy (sorry, Khush) iPhone responses. That’s not to say the iPhone creation is any less human – it’s a computation model programmed by humans, and is capable of some impressive feats made possible by their musical instincts and training. As such, we really can hear the gap between what advanced musicians can do intuitively and what we can model computationally, atop the restrictions of the device’s ability to sense the world around it.

World Science Festival 2009: Notes & Neurons, Part 5 of 5 from World Science Festival on Vimeo.

Code, hardware, and software: Hack Days are all about getting actual stuff made. Berliners, the Music Hack Day that took place in London at The Guardian now gets underway in Berlin this weekend. For anyone who thought the first event was overly Web-centric, there are some new players in Berlin. Ableton is a sponsor, and Ableton, Native Instruments, and RjDj are all presenting hack sessions (in addition to the more Web-focused / consumer-focused 7digital, Songkick, Cloudspeakers, Mufin, SoundCloud, and Echonest). The awesome German musician magazine DE:BUG is also in on the action. I also see our friends at Future Audio Workshop (developers of Circle) in the lineup.

Check out the details:
http://berlin.musichackday.org/
Weekend schedule

So, German readers, who’s going? I’d love to have some spies tell us what the discussions are with NI and Ableton.

I’m, as always, interested in how we can get past geography and share work internationally. So if you’re doing a project, be sure to take lots of pictures, screen caps, code pastes, and the like, and we’ll feature your work here on CDM.

Future events are planned for other cities, and I hope CDM will be involved in some of them. Boston will be the first US event, but it’s on a date I can’t make it. Anyone have a space here in New York you’d like to suggest?

Smule, the iPhone/iPod touch development house that has released an Ocarina and a Leaf Trombone to the iPhone, has now partnered with T-Pain and Auto-Tune to bring a T-Pain-branded app to the mobile platform. I interviewed Ge Wang earlier; he gets exceptional music geek cred for the creation of the real-time synthesis language ChucK.

But this app goes further. It isn’t just called Auto-Tune for iPhone, or T-Pain Presents Auto-Tune by Smule or something like that. It actually promises to turn you into T-Pain, sort of like the toys that make you sound like Darth Vader. And that means it has exactly one application – one essential application, I’d say. It means you can do amazing covers of “I’m on a Boat.”

Something has jumped a shark here, but I’m not sure which. Maybe it jumped over the shark onto the boat.

Two more serious observations:

One, this theoretically could be a useful addition to your mobile arsenal. Mike Una uses Auto-Tune to map the continuously-varying pitch of his “Beep-It” optical Theremin to a scale. Of course, the problem is that the iPhone lacks an audio input jack, though maybe someone has an idea for how to solve that.

Two, a question: just when, exactly, will we get basic audio DSP coding on a platform that’s not the iPhone? Sony’s PSP is arguably more powerful, but requires you to take your game system into a back alley to modify it to run homebrewed software. Google’s Android has more powerful hardware in the pipeline, at least, but there’s still not really official support for running native audio code (even though that’s how the phone’s own audio system was built). People are starting to simply say “iPhone app” when what they mean is “mobile app,” and that’s a shame.

Rounding up my catch-up-on-iPod/iPhone-stories, here’s one from the developer perspective – one that could face music creation developers on the entire platform.

The Apple iTunes App Store now faces the risk of becoming a victim of its own success. Music applications could be a big part of that, without some adjustments on Apple’s part. The problem is this: incoming music “fan” apps could flood out the music production apps that had enriched the mobile software platform since its debut. I think the need could be really urgent. Consider that part of the appeal of Apple’s mobile platform – yes, even in stark contrast to the Google Android on which I’ve been developing myself – is its spectacular real-time audio tools. Combine that with a disproportionately large number of Mac-using musicians, lots of ingenious apps build on Apple’s Core Audio platform, and we’ve seen a mobile platform with an extraordinary number of tools for music creation.

The problem now is that that unique set of powerful apps could get overwhelmed by essentially unrelated “music” apps. A developer who has asked to remain anonymous is already campaigning for a change. He does a good job of explaining the issue, and what might need to happen to fix it. If you’re a developer, you can add your support and feedback to the idea.

Here’s the full explanation:

Hi Peter,
I am writing you with this email I have been sending other developers on the Apple App Store. Although you probably cannot go visit the apple developer connection website because you dont have a membership, I thought you should be informed about the discussion brewing there. Here it is:

Recently the Music section of the App store has gotten very busy with a new type of app, lets call them Artist Apps or Fan Apps. Some of these Apps are great resources for fans and artists reaching out to their fans and potential fans, and some don’t live up to their potential.

However, they are joining a category that previously moved a lot slower, as the apps that had been populating this category were apps with a lot of development put into them and therefore sold at a higher tier usually- but were released at a slower pace. A look at the top 100 paid music apps illustrates this nicely.

Customers perusing the music section to catch that next great sound generating tool (for example), could check in on the new releases section perhaps once a week or even once a month and have the opportunity to check out all the great new apps that had been released, without worrying that one was missed.

Now however, these newer Artist apps have flooded this category, and great apps are getting lost in the shuffle. On one day last week, there were 21 pages of Artist or Fan apps, with a few “other” apps strewn in the mix here and there, very hard to pick out of the jumble.

I understand that this may be happening in other categories for other reasons, but I only concentrate on the Music section since I am a music producer and music App writer.

I propose that we all get together to come up with some suggested sub-category names for the music category. I will start the list off and hopefully some of you will chime in and give suggestions for other categories or add more definition to a sub-category that is alredy here.

Once enough input is received, I will compile it into one bug report for Apple. i will then post the bug# for everyone to include with any correspondance with Apple on this issue.

New sub-categories for the Music section of the App store.

Music Creation:
Synthesizers, drum machines, sound generators, scoring and notation, sequencers, DJ apps, recorders (multi track)

Music Utilities:
Lyrics apps, iPod interfaces, visualizers, iPod controllers, song recognizers, concert finders,

Learning:
Metronomes, guitar and voice tuners, music slow downers, guitar tutors, chord apps,

Artist Apps/Fan Apps:
iLike apps, Deadmou5 app, PVD App, Underworld App, NIN, etc.

Radio Tuners:

AOL Radio, Pandora, Last.fm, individual radio stations

Please visit the Apple iPhone developer forums and voice your opinion/support!

https://devforums.apple.com/message/107989#107989

Definitely voice your thoughts to Apple, but I’d love to hear what you think here on CDM, too (especially since I know some folks at Apple do read this site).

So, you’ve seen lots of interesting looking iPhone apps, but most of them strike you as gimmicky. Others have interesting workflows, but limit you to working on the mobile device, not switching back to a computer. And maybe you’re perfectly happy with a phone running Windows Mobile or Palm OS.

Enter SunVox. This is not a mobile music making app for the timid. It’s a powerful suite of soundmakers and sequencers, baked together into a modular environment that lets power users tweak to their heart’s delight. It’s small, it’s fast, and it looks – and sounds – a lot like early computer music programs. It’ll run on iPhone now, but also on Palm, Windows Mobile, Mac, Windows, and Linux. It’ll run on your netbook, your MacBook, and your ThinkPad.

Incredibly, all this goodness is yours on all those platforms for ten bucks and on iPhone for $5, easily making SunVox the biggest steal in music software I think I’ve ever seen:

• Flexible architecture that adapts to slow and fast CPUs
• Synths and generators: FM, virtual analog, FFT-based “SpectraVoice”, Kicker
• Effects: Delay, distortion, filters, LFOs, reverb
• Sampler with WAV support
• WAV export when you’re done

http://warmplace.ru/soft/sunvox/

And for fans of computer music in the 90s, it’s a chance to get back to some of the no-nonsense, powerful creation of that era, without some of the distractions you may find in modern apps.

To see SunVox in action (and start to make sense of how to use it), check out the YouTube videos from Alex Zolotov (among others). They’re not the best video quality (I wish we had iPhone screencasting software, darnit), but they will give you a sense of what the app is about:
http://www.youtube.com/user/NightRadio2007

The videos made their debut on the excellent PalmSounds Google Group:
http://groups.google.com/group/palmsounds?hl=en
CDM isn’t exclusively about mobile apps, so check out PalmSounds the blog, too, if you like your music making handheld – the site has been on fire lately with updates.
http://the-palm-sound.blogspot.com/

Here’s an example of how SunVox can be used for live playing:

Here it is being used to produce lovely FM synthesis noises:

If you’re new to trackers, especially, you’ll want to brush up on the tracker workflow in SunVox: