By the 1990s, the notion that computer software could be a means of delivering interactive digital art more personally was enjoying a Renaissance. This was the age of the Voyager CD-ROM, which catered to new multimedia PCs and Macs with titles from the likes of Laurie Anderson and Morton Subotnick, the decade in which Brian Eno released Generative Music as software and Monolake – before Ableton – included a Max/MSP patch with an album. But the reach of these experiments was doomed to be relatively limited.

Now, of course, things are different. First, we saw some widely-available audiovisual toys, coinciding in particular with the debut of the iTunes App Store. But now, those fairly one-dimensional experiments are beginning to blossom into something else. When these particular gadgets and app stores are forgotten, the question is whether those aesthetic adventures, the personalization of the digital art experience, will endure.

Joshue Ott, co-creator of Thicket for iOS, points to a review of that application on Apple’s App Store. “I always want to touch the masterpieces in museums,” a user says in that review. “I’ll use Thicket instead of getting arrested!”

“It’s the democratization of our own performance works,” muses Ott. “It’s a way people can play along with us,” he says. “We’re constantly creating processes to create sound and music; it’s what we’ve done for ten years or so,” chimes in Ott’s creative partner, Morgan Packard. “Now people can own the processes, not just the results.”

Ott and creative partner Packard have long each been visual and music performers, respectively. That meant what it has traditionally meant: the artist gets up in front of an audience, the real work hidden behind an onstage laptop. With Thicket, by contrast, the raw materials of that performance became embodied in the software itself, and thus in the hands of the audience, who can double as performer. At first, this software included only a simple mode or two, each with a specific sound, musical ambience, and visual look. Even in those versions, Thicket made some appearances in an occasional gallery show or performance – the app you download could also be the art.

As Thicket has added modes, though, it has evolved in a kind of platform of its own. Ott and Packard produce new works that can be distributed as in-app purchases (more on how they contend with that in a bit). The sum total of those modes has created a massive audiovisual playground, a compendium of ideas and aesthetic.

A new version released this week adds three new modes, seen in the video at top here, building atop modes added in late December. For the first time, you can use Thicket on an iPhone and not just an iPad; it’s a Universal app. Screenshot sharing is available, too. But the addition of all these modes, unveiled with a “reboot” of the app at the end of last year, represents a shift in thinking as these artists and developers reevaluated what it was they were doing.

“We found that the modes were becoming so different, so much deeper,” says Ott:

We were having such fun using it as a big sketchbook that we decided to ditch the ‘rotate to change modes’ system so that we could handle lots of modes, rather than just four or five. The modes in Thicket reboot are completely new, and each one is a lot more complex than the older modes. They’re all very different, and each have separate methodologies behind how you control them. We’re playing with different concepts in user interaction design, searching for the right intuitive feel to make a true audiovisual instrument (among quite a few other things).

In other words, if you haven’t played with Thicket lately, it’s a different animal. It’s a Long Play album to the first version’s single cut. The work is immersive, too; you can transmit video output via HDMI or VGA on the iPad, and get up to 1920×1200 HD output, with no menu intervening. (One of the many significant current drawbacks of Android for the moment for artists: the move to a soft menu on Android tablets means menu detritus that never goes away. Artists were intensely relieved this week when Apple’s new iPad kept its signature, dedicated hardware menu button.)

Morgan Packard says he has some strong feelings about why this kind of experience has value in his work:

I’d say where we both overlap is our shared interest in how abstract sound and picture, plus interactivity, all can work together. Thicket is a bit of a research sketchbook for us. There’s something very magical about just twiddling your fingers and having sound and visuals spring to life. Frankly, we don’t entirely understand this medium yet. But we like not knowing, trying to understand it in different ways.

The gestural thing is huge with us, and is at the core of what thicket is. It’s partly why I’m a bit resistant to the idea of layering features on to Thicket. Of all the different people who give us feedback, I get the most gratification from parents of special needs kids.The non-fiddly, large-motor interaction style is very accessible to a huge range of minds and hands. I want to explore this more, to give people new ways of feeling expressive and creative with movement and gesture. In my mind, that’s what’s really special about what we’re doing.

The duo did get a chance to try the app with people with different user needs. Ott explains:

Morgan and I actually toured a special needs school earlier this year and observed autistic kids using Thicket. A very special music teacher is using Thicket (among a couple of other technologies) to teach the kids music, and had found that it seemed to really empower them. He offered to let us visit and we happily agreed… really really amazing experience.

As Subotnick hoped years ago in “All My Hummingbirds Have Alibis” for Voyager, the distribution of art as software can create a new kind of “chamber” art, in which the work is personal, enjoyed by a few people. It can be a family or a couple of friends on a couch.

Of course, somewhere in all of this, these artists are looking for revenue in order to be able to devote the massive amounts of development and testing time the application demands. (Neither has quit day jobs, which means finding a way to devote resources to development.) Thicket easily climbed in download counts, but only after the application was made free. In-app purchases have been a tough mountain to climb, but have at least allowed some revenue to trickle in; the challenge was finding a way to make them appealing to users, says Ott:

I think in general people hate In-App Purchasing (IAP), because, in general, I think IAP is usually not handled so well. We have thought a lot about how to show people exactly what they are buying before they buy it, and I’m really pleased with what we’ve come up with. Every mode in the new Thicket has a pre-recorded “demo” of one of us playing the mode. Before you buy a mode you can watch this demo, learn what the mode can do, watch someone use it in an interesting way, and decide if that’s something you’re interested in or not. You can of course watch the demos even after you’ve purchased the mode (and the free Sinemorph mode also includes a demo as well). The demos are a great way for us to show users different tricks and techniques.

So the reboot is really about making Thicket a platform rather than just a single art piece. Something that we can keep adding to (with a financial structure that makes sense for us to keep adding to). Something that we can start collaborating with other artists on – we are talking to a couple of different people about releasing modes within the Thicket system. So yeah, that’s what the platform part is. We’re really excited about it, and what it will become in the future.

But these concerns aside, the developers aren’t just creating Thicket for users; they’re building something they use themselves. As Josh explains:

I’ve performed with Thicket now a couple of times, once at the excellent SONiC festival, and another at Issue Project Room in a program curated by Ryan Lott (AKA Son Lux), and have started to really feel like it has the potential to be a new form of audiovisual instrument. I want to see more stuff like it- things that generate graphics and audio intertwined, and I want to continue to explore these relationships in different ways. I’m actually pretty excited about performing with Thicket more, and I think doing so will push it even further in that direction.

“That’s really what an audiovisual instrument is to me,” says Ott. “It’s something that you can bang on and make something interesting, but you can touch it subtly, as well, to shape it, to express with it. That’s what I want to make. We’re right at the beginning of that exploration, and I think we have something that is a promising vehicle for it.”

You can try out the new Thicket now, as seen in CDM Apps:

Thicket @ CDM Apps
[Says iPad, is actually now Universal. PS - music and beauty flow from my fingers all the time - no app needed - but I'm glad now the rest of you get the chance.]

Pure Data (Pd) is already a free, convenient tool for making synths, effects, and sequencers and other musical generators. But imagine stripping away all the things that tie it to a platform – UI, specific hardware support – so it will run just about anywhere, on anything, in any context.

That’s what libpd, a free, embeddable, open source (BSD) tool for making interactive music, does. Coders can take their favorite language and their favorite platform, and just plug in the power of Pd. They don’t even have to know almost anything about Pd – they can let an intrepid Pd patcher create the interactive sound effects and dynamic music for their game and just drop a patch into their assets.

One of the most powerful applications for this is the ability to add interactive music and sound to mobile apps, on iOS and Android, without writing and testing a bunch of custom DSP code. And that has enabled the use of libpd in apps as successful as Inception: The App. With music by Hans Zimmer and a custom “dream” experience created by RjDj, that app racked up millions of downloads in under a couple of months, and then, far from sitting idle on the app launch screen, went on to clock in over a century of user “dreamtime.”

Okay, so, you’re sold. You want to see what this thing can do, and maybe try it out, and you’re wondering where to start. So, here’s some good news: there’s a new site and a new book to get you going.

The site: libpd.cc

libpd has a new home on the Web, both in the form of a new GitHub repository to organize all the code and docs and samples, and a site that brings together a showcase of what the apps does and points you to where to learn more. The single destination is now hosted here by CDM:

http://libpd.cc

I built that site, so please, if there’s anything you’d like to see or you’ve got your own work created with libpd, let me know about it.

Even just having selected a few key highlights of apps built with libpd, it’s impressive what people are already doing with this tool:

libpd Showcase

The book, and a chat with its author

A new book published by O’Reilly focuses on building mobile apps using libpd, for iOS and Android. (iPhone, iPod touch, Android phones and tablets, and yes, even that “new iPad” introduced yesterday are therefore all fair game.)

You can read a section of the book right here on CDM, for a taste of what’s in store:
How to Make a Music App for iOS, Free, with libpd: Exclusive Book Excerpt

It’s an exceptional, comprehensive look at development using libpd, covering iOS and Android, but also a complete look at the libpd API and how to use it. For Pd patchers just getting started with iOS and Android, it includes all of the basics of how to use libpd in your mobile development environment. For mobile developers new to Pd and patching, it makes clear how you’d communicate with Pd, so you can either dive into Pd yourself or properly interface with patches made by musicians, composers, and sound designers with whom you may be collaborating. It’s an ideal title for anyone interested in taking a game and giving it a more dynamic soundtrack – in sound effects, music or both – or for people building mobile musical instruments and effects, sonic toys, interactive albums, or, really, anything at all that involves sound or music. Since it walks you through the entire development experience, you can sit down with it in the course of a few evenings, and get a complete picture of how to integrate Pd with your development workflow.

Dr. Peter Brinkmann, the principal developer of libpd, is the author of the title. I asked Peter to explain a little bit about the book, who it’s for (hint: you!), and what’s in it (hint: stuff you want to read!) …

CDM: How did this book come about? And the book process really helped drive improvements to libpd, too?

Peter B.: Shawn Wallace, an editor at O’Reilly, contacted me last summer and asked whether I would be interested in writing a short book on libpd. I was interested, and so I talked to my [Google] manager (“No conflict — we all have time-consuming hobbies!”) as well as a couple of colleagues who had written books for O’Reilly. They made a token attempt to dissuade me, but it was clear that they had enjoyed writing their books, and they seemed quite proud of the result, too.

Once I had made up my mind to write a book, the next question was whether to self-publish or go with O’Reilly. Self-publishing is a viable option these days, but then I decided that I really wanted an animal on the cover. Besides, I had never written a book before, and having the support of O’Reilly’s editorial staff made the prospect seem less daunting.

The first draft was done in mid-November, but at that time it was basically science fiction because it presented libpd the way I wanted it to be, not the way it was at the time.

So, after the bulk of the writing was done, libpd needed to be revised so that it would actually be in agreement with the book. In particular, Rich Eakin and I rewrote the iOS components for better performance and usability. That delayed the book by a month or so, which turned out to be a great stroke of luck because that was when I discovered that Xcode 4.2 had changed the entire development model by introducing automatic reference counting, instantly rendering existing
texts obsolete. That included my chapter on iOS, and so I had to sit down and rewrite it.

After that, the rest happened rather quickly — getting reviews, revising the draft, going through the production process. O’Reilly’s toolchain is remarkably efficient, using asciidoc and docbook in a Subversion repository. The editorial staff is great, too. I’m amazed to see how quickly it all came together.

How did you approach writing the book?

For the first draft, I just imagined that I was teaching a class on libpd. When you’re lecturing in front of an audience, you don’t have time to polish every sentence; you just have to talk and maintain some sense of momentum. That approach helps a lot when facing a blank page. After that, it’s many, many rounds of revisions to eliminate weak or redundant sentences.

For the sample code, I picked one project that uses all major components of libpd. That provided a natural progression from idea to completion, while touching on all important points in their proper context. I’m basically providing running commentary on my thought process when making an app, including common mistakes and pitfalls. Like this, readers will know how to recognize and work around most problems.

Another trick is to write more than necessary. The first draft contained a lot of gratuitous editorializing. Those parts were never meant to make it into the finished text, but they were fun to write and they kept me going when I wasn’t quite sure what to write next.

Who it’s for?

The book explains how to patch for libpd, and how to write apps with libpd, with special emphasis on the interface between Pd patches and application code. It’s for mobile developers who want to add real-time audio synthesis to their projects, as well as sound designers who want to deploy their work on mobile devices. It’s light on prerequisites; if you know how to write a basic app for Android or iOS, you’re ready to read the book.

Ed.: I’d add to that, given that there are such great tutorials on app development for Android and iOS – even many of them free, including some very worthwhile documentation from Google and Apple — if you’ve messed with Pd, you should give the book a try. And if you haven’t messed with Pd, this could be a great excuse. This book won’t teach you Pd, but it’ll make very clear how to glue everything together. -PK

Why does a book like this matter? What do you hope will come out of it?

I hope that the book will help popularize real-time procedural audio, in games and other apps. I’m thrilled to see all the projects that use libpd, and I hope that the book will help people create even more awesomeness of this kind. One thing I only fully realized when writing the book is that libpd lets developers use DSP code like a media file: An audio developer creates a Pd patch, and the app developer just drops it into the resources of the app and loads and
triggers it as needed. I guess this was implicit in a blog post I wrote on workflow and prototyping a year ago, but I think the DSP-as-media angle is even more powerful. I hope that the book will bring this out.

The book project has already improved libpd. Whenever I faced the choice between fixing an awkward bit of code or explaining the awkwardness in the book, I chose to fix the code. That took care of all the little things that were sort of bothering me but didn’t seem significant enough to spend time on. It also gave us a deadline for a number of related things that we wanted to do, such as migrating to GitHub and launching the new website, libpd.cc. Ed.: Cough. Yes, glad that gave me that deadline – and thanks to Peter B. for the extra push! -PK

Congrats to Peter on his first animal-on-a-cover! It’s really a great book: you read it, and feel like making more new things, inventing new creations that produce sound and music. And that’s a very good thing.

There was a time when the ability to record and playback music didn’t exist – such things were magical fiction no one had seen. So, the idea of playing one channel of recorded sound, then two channels, had to be invented. Artists hadn’t created something called an “album” until there were devices that played back that monophonic and stereophonic sound; even the idea that such a strange art counted as “music” had to be constructed. It’s obvious now, but it’s easy to forget that these musical forms were produced to cater to the capabilities of what was once a new device.

Now that your music device can do more than play a couple of channels of sound, will musicians find use in those features? Or are they just distractions? Can the fact that your music player knows where you are be as important as the fact that it can play audio?

We saw the work of Bluebrain, the Washington, DC-based duo of Hays Holladay & Ryan Holladay, before. They’ve been slowly building up a repertoire of locative art, starting with the Mall in DC. Their first full-length album came to Central Park, as documented beautifully in a short film that details the creation of the music and software, and various critics responding to its significance.

The most compelling image recurring in the film may be their scrawled-upon map of the city itself. It’s clear in those images that composition and place converge: the map itself becomes a score for the music, a topography of interaction through the landmark park.

One of those people interviewed in the film, briefly, is me. You’ll see some of the answers from the interviewees don’t entirely agree with others. Rather than focus on the novelty of the thing, I chose to look at their work as rooted in history. It’s not entirely clear whether the musical card game attributed to Mozart was his work, but various aleatoric and algorithmic approaches to composition pre-date even recording, let alone GPS. That to me gives a context and a continuity to these kinds of activities.

But beyond the meaning of “disruptive” technology as one person puts it, what the film conveys most is the artists’ love of where they are. They’re not making an album that’s an app, they hasten to add. They really just want you to hear this music in this particular place, moving in these particular ways. The fact that they record an organ that is part of where they grew up is added evidence.

If you’re going to South by Southwest, you can experience this application when you’re in Austin, as covered in an article on The Creators’ Project. You should do it if you’re there, especially as you otherwise can’t hear this music without going to the National Mall or New York’s Central Park.

Choose-Your-Own-Adventure App Album Debuts At SXSW

In a way, though, that seems to me the least interesting of these applications. Perhaps I’m biased in that I have a connection in my life to Manhattan and not so much to downtown Austin. But to me, the arguably-perverse requirement that you go to a place in order to hear a work seems part of the joy of these creations. Having it switch on in a place already full of iPhone-toting Web geeks deeply in love with GPS seems to take out the fun and the challenge. It comes to its audience; the other works demand an audience come to it.

What the duo succeeded in doing in New York and DC – even though these places are landmarks – is making the ever-present software somehow more ephemeral. It works in one place, and then it’s gone. Like the generative limited edition we saw last month, it undercuts the very ubiquity that seems to be digital music’s fundamental character.

And yes, greetings, New York and New Yorkers; I love where I am, but I do miss you. Unlike in software, in the real world, we can’t be more than one place at once. We have to be alive, and we have to do what we’re doing now. We are where we are, and we’re not somewhere else. If you aren’t there when someone plays, you miss it. You have to choose.

And perhaps that’s what is sometimes missing in our music and technology.

Previously:
An Album That Can Be Heard Only in One Location, in Interactive Ode to Washington, D.C.

More:
Bluebrain’s Music, locative and non-locative alike

A free app download for iOS, for use in Austin, TX

Listen in Central Park

I love reviews. One person writes on the iTunes App Store about the Central Park app, “Weirdest music we have ever heard. Creepy, eerie noise.” You can’t please everyone.

I’m also quoted in a story in The New York Times from December:
Central Park, the Soundtrack

I believe I did the interview from Amsterdam (ironically, the old one), and apparently said:

“It’s not just that they are using this as a novel delivery mechanism. It’s part of their musical process. They are forcing you to go to a place because that place for them is musically meaningful.”

One perhaps unexpected impact of technology has been to change the way we think about ourselves and our experience. Recording equipment – from photography to phonograph – has given us a new sense that memory itself might be fixed, unchanging, an accurate record of an unmoving truth.

Except, of course, neither the recorded object nor the thing it is recording ever quite seems to work out that way. (Ask your local theoretical physicist, or for a more localized, humanized, sociological view, any loved one.)

UNRAVEL is an installation that uses just those sorts of technologies to construct a narrative, and push and tug at that narrative. And if you don’t like it, well, that’ll impact the video, too. (Just complain via Twitter, and you’ll make the narrator “increasingly insecure.” As a blogger, I can relate.)

Combining record playback, a robotic band contributing incidental music, and a set of interactive dials, the installation recounts a story with mechanically-reproduced soundtrack, as the audience adjusts what happens. It’s all clear in the extended video:

More information:

UNRAVEL opens to the public on 20 April – 7 May as part of Glasgow International Festival of Visual Art at Arch 24/ SWG3.

UNRAVEL is a collection of devices making up a gallery-based, reactive sound installation, through which the audience will attempt to unravel the truth about The Narrator’s life by playing records from his collection.

When we tell the story of a memory, how much of it is true and how much is shaped by who we are talking to? Once we’ve told the story many times, how do we even know what is true any more – what is constructed and what actually happened?

The installation is the work of Edinburgh based arts collective / experimental pop band FOUND, whose members include Ziggy Campbell, Simon Kirby and Tommy Perman and Glasgow-based author and musician, Aidan Moffat best known as one half of the band Arab Strap. FOUND and Aidan Moffat are signed to Glasgow record label Chemikal Underground.

At the heart of the installation is a vinyl record player and ten 7” records of familiar singles from pop music’s heyday. Visitors to the gallery are encouraged to select a record from the collection to be played. As soon as they drop the needle on to the record the installation springs to life. The vinyl controls a series of acoustic, self-playing musical instruments positioned throughout the gallery which soundtrack the story as the narrator recounts a memory he associates with that record. Each 7” record represents a different memory, but unlike conventional vinyl recordings they sound different each time they are played.

Just as a real narrator alters the way they tell a story depending on their mood, audience and context, the memories embodied in the installation will distort, evolve and warp depending on external influences: the time of day, the size of #UNRAVEL’s audience, the local weather, and what people are writing about the installation on twitter from moment to moment.

A year in the making, #UNRAVEL is the first collaboration between FOUND and Aidan Moffat and represents a major new body of work for both. The project required Aidan to write 10 short stories with multiple variations of each, to be soundtracked by a total of 160 new musical compositions by FOUND.

With Investment from Creative Scotland’s Vital Spark programme and New Media Scotland‘s Alt-w Fund with the support of the Centre for Design Informatics, Glasgow International Festival of Visual Art, SWG3 and the University of Edinburgh.

Funny side note: I recall some evenings out drinking with Scottish people that also questioned the boundaries of what is real and not real and the imperfection of memory, though more in a performative, real-time sense than in an interactive installation. (I was a willing and active participant, so I’ll not hold this experience against the fine countrymen and women of Scotland. Indeed, I hope to toast with these chaps next time I’m in Glasgow. I, of course, do not condone such behavior, and you will find that by contrast, this particular interactive installation has no ill health effects that I know of.)

For something completely different, here’s a beautiful set of instrument robotic solos incorporating acoustic instruments, plants, and bamboo:

A composition for plants, yangqin, bamboo robot and robotic chimes, Three Pieces is designed as a collaboration between robots, traditional instruments, and living things, housed in Victorian Palm House of the Royal Botanic Garden in Edinburgh. A traditional Chinese dulcimer is played by a robot with many bamboo fingers while the surrounding foliage hides an ensemble of robotic chimes. Despite being separate individuals, the robots communicate and perform together. The robot performers are conducted by all the living things in the Palm House. The moisture content of the soil changes slowly as the plants absorb water, while on a much faster timescale, the temperature changes in the building as animals, including humans, move about. The installation detects this living presence in the Palm House and the music changes accordingly. The robots react to humans, but their mood alters with the plants. For more info visit… foundcollective.com

Previously:

Plant-Reactive Robots Play Bamboo, Chinese Instruments at Royal Botanic Garden, Scotland

Reconceived Acoustic Music on an Interactive Table: Etiquette in Edinburgh

Sometimes, to quote Depeche Mode, words are very unnecessary. Instead, lose yourself for a few minutes in the vibrating mathemagical lands of numbercult, audiovisual immersions in which sound and geometry fuse in a strange, abstract dance.

Their most recent creation, found via Richard Devine’s prolific Facebook wall and posted earlier this summer, explores an actual audiovisual sequencer. See it at top:

Connected is a graphical/musical sequencer system. a three way flow of information, between graphics, sound and external triggers shape the composition. Recorded in real-time.

But actual functioning interfaces aside, I’ll leave you with some other video clips that traverse similar territory, these syncing up separate visual and audio systems.

These folks make music, too – have a listen to their album, at bottom. And that shifts to body candy, as in, for your butt, with danceable grooves.

All three of the above videos combine vvvv – the Windows-only, graphical patching environment for powerful 3D effects – with Ableton Live for sound.

But lest you think it’s all abstraction, have a listen to their excellent dance release on Bandcamp. Downloading:

http://www.numbercult.com/

By the way, ever wondered what visual software people are using? So did we. Don’t miss this look on our sister site, Create Digital Motion, including where vvvv fits on the spectrum:
What Visual Software Readers Use: Some Clear Favorites, Plenty of Diversity, in Census Results

In a responsive, real-time sculpture, the simple sonic qualities of a rainstick become electronically enhanced. Rainlith, a “kinetic sound art” work by Rui Gato, makes the rainstick itself robotic, its sounds transformed in space in a way that is itself sculptural. Responding to movement in the space using Microsoft’s Kinect, the apparatus is a geektastic brew of just about every tool you could imagine involved in this sort of construction.

The artist shares full details, reproduced here in both English and Portugese – and Rui, thanks for sending this in:

Rainlith 2 – Kinectic sound art piece.

On Rainlith, the primitive naturally granular sound of a big rainstick gets explored in real-time by cyber-age sound manipulation tools.
It’s an interactive piece in witch the movement of the audience’s body activates an electric motor, making a reflex movement on the structure that embraces the instrument.
The sound of the rainstick is captured and processed in realtime, and sent 24 meters above, filling the empty space of a old industrial cereal container. The reverberated acoustic mix is then received back by the audience in the spot right below the opening of the container.

Na peça Rainlith o som primitivo, naturalmente granular, de um pau de chuva é explorado por ferramentas modernas de sound design, em tempo real.
É uma peça interactiva em que o movimento do corpo do público activa um motor eléctrico, provocando um movimento reflexo na estrutura que sustenta o instrumento.
O som captado em tempo real é processado e enviado 24 metros acima, enchendo o espaço de um silo de cereais industrial. A mistura acústica reverberada é absorvida pelo visitante no local imediatamente abaixo da abertura do silo.

hardware:

microsoft kinect
arduino duemilanove
H-bridge (hand made)
24v 6A DC motor
CPU
zoom H4N
FM emitter / receiver
ion ipa3 portable speaker

software:

MAX/MSP
Max for Live
OSCeleton
OpenNI
Nite
toxiclibs

agradecimentos especiais:

Nicola Henriques
Susana Luiz
Luís Pereira
Paulo Carocinho
André Sier
Daniel Coimbra
Ruben Santos

By the way, if you’re intrigued by the potential of Kinect, be sure to read sister site Create Digital Motion for more. Just today, we have news of a new version of EyesWeb that could be relevant to musical use:
EyesWeb, Powerful Computer Vision Software for Windows, Adds Kinect Support, Fixes, More

“You had to be there.” Live performance has always been dictated by being present in a particular place, at a particular time. Now, the same is true of an interactive album produced by brothers Hays and Ryan Holladay, aka Bluebrain.

Both a two-man band and a two-man development team, there’s no clear dividing line between “coder” and “musician” for the artists on this project. But the only way to hear the work is to physically go to Washington, D.C.’s National Mall, and begin walking around. The satellites that populate the GPS received in your smartphone, currently on iOS but with an Android release planned, realize the work. You, and your device, then, participate in a kind of performance. The album is the first of a series; New York’s Flushing Meadows, site of a World’s Fair and a failed Olympics bid, is next.

The Washington Post‘s Chris Richards talk with the two artists; I’m quoted as the story pans back to look at music technology in general:
Bluebrain make magic with the world’s first location aware album [Washington Post]

It’s well worth a full read, as the artists describe some of their intentions, and claim they’re uninterested in this as technological gimmick. Richards also explains the experience of hearing the work, since not all of us can go to DC:

Approach that crazy-looking thing while listening to “The National Mall,” and you’ll hear a keyboard weep. Get closer and digital cellos begin to trace a regal melody. Closer. There’s percussion. Keep going. The volume creeps up. The drums push toward anarchy. Walk right up to the monument, press your hand against the cool, smooth stone and listen, as if the obelisk were a giant radio needle receiving some riotous transmission from deep space.

At one point when Richards interviewed me for the story, he asked me point blank whether technology’s greater impact has been on distribution or production. Caught off guard – it’s a question so fundamental I hadn’t really thought to choose – I found myself choosing production. After all, while distribution has been profound, the advent of recording, not the advent of the computer, is the fundamental breakthrough. But with computer music software, the ability to re-imagine what music actually is has taken the grandest leap since the gramophone.

Ironically, though, Bluebrain are taking the same approach to conventional recording technology as they are the new smartphone – they’re intervening to ensure music is limited and local. A “surprise” record release earlier this year not only went straight-to-vinyl (see previous editorial here), but required that you go to an actual store in the DC area.

In vinyl, the approach is an intentional throwback. In digital, it suggests a new way of making music for a space with a device as the medium rather than live performance.

There have certainly been locative digital works before this one, but I couldn’t think of one that was introduced as an album in this way. Then again, if the idea is worthwhile, it may prove worth repeating.

Follow Bluebrain’s work via their blog and site (and you may have to literally follow it, geographically):
http://bluebrainmusic.blogspot.com/
http://bluebra.in/

And do point us to other examples of locative work – including anything that might challenge their claim of being first, at least for our historical benefit.

From the blog:

Samantha Kalman
I’m most thrilled about the new audio features. Big things like fx filters and reverb zones to add atmosphere to your audio are awesome, but little things like reliable synching of multiple playing sources is completely wonderful. Combined with spectrum analysis you can do things like procedurally modify colors, meshes, lighting, or anything else based on audio playback. As someone who wants to make synaesthesia-invoking music games, I am so happy that these features made it into 3.0.

Nicolaj Schweitz
I love the new audio features, especially the possibility to use audio to affect any runtime variable. I can’t wait to see what people get out of this.

The mod tracker file support might start a new epoch in music for games — or should I say a revival of the demo scene trackers.

Unity 3 – What Feature is The Dev Team Most Proud Of? [Unity blog]

Thanks to Zyler Vega for the tip!

From Unity’s site, a description of the “Audio Magic” coming in version 3:

Unity 3 brings Reverb Zones, filters, tracker file support and a bunch of other goodies to the table. We’re also introducing editable falloff curves for all major audio parameters, so you get complete control over your sound ambience.

More on the upgrade at Create Digital Motion.

Dreaming of a future in which music, instead of just being rendered audio files, arrives in fully generative, interactive form? Albums might “listen” to the world around you, and listeners could record their own alternate versions of music and share with others.

RjDj, the generative mobile music platform for Apple devices, realizes that future right now, instead of at some nebulous time in the future. In addition to the iPhone, you can make use of a second-generation iPod to use it. (You’ll need a headset with a mic; I have one by Griffin I’m testing.) And the RjDj folks have a whole bevy of significant updates to share:

• Free downloads (limited time): All three RjDj releases are available now for free. That includes the RjDj app itself (from which you can now grab and share releases), as well as RjDj Album (with a selection of generative/interactive/reactive releases) and the new RjDj shake.
• Download “scenes”: From the beginning, we knew that RjDj was imagined as a platform for other people to release interactive music. Now you can download scenes for free or fee. (Paid scenes currently redirect to the browser, but with iPhone SDK 3.0, you’ll be able to buy right from the app.)
• Share recordings: Because RjDj-generated music is controlled by the user and often records from the environment, the music may sound different each time. You can now share recordings with others from the device and the new social site.
• RjDj.me community: The RjDj folks have built a little community where you can share your favorite scenes and upload recordings, and keep track of scenes coming out from other artists.

By the way, with all of these releases, I know there’s some confusion. RjDj is the main app — the platform from which you’ll be able to grab scenes in the future. RjDj Album is a collection of “player”-style RjDj scenes — ones we have seen released previously. RjDj Shake is a newer, accelerometer-powered set of scenes. It comes with the amusing admonition that you should “PLEASE TAKE CARE, DON’T HURT ANYONE AND DON’T SMASH YOUR DEVICE.” If you missed Shake before, it now also has the recording sharing features. But the main RjDj app is the big release going forward.

We’re also awaiting news on more “sprints,” community-driven development efforts for making new scenes. And if you’re a fan of this sort of thing, RjDj isn’t the only game in town. RjDj itself is powered on Pure Data, the open source patching cousin of Max/MSP. Pd is making its way to other mobile devices; I even have it working on the BUG Labs gadget. At the same time, I’m curious to see if the RjDj gang can succeed in building a platform for lots of people doing this sort of work.

Regardless of how you look at it, more mobile generative / responsive music is most definitely in your future. Stay tuned.

Elsewhere:
Free trip into the rainbow vein: reality-enhancing iPhone app RjDj free with social update [Boing Boing Offworld]

RjDj.me community site
RjDj 0.7 out now [RjDj News]

RjDj [iTunes]
RjDj Album [iTunes]
RjDj Shake [iTunes]

Be sure to see our previous interview with the creators:
Exclusive RjDj Interview: Interactive Music Listening, Everywhere You Go

Also, expect more iPod/iPhone news and hands-on’s soon — I’m way behind, but let’s assume that means the best stuff will rise to the top.

Some people were trying to install RjDj on their Ipod touch, which does not work because we currently only support the iPhone (we are working on an iPod touch 2g version too….) Others tried to use RjDj without headset microphone. In theory that should work but only in theory. Ask Paul who spent countless nights on the audio driver how much he cursed over the Apple SDK…

A few people also reported one nasty problem that really twisted the mind of Paul and Guenter: RjDj crashed right after launch. We are working on this but are still trying to find a way to reproduce this error. If it happens to you, read the bug report and send us an email.

Incidentally, as a 1g iPod touch owner, I’m still looking into that; it comes down to homebrew mic support. Now that Apple has lifted their NDA, I hope developers can start to sort some of these odder driver issues.