Consumption, or creation?

When it comes to notation and musical scores, the iPad (and tablets, generally) has fallen on the side of reading rather than writing, display rather than creation.

Notion for iPad, a mobile version of the desktop notation software, looks poised to change all of that. See video, above, for an overview of the features. Highlights:

• Entry, editing, and playback for notation and guitar tab
• Built-in samples, including keys, guitar and bass, and the London Symphony Orchestra as recorded at Abbey Road Studios
• Enter notes by tapping a keyboard or 24-fret fretboard, or select and drag and drop
• Mixer and effects
• Orchestra and guitar articulations and marks
• Text/lyrics support
• Import MIDI, MusicXML, GuitarPro, and export to PDF, MusicXML, and MIDI
• Look for guitar tab, MIDI, and MusicXML right inside the app – this could be a huge feature

There are also in-app purchases of instruments and effects and so on.

It’s a big deal, I think, and a huge release. Even if you use software other than Notion on desktop, I can see this as – at last – a way for people comfortable with notation to sketch ideas and enter MIDI and scores from a music stand. I look forward to testing it. (Anyone know of any other candidates in this category? Since Sibelius focused on score reading, Notion seems to be the first major release of this kind for a tablet.)

Thanks to everyone who sent this in.

http://www.notionmusic.com/products/notionipad.html

By the way, what’s up with the lines at the end of the video?

You Honor Tradition!
You Defy Genre!
You The Create Future! [sic]

You have come to fight as free men, and free men you are. What would you do without freedom? Will you fight?

They may take our lives, but they will never take our freedom!

(Sorry, I may have broken into the speech from Braveheart there. It could be the London Symphony Orchestra music. Alba gu bra!)

Since today is Beethoven’s 241st birthday, it seems only appropriate to inject a little conventional notation into today’s coverage. And what better way to do that than with an iPad app that promises some musician-friendly reading features.

We’ve already looked a couple of times at Avid’s Sibelius-powered Scorch iPad reader, which features nice output and score integration, and recently added PDF support.

Scorecerer has some unique features – aside from, augh, a somewhat unpronounceable name. It goes further in page turn control, MIDI integration, and DAW integration (through MIDI program changes). A desktop version aids in scanned score management.

And it has two potentially killer features: one is the ability to manage converting your conventional notation to PDF, and the other is – at last – proper markup.

Run-down of features:

• Markup: highlight or add handwritten notes (why every app doesn’t include this, standard, I have no idea – it’s a deal-breaker without it.) See the video for more.
• Meet your MIDI page turner: Load songs, change pages, from any MIDI instrument – or send page turns from a DAW’s sequence playback (via a program change message) for automated page turns.
• Total page layout control: Arrange pages in an arbitrary sequence, so, for instance, repeats and DS al Coda sections simply repeat in front of you instead of requiring you to go back.
• Desktop PDF conversion: Scan images or import PDFs, straighten out crooked scans, remove borders, create lead sheets, all in a batch-conversion desktop management tool.
• Desktop Pro software: Add on this US$39.95 desktop companion, and you additionally get to publish scanned or imported music as a set of images, PDF, Kindle DX, or MusicPad Pro. (The free iPad edition only exports to the iPad.) You can also batch convert a stack of music – like an entire fake book – by splitting it into PDFs.

The emphasis on scanning and importing PDFs is a concession to the likely reality of iPad notation users. Simply put, you’re probably not going to use an iPad for notation unless you can make it useful with all the scores you’ve already got. Now, some of this batch processing I imagine could make publishers very nervous about piracy. But I still imagine that – as we saw with the combination of digital downloads and ripped CDs, only with yet-more-expansive collections – we’ll see a bit of each. (Selling scores online I still think will be a big market for publishers.)

But I just keep coming back to this: you have to have markup. And I look forward to watching tablet apps in general work to provide features that make them more usable to musicians.

More on the app:
http://www.deskew.com/

There’s a free, “Lite” version that you can try out first.

The full version is US$9.95.

Scorcerer @ iTunes App Store

Back before the iPad (perhaps deservedly) hogged the spotlight, there were interactive tables. And one of the selling points of these new interfaces was collaborative play. Unlike the solo experience of using a computer, you’d gather around a display surface – just as you would a dining room table – and share the device. You’d play together.

The iPad is much smaller, but in a way, that lends a certain charm, cramming hands around its little surface. (Anyone play Hungry, Hungry Hippos?)

Tapping fingers on that shared surface, you have an experience that, while perhaps less finely-tuned than using the iPad one-on-one, you actually get to have with other human beings

And so that reason alone gives Rockmate special mention. I hear mainstream journalists ask questions like “is this the way people will play music in the future?” That’s, of course, roughly as intelligent as someone looking at Pong and saying, “well, I guess that about does it for Wimbledon, huh?” But it’s the awkwardness of playing a virtual band that makes this look like fun, like something families and friends might use. It could also be fun to play after a little too much NAMM. And the developers have lavished functionality on it (see specs below). They’ve also got an intro price of $1, or about one quarter per person. Have at it. I think it looks like brilliant fun.

It’s a set of sampled instrument for four players on a single device, with:

Realtime looper
Smart metronome
Mixer with level and pan controls
Realtime Fx (distortion, multiFX, powerchord)
Chords progression customizable
Create your own chords
Save your styles (Chords progression, FX, Drum, keyboard style…)
Export: .wav or .aac
Sharing: iTunes sharing folder and Email.
Airplay

The chord feature brings back fond memories of home organs for me. From the developers of the excellent DM1 drum machine.

On iTunes:

Rockmate @ iTunes Music Store

Official site: http://www.fingerlab.net/website/Fingerlab/Rockmate.html

Graphics are good. Graphics are shiny. But when it comes to reality-bending, emotionally-immersive, perception-shifting power, look to sound and music.

At least that’s the feeling you could get after playing Dimensions. Following their reactive music tools and Inception dream states for iOS, RjDj have turned their mind-altering sonics to gameplay. As with previous releases, these tools are powered by the open source visual development environment Pure Data. Pd engineering wizardry here meetings the compositional and sound design prowess of Hans Zimmer.

You can see a bit of how the musical world works in the teaser video above, and the music sound design video below.

But we wanted quite a lot more information. So, CDM got RjDJ’s Rob, Joe, and Martin to share some detailed thoughts on how the game experience is put together and how it works.

The App

RjDj Team: Most games require your full attention when you play them. You either live your life or play the game. Dimensions is different. It’s designed to be played in parallel with your normal life.

Gameplay is intertwined deeply into your daily life. Some dimensions unlock if you are physically active and others unlock if you are quiet. The app automatically detects what you are doing and syncs the game to it making use of every possible sensor on the iPhone.

You stay immersed in the game by listening to augmented sound and the voice of Emily from Mission Control. She guides you through many exciting challenges like collecting Artifacts and avoiding the dreaded Nephilim.

With Dimensions we are very interested in creating a gameplay experience which is between the device based focus of a casual game and the passive use of listening to music. Its a game which you play by listening – a game that place in parallel to your everyday life.

The Tech: Reading Files

We built our own version of readsf, rj_readsf, in order to be able to read compressed audio and make the samples available for processing in Pd. One advantage of readsf is that possibly lengthy audio assets do not need to be loaded into memory. If memory is limited, especially when Pd may be running in the background, limiting exposure to system memory warnings helps keep the app running and the music playing. Given that compressed audio is roughly ten times smaller in size than uncompressed audio, and that audio assets make up the majority of the size of the entire app, it is a huge benefit to be able to deliver and read compressed audio assets directly, without the need to decompress in memory or onto disk. Dimensions requires that several dozen such players be open and viable at any time, and special consideration was given to concurrent behaviour. rj_readsf can loop a file when it gets to the end, and it indicates with a bang when a file has been loaded (an asynchronous operation) or the end as been reached (in the non-looping case). rj_readsf is built on iOS standard APIs and can read any file format that iOS can.

Ed.: I’m waiting to hear if rj_readsf will be open-sourced. The issue of reading files is one we’ve had around libpd recently. While their rj_readsf sounds great, my sense is the best long-term solution will be a similar object that is independent of the APIs of any one OS, so this same set of problems may need a different solution for the open source community more generally. (Building such a tool is absolutely possible, though it might require more effort.)

The Music, and How the Music Plays with You

The music of Dimensions uses various different techniques from straight sample playback to audio analysis and synthesis:

Realtime manipulation of audio input from the mic:

This is perhaps the most recognisable technique we use. We process audio from the iPhone microphone live in many different ways. It’s kinda like a feeling of being inside the music.

The key thing we do with effects is attempting to analyse the environment of the player / listener and then making appropriate things happen within the effect. For instance, the Flux Dimension features a filterbank on the mic input. We analyse the incoming audio from the players environment and make the filter frequencies change as events occur ( either due to pitch changes or onsets ) this gives the impression that objects and activity around the player is somehow “playing” the music.

In the Ghost Dimension there is an effect which records audio whenever it detects an event, then scrubs repeatedly forwards and backwards through the sample using granular techniques stretching it out in time. This manipulation accentuates the textural and pitch based qualities of the sample as it repeats and works well with the atmospheric music Hans Zimmer composed.

Dynamically-controlled stems:

All the Dimensions use stems and hits from a conventional sequencer in some way, re-arranged live on the device relative to how the player is interacting. These stems were mainly composed in Cubase and Logic.

For example, in the Kinetic Dimension we feed accelerometer data from the device into Pd and drive the music from that. The player hears more energetic beats when they go for a run, but if they stop at the lights to cross the road, the drums immediately drop away. This was achieved with a large number of hits with all the rhythmic sequencing happening in a hybrid reactive / generative way live on the device.

In the Tranquil Dimension, the music introduces more stems the longer the player is quiet. If they make too much noise the music “shrinks away” from them and becomes quieter. If they stay in a Zen like peaceful state, the music grows into a kind of crescendo of serenity.

Reactive synthesis:

We often control parts of the music by doing a frequency analysis of incoming microphone audio from the device and then using those frequencies to determine the notes synths will play within the music. The Travelling Dream in Inception the App uses this extensively. Tranquil Dimension in Dimensions also uses onset and frequency changes to trigger synth melodies in the music.

The synths we use range in complexity from very simple additive synthesis to some great synth patches from the rjlib by Frank Barknecht and Andy Farnell.

Generative approaches:

There are some sections within Dimensions which are generative. These play back prepared samples as well as triggering onboard synthesis. They also feed the results of this through various live sampling and glitching patches. They are governed by various sets of rules which have various long term parameters, like adjusting to the intensity of the audio environment of the listener, or how dense areas of music have been around the present time.

Sample triggering:

Ghost Dimension uses a simple but effective technique of triggering samples from the music on onsets in the environment. This can cause some real jump out of your skin moments. We combined this section with a randomised very short delay on the mic which acts almost like a resonator, turning the mic sounds into creepy atonal pitched noises.

Sound Design

The main hub section in Dimensions, called the Launch screen, acts as a entry point to your augmented adventures. It also displays all available Dimensions via the floating tile icons.

Visually, these represent a snapshot of your previous experience using your location at that time. Sonically we wanted them to have an aura or energy from the Dimensions themselves.

SoundCloud examples:
Dimensions Sound Design Example by rjdjme

Example of using mixture of synthesis and samples to create user feedback when interacting with Dimension icons in the game.

Map Tile Down: several recordings of a synth in Pure Data that is played when the tiles are touched. Each one is slightly different due using two detuned oscillators.

Map Tile Open Only: a sample from Logic Pro for the woosh sound when showing the information view.

Map Tile Click: a sample from Logic Pro for touch events.

Map Tile Open: recording of how it sounds when put together.

Sound is a mixture of samples and real-time synthesis. The energy sound is made using two oscillators (one detuned) to create some modulation for a glowing effect. Added to some harmonics to make it more of a beam sound and some chorus and reverb. The open tile is made in logic, when closed it’s the same sound but reversed and pitched down in Pd.

We wanted the tiles you tap on to feel like each Dimension has some sort of energy radiating out.

Here’s a sense of how the sound design works in the game:

It’s an ambitious app, and the whole cost is US$2.99. I guarantee it’ll change your world more than a latte. (Well … unless we’re talking a really crazy latte. And that might not be legal.) As sometimes-CDM contributor Jaymis Loveday notes, there are terrific choices in coloring Google Maps, and how modes change based on ambient sound and motion.

Requires an iPhone 3GS or better, or third-generation iPod Touch or better, or an iPad.

Dimensions @ iTunes Store

More reading:
Dimensions Augments Reality Purely Through Sound [Leigh Alexander, one of my favorite game writers, for Gamasutra
The Roundabout Tapes – RjDj now plans to game reality with sound [TCTV] [Techcrunch EU]

Instruments like the Theremin may be trying to shake off their association with fear, dread, and the unnatural. But the synthesizer has no such concern: after all, the Moog is pretty much a rock star, literally. So, for anyone fiddling around with the Animoog – hopefully including iPad owners who are newer to synthesis – you can now grab a bunch of presets to provide the perfect sonic accompaniment to this Halloween. The sounds are the work of synthesist/sound designers Drew Neumann and Kevin Lamb.

And as if the app, currently on sale for $.99, weren’t already a steal for people who already have the iPad, the presets are free. Just move quickly: the price jumps to US$29.99 on November 18.

An email registration is required.
Halloween Sound Set Download
Animoog product page

Of course, what would also be a lot of fun would be some sort of proximity sensor for your app, for use at a party… okay, we have a few hours left if anyone can wire up the Arduino hardware link on Android or the camera on the iPhone or the motion sensor or … something. Go!

Got other Halloweeny news for us? Let us know!

Installation instructions from Moog (by popular demand):

1. Download the Halloween Sound Set and un-zip the file.
2. Connect your iPad (with Animoog installed) to your computer.
3. Launch iTunes and select the iPad in the devices list.
4. Select the “Apps” tab for the iPad.
5. Scroll down to “Animoog File Sharing,” and click “Add.”
6. Select all the files in the Animoog Halloween folder you just un-zipped.
7. Launch Animoog and select “Import Presets” from the settings tab.

That also demonstrates how you could share other presets.

NodeBeat is the kind of experimental music application that’s thriving in the age of the multi-touch tablet. Its dynamic interface and sound are built on the foundation of free and open source software tools regularly covered here on CDMusic and Motion. OpenFrameworks, the Processing-like C++ library, handles the UI, as libpd, the embeddable version of graphical media environment Pure Data, manages the sound.

What you get is an open-ended plane on which you can graphically array sequences, far away from the standard grid, for generative and sequenced music. It’s good fun, which made it a hit on iOS. Developer Seth Sandler, working with Justin Windle, did a brilliant job. Then, earlier this month, NodeBeat made the jump to Android, with additional porting work by Laurence Muller. Android has been getting tablets that can hold their own — I’ve enjoyed my Samsung Galaxy Tab 10.1, for instance. But the platform has remained severely starved of applications in contrast to iOS, but at least in place of quantity, there’s some quality: this application being one, tools like Mikrosonic’s RD3 or Reactable orControl or Nanoloop qualifying, too. (I’m not delusional; this does not make it at this point any serious competition for iOS, but it does demonstrate potential for developers. And I’ve already had the chance to use Reactable and Control in live performance, personally.)

That is, NodeBeat was temporarily available on Google’s Android Market. Then, without warning, Google suspended developer Seth Sandler’s seller account. This led to an extended discussion with Seth, other developers, and myself as we watched events unfold, ironically on Google’s own Google+. (Yes, that Google product works, despite what you’ve heard.)

It’s back now, so please, go buy and review it if you get the chance. If you’ve got a compatible Android, you’ve got truly no excuse as it’s a delightful app, and it holds up even in the crowded iOS platform:
NodeBeat @ Android Market
http://nodebeat.com/ (iOS and all versions; there’s even a free, desktop version with source code!)

Okay? Bought it? Good. Now it’s time to talk about how bad this is for a developer.

The account suspension on the Market represents a series of obvious flaws. First, of course, it shouldn’t have happened in the first place – Google support eventually acknowledged the suspension was entirely random, “incorrectly suspended” in the words of support, with no other explanation.

Second, support was largely nonexistent. Days passed during which Seth was left without any information. (Amidst discussions of how “evil” or “open” Google is, I’d sometimes be happy just to see them seem something other than desperately rushed. And that seems to be the primary “Apple-fication” of the market – the company’s rivals now are so rushed to try to compete that they screw things up constantly. “Don’t be crappy.”)

Third, and most bizarre, the application stayed available but payment was impossible, leaving customers confused and unable to buy the app.

Now, horror stories like this weren’t unheard of in the early days of the Apple App Store, and I still hear – with, happily, much less frequency – complaints from developers about Apple’s store and approval process. Apple deserves credit for ironing out those flaws, but from the skeptical perspective of a developer, It’s hard not to draw the conclusion that you may want to consider distributing your software via more than one means. Even as Apple fails to allow that on their mobile devices, that means considering going cross-platform. That’s not a philosophical claim; from the perspective of a developer, you don’t want to be dependent on only one company. Feel free to disagree, but my experience has shown otherwise as I’ve watched developers get burned. (And it’s worth noting that while Google couldn’t sell Seth’s app, Apple could.) Technically, via Android, developers are free on the vast majority of devices to sell direct or sell via alternative stores; unsurprisingly, Seth submitted his app to the competing Amazon App Store and is awaiting approval there.

None of this, of course, excuses Google from a big customer failure on Android Market. And whereas Apple’s earlier hiccups occurred as it was the only game in town, Google is making an uphill battle even worse. With Amazon’s Fire on the horizon, there are two questions to watch: one, can Amazon deliver enough tablets to create the tablet market Android has thus far lacked, and two, will their store deliver a better experience? Meanwhile, Google continues to promise a better Market; it’s all I hear about at developer events, largely because it’s the primary complaint from developers. As tech pundits make largely-unsupported claims like “Android users don’t like to buy software,” as if they’re a bunch of degenerate freeloaders, I’d point to the often-inferior Market and frustrating hardware experiences.

But, let’s put it this way: in addition to the obvious range of iOS choice, yes, there are superb applications beginning to appear on Android. For that, I credit developers like Seth and his collaborators. Even as we push for better audio performance, some of those applications are already running exceptionally well on new tablets and higher-end phones. If you have one of these devices, you can fire these up and enjoy making some sounds. And because you can’t always rely on another vendor to get things right, having cross-platform, free and open source tools behind these applications means developers have the flexibility to adapt to a changing market, and to focus on creative design and not constantly reinventing the wheel.

Here are some notes on NodeBeat’s creation on our forums.

And let us know what you think of NodeBeat, or if you do have an Android device you’re using for music (or a Fire on pre-order, for that matter).

Sometimes, images and video can say far more than words, and it’s best to stand back rather than ramble on. (Cough, ahem.)

From Björk this year has come two visions of how to make new instruments. The Biophilia software for iOS is an interactive rendition of the album. As apps, you have the curious separation of tracks into individual application icons, available as separate purchases or a bundle. But the effect is one we’ve traced for a while: the music becomes non-linear and interactive, blurring the line between recording as reproduction and dynamic instruments that can transform what you hear. Most notably, it also comes, via an update, with MIDI as observed by Synthtopia. MIDI allows you to then radically transform the output of what you get, and I agree that this is probably the first “album with MIDI output.” (The deeper question: are other sequencers in some sense someone else’s musical/compositional creation?)

In the Gameleste gamelan-celeste hybrid, you also have MIDI, here controlling an otherwise entirely acoustic instrument. (Create Acoustic Music!) Starting with a conventional celeste, the original instrument was “hacked” with hand-built bronze bars made by UK cymbalsmith Matt Nolan, then constructed into the finished instrument with MIDI by Icelandic organ builder Björgvin Tòmasson.

Videos via Shocklee.com.

The videos themselves to me represent the spectrum of possible choice in instrument design on a whole number of levels – MIDI even being one fascinating such level.

Biophilia software [iTunes link]

Excellent reading –
Extended behind-the-scenes look at the release with Damian Taylor at Sonic Scoop

With soft synths a dime a dozen, how do you set yourself apart? Defying conventions is a pretty good start, and a team of developers who built the Mixxx open source DJ tool are doing just that.

SodaSynth from Oscillicious is a soft synth with a different approach. With no effects and, surprisingly, no filters, SodaSynth is all about the oscillators. But apart from its ready-to-layer sound, the developers are also making their software run in new places: aside from a VST, there’s a version for HP’s defunct TouchPad and, more interestingly, the first major soft synth we’ve seen yet for Google Chrome’s Native Client. We’ve got some details on the latter that will appeal to you hardcore Web browser / coder geeks out there.

First, the sound: with no filters and no effects, SodaSynth’s developers say they’ve made a synth that’s easy to layer. You get five waveforms, up to 32 oscillators per note, and full 8 note polyphony. (Per-note oscillators to me is where things get interesting.) The controls are pretty stunningly simple, but with five “classic” waveforms and some unique morphing settings.

Also, for those new to synthesis – and for some of those more unusual parameter names new to all of us – they’ve added extensive in-line online support, in a nice touch. (More in the gallery/sounds below.)

I’m in. Mac and Windows VST, and should run fine on Linux machines with Windows VST support. US$23.

SodaSynth VST

Here’s what it sounds like:

SodaSynth VST Demo 1 by Oscillicious

And there’s an HP Touchpad version, which you’ll find for $3 in the HP App Catalog. Notable in that it may soon join our Doomed Tablet Instruments Hall of Fame. (Our friend Francis Preve had an instrument out for the Newton. Really.) Seriously, if anyone has a TouchPad, send us video, ‘kay?

But more practically…

You can run SodaSynth right in Google’s Chrome Browser. We’ve seen plenty of synths and even full-blown workstations employing Adobe’s Flash. And there have been some projects built in JavaScript for Mozilla’s Audio Data API, previously called the Web Audio API (which I liked better as a moniker). Tons of examples via the Chromium site; Chrome and now an experimental Safari build have added support:

Web Audio API Samples

Soda Synth uses a third avenue, one which I’ve heard lots of people talk about but no one actually try. Google’s Native Client allows you to run native code right in the browser – not this JavaScript kids today love so much, but good, old fashioned, C/C++.

What does that mean for synths? Think low-latency live audio that out-performs other solutions, at least for now. SodaSynth isn’t just the first NC synth in the Chrome Web Store; according to the developers, it’s the first Native Client app, period. (Answer to the question “who cares whether you use native code ever again?” is, of course, “audio people.” I’m sure JavaScript advocates will be happy to chime in here, but even if JavaScript matches C/C++ performance, the ability to run C DSP code natively will continue to have advantages down the road.)

It’s free, so add it to Chrome now, and you get a synth you can jam with – there’s even a 4-bar live looper so you could produce actual sound snippets with the thing. I’m curious to hear your experience.

SodaSynth, free for Chrome Web Store

Developing in Native – Why it Matters, What it’s Like

I’m all about getting the nitty-gritty details – yes, including not only why this is exciting, but what the development process is like, warts and all.

Developer Albert writes:

Why is this news? It’s native compiled C++ code running our synthesizer in a browser at full speed, for the first time. While there’s some other pro-audio web apps like AudioTool, nothing can really get the latency low and run efficiently without native code. We think this might be a peek into a future where we there’s real pro-audio web apps.

I asked Albert specifically what challenges, if any, they’d encountered. Albert tells CDM that NaCl (get it?) still has some rough edges and needs further testing, and significantly isn’t enabled by default for some users. He did qualify that by noting NaCl’s developers have been generally helpful.

The Pepper Audio API that NaCl implements is pretty similar to SDL and performance seems to be good. The three big advantages of using NaCl over Adobe Flash for this sort of thing are raw performance, being able to directly set the audio latency, and that most audio apps are already written in C/C++, so they’re easier to port. Being able to just upload your binary to “deploy” it instead of building Windows/Mac/Linux versions is a huge time saver too.

Currently, I’m only hosting binaries for x86 and x86_64 because the Native Client doesn’t actually work on ChromeOS yet. One of the main
NaCl developers mentions this [2], though perhaps that’s been miscommunicated by Chrome’s marketing team, because I too thought it
was supposed to work.

The next milestone for the Native Client team is to implement “Portable Native Client”, or PNaCl [1], which will mean that NaCl apps will get distributed as “LLVM bitcode” instead of compiled architecture-dependent binaries. In other words, you will compile your application once, and it should run on x86, x86_64, and ARM. I think Google is waiting for this before pushing NaCl into ChromeOS.

“Early days” seems to be the key phrase here, but I’m eager to see Google put some resources behind this and turn this into a solid solution, especially on their nascent Chrome OS. (Too bad, as I was looking forward to seeing someone fire this up on a ChromeBook.)

For further reading, via Albert:

[1] The gory details about the proposed PNaCl plan
[2] Chrome/NaCl engineer at Google saying it doesn’t work in ChromeOS

More Images + Sounds

A song without and with effects, using Renoise:

SodaSynth VST Demo 2 (Dry – No Effects) by Oscillicious

SodaSynth VST Demo 2 (Wet – With Effects) by Oscillicious

The VST version:

Image of the ill-fated HP tablet version:

http://www.oscillicious.com/

Sonaur is a US$1.99 ambient toy for Android mobile devices, with on-screen creatures you can manipulate to generate sound. It’s notable not only for being a fun toy – and on a platform that hasn’t had as many fun toys – but because the tools used to create it are also highly accessible and free.

I’ve taught Processing, a code environment popular among artists and designers to people who never before imagined they could be coders. Pd (Pure Data), here in the form of libpd, is a free graphical patching cousin of Max/MSP. You can check out libpd, which allows Pd to run on Android, at our Pd Everywhere group.

Developer Miles describes the app thusly:

I wanted to create an app that lay somewhere between an ecosystem and a musical instrument. The hope is that sonaur requires less attention both, and still provides a reasonable amount of intrigue.

Sonaur contains three distinct lifeforms. You can interact with them individually, or together; creating new sounds and visual patterns for your enjoyment.

I was also curious if he had advice for people exploring this area.

Miles tells us that he found making both the art and sound generative – rather than pre-drawn and pre-recorded – made a big difference. He also suggests reading Andy Farnell’s book Designing Sound (now on MIT Press) as a way of learning both Pd and sound design, saying it “helped me a lot to create the sound of the flying insects.” Another tip: using vectors and not hard-coded pixel values makes your work adaptable to different devices. And, “Matt Pearson’s book Generative Art talks a lot about this but I’ve found too that randomness is great in controlled amounts.” I couldn’t agree more.

It’s really great work, Miles. And by the way, readers should never be ashamed of plugging their work, individual or group, free or for-sale. We love hearing about it, even if we can’t cover it all.

Find this at:
http://app.net/sonaur

Via discussion on Noisepages.

Also on Creative Applications Network, run by our friend Filip, which covers all sorts of these kinds of creations.

You’ve heard all the complaints about laptops onstage. But since there are many arguments for a laptop, why not put all that powerful hardware to use, and make your Mac laptop part of a musically-expressive performance?

Track Master, a Mac-only application available on the Mac App Store (and one of the few serious music offerings we’ve seen there), is a great place to start. It transforms the built-in, multitouch-capable trackpad on recent MacBooks, MacBook Pros, and MacBook Airs into a MIDI controller.

The trackpads on those are actually impressively sensitive and accurate, tracking as many as eleven fingers at once. (So, uh, you can use all of your fingers and invite a friend’s index finger. Or play it by yourself, if you’re the guy who killed Inigo Montoya’s father.)

I’ve been playing with Track Master all morning (uh, yeah, sorry about the blog posts coming late), and it works brilliantly. With mappings to X/Y or scales, you can assign it to any number of instruments and effects. There’s an added bonus, too: by taking over your trackpad for musical use, you don’t risk bumping your trackpad, which makes the QWERTY keyboard more useful as a controller live, too.

If you still want to hide away your laptop, you can also make use of the larger Magic Trackpad hardware.

Full feature list:

Notes Mode

• Play in any key
• Can play with up to 11 fingers
• Chromatic or other scales for easy input
• Key latching, simply press escape while touching the trackpad Ed.: Yeah — that’s important! Keeps it on when you need it. I turned off the option to use “click” for the same feature to avoid accidentally disabling the feature.

X-Y Mode

• Tracks X, Y and finger on off for each number of fingers
• Has assignable control for up to three fingers
• MIDI learn functionality built in to make assigning controls a snap

Interface

• Shows exactly where your fingers are on your trackpad
• Displays which notes are active based on where your presses are

Also, due kudos to Apple: this kind of functionality is exactly the sort of thing an intelligent operating system should provide. Now, can you just please stop breaking plug-in validation, so we’ll love you forever?

Here’s an easy review: if you’ve got a (supported) Mac, get this. Period. US$4.99 well spent.

Track Master at the Mac App Store