One is a keytar. One is a master controller with touch faders and real MIDI and — control voltage, for working with analog gear. Seriously. The keyboard controller market may have faded into a dull, gray blur of nearly-identical models, but under the Alesis and Akai monikers, there’s some fresh-looking variety. Love it or hate it, these are not the same keyboards you’ll get from anybody else at the moment.

I got to meet with Alesis/Akai/Numark today at the NAMM Press Preview, get my hands on a prototype of their new Vortex keytar, and talk about what they’re doing. And I have to say, I’m impressed. (I didn’t get hands on the second model, the MAX49, but will visit their booth in the next couple of days.) Finally, we get the return of the MIDI DIN port for working with a wider range of hardware, without sacrificing USB. One model even does CV for analog equipment. And both can supply their own power so you can use them with iOS. And they at least are interesting enough to have an opinion about them – even if you hate them.

Here’s a look at each of them and what why they’ll be on our radar when they ship later this year.

Alesis Vortex Keytar

First off, let me say it, once and for all: I don’t think there’s anything dorky about a keytar, other than the name. Us keyboardists are plenty capable of being dorky on our own, but don’t blame the instrument.

What keytars are – or strap-on keyboards, if you can say that without smirking – is eminently practical for one-handed playing. For two-handed playing or more conventional piano or organ parts, of course, you’re better off without them. But the keytar lets you move around, play expressive solos, and also free up your hands if you’re using other machines, as in electronic music. Unfortunately, the options out there have been overly large, making them too unweildly for many people to play, and overly expensive, pricing them out of a lot of their market. I’ve played and advocated the Rock Band game controller because it’s lightweight, inexpensive, and nicely made, and it even has a MIDI jack. I actually hear one Harmonix veteran is now at Alesis, so that may be no coincidence. (The Vortex even has a touch strip on its neck.)

The Vortex, though, looks like the first really balanced keytar controller in the market … well, ever. Features:

• MIDI DIN and USB MIDI
• Velocity-sensitive pads in addition to the keys
• 37 velocity-sensitive keys (good number for a keytar), plus channel aftertouch (heck, yes)
• MIDI-assignable accelerometer. And this is cool – it’s not on all the time; you make a quick sweep of the neck to enable the accelerometer in a clever gesture control.
• MIDI-assignable touch strip, but also a full pitch bend wheel underneath your thumb (I rather prefer the latter, but it’s nice to have a choice).
• Assignable slider under your thumb, mapped by default to volume.
• Dedicated sustain button, plus octave selection, transport, and patch select.

With all due respect to Roland, this appears to fix effectively all of my complaints about the Roland keytars at a fraction of the price.

And you can add a strap via standard guitar strap pegs.

The best part:
Q2-2012
MSRP US$399
Estimated street US$249

http://www.alesis.com/vortex

Akai Pro MAX49: Touch Faders, CV

I’ve all but begged manufacturers to explore what an advanced or high-end MIDI controller would look like. The MAX49 likely won’t please everyone, but it’s one compelling-looking answer. Features:

• 49 semi-weighted keys, with channel aftertouch
• 12 MPC pads, backlit, four banks each
• 8 LED touch faders in place of physical faders, four banks each
• Control Voltage and analog Gate outputs for use with analog and vintage gear
• Arpeggiator with latch
• Step sequencer
• MPC swing, Note Repeat, Full Level, navigation – and yeah, I use this stuff, even if the software can do the same
  USB MIDI, MIDI DIN, connect to anything
• Control surface mappings plus full Mackie Control and HUI support – and, sorry, but for all the fancier solutions, sometimes that’s the easiest way to control a variety of software like Ableton Live, Reason, and the other DAWs

So, basically, all the features you want. My only questions are what it looks like in person and how the action feels, particularly those touch faders, as that can be tricky to pull off.

But the features are just perfect. It’s about time to bring back aftertouch and to connect with actual MIDI gear. Adding CV is a delicious addition. And honestly, features like being able to switch on an arpeggiator are far more useful and appealing to average musicians than the hard-to-configure, often-gimmicky automatic control features on many of the keyboards out there. So I’ve got my fingers crossed that the build quality and usability here are good — and that some of Akai’s rivals start taking on similar features. It’s bizarre to be applauding adding features from the 80s and 70s, but some recent progress has been steps backward, not forward.

Q2 2012
MSRP US$699
Estimated street $499

http://www.akaipro.com/max49

There are other new Alesis keyboards out this week, but the Akai MAX49 pretty much steals their thunder.

More Vortex Photos

Back to the Vortex, since I got to snap some shots this morning in Anaheim.

Discuss.

I think I’m going to have to start teasing random projects I’m doing, like taking a picture of the corner of a dirty dish before I do the dishes, or showing a corner of my shoe before I tie them in the morning. But here’s one more teaser for you, especially since Americans today have the day off.

One reader tips us off to an image inserted in iKaossilator. It sure looks like a new KAOSS product. Aaron lazytrap writes some reasonable speculation:

New KP, red & yellow = Kaossilator+KP in one h/w box? New `tribe (play/stop buttons)? Hrmn.

I’m just hoping KORG will get some MIDI connections and MIDI sync back on their products, cough – we’ll see if this continues the trend of leaving that out.

Thoughts?

Ready to just use the gear you’ve already got and quit it with the teasers, already? (Hey, after NAMM week, I get to sit down and make music again myself, hopefully.)

Touchable tablets may be all the rage at the CES trade show, showcase to consumer-friendly gadgetry. But quietly, developer Sensomusic has accomplished multi-touch control of an open-ended music system on standard-issue PCs and accessories. They’ve pointed the way to just what this mechanism could be.

The latest video isn’t terribly easy to see, but it realizes something that has been the dream of fans of the music control protocol OSC (OpenSoundControl). “Learn” functionality lets you touch a control, then assign that control to something in your music software. But because these functions have relied on MIDI, they’ve generally been a bit arbitrary – touch one thing at a time, get a number for that thing, then assign that number to a controller. It works well enough, provided you step through each control. OSC promises to do more, though: an arbitrary touch controller on, say, your iPhone (or anything else) can have a plain-English name. And you can see multiple parameters appear on the screen at once, so that a sensor or multi-touch pad could have all its messages pop up at the same time.

Finally, Usine does OSC Learn correctly, with messages that pop up with names and get connected to whatever you like. I still think there’s more potential here to be plumbed, but it’s a great step.

If you don’t follow why that’s cool, check out another mapping notion from last year – here using a touch panel to make any graphic playable. And at the end of this story, check out the clever multitouch gesture recognition they’ve added.

Again, all of this you can do with standard-issue hardware – Apple iOS hardware, if you like, controlling a PC, or non-Apple hardware displays with touch or Android devices and the like. (Unlike the Emulator we saw earlier today or the original Lemur device, it’s a software solution that works with your hardware of choice.) More to watch:

More information (and more videos):
http://www.sensomusic.com/usine/

Music lovers are hacking Apple’s Siri voice recognition technology. By connecting to some of the “intelligence” of the cloud, these tools can make your phone rap or send music files to a player piano for instant musical playback.

First up: Yamaha’s piano taking requests, thanks to music grabbed online. A Yamaha rep explains:

Yamaha consultant Craig Knudsen demonstrates a unique implementation of Apple’s incredible Airplay technology in an exciting new way.
Here’s how it works:
Take a standard MIDI songfile and convert it to an audio file (while maintaining the MIDI data). The songfile is then sent wirelessly via WiFi to an Apple Airport Express (which is mounted underneath a Yamaha Disklavier reproducing piano. The audio output of the Airport Express is then connected to the analog MIDI inputs of the Disklavier, using a standard audio cable.
Then, you simply ask Siri to play your favorite song from your iTunes library, and Siri responds immediately, by making the Disklavier’s keys and pedal move up and down, recreating the performance, including full orchestration.
The result is nothing short of magical.

Of course, the actual “playing” is thanks to the capabilities of the Yamaha Disklavier. I’m actually a bit puzzled as to how the online conversion works, exactly, and I was curious for any Disklavier-owning CDM readers whether this is something publicly available. I’m waiting to hear back from Yamaha.

And now, for something completely different: Siri rapping. (Somewhat … erm … badly, if amusingly. It is a hack.)

My friend Robert “Robb” Böhnke had a lot of fun combining Siri’s voice synthesis and the lyrics of Notorious B.I.G.

My hack for the Music Hack Day 2011 in London, a 24h Hackathon for all things music.

SiriProxy is used to intercept the communication with Apple’s servers. Notorious Siri then sends Notorious B.I.G.’s Hypnotize to the device.

Siri’s speech synthesis is synced to the beat using the timestamps obtained from the Echonest API which were then manually tweaked, to smooth out delays in the text-to-speech engine.

Thanks to Universal Music for awarding me a nice pair of Dr. Dre headphones

The Echonest API, by the way, is an amazing do-everything “API for music,” one that analyzes musical files and connects to a vast storehouse of musical intelligence.

Warning: this video is most definitely Not Safe For Work. (Heck, even the thumbnail isn’t, exactly.) If that concerns you, just go listen to the Yamaha video again, okay?

Siri FAQ [Apple.com]

Previously: Google Translate Beatboxing

…and, of course, that means: Android, your move.

Truly generative musical scores in games have been few and far between, and “music games” has traditionally meant arcade-style rhythm games in which you repeat phrases or whole songs as accurately as possible. Pugs Luv Beats breaks those molds. Part of a vanguard of new gaming creations that generate dynamic music on the fly, it marries grid-based sequencing and resource-gathering gaming, as music making and gameplay blur together. The interactively-produced music could itself become a new way of delivering a musical signature with sound packs.

And beneath it all lurks a free and open source library, libpd – the embeddable version of tried-and-true free graphical music environment Pure Data. (That library is now on GitHub, and vastly updated, by the way, and we’re expecting a book soon from the library’s principle author Peter Brinkmann.)

Oh, yeah, and don’t forget about some seriously addictive gameplay and adorable pugs. I’m suddenly not concerned about the 15 hours Europe-to-North-America travel I’m doing tomorrow.

Here’s what the gameplay looks like, since it’s much easier to see:

Pugs Luv Beats was just approved on the iTunes App Store for iPhone and iPad.

Co-creator Yann Seznec (The Amazing Rolo) is a terrific musician; I just caught up with him in Edinburgh and Berlin and watched him play a homebrewed pig gut instrument with Matthew Herbert for the performance piece “One Pig,” on tour at Berghain. Working with Pd allowed Yann to focus on those musical impulses and not just engineering, and to let him try things he otherwise would never have imagined on a mobile title. So I asked Yann to walk us through how the project was built. He responded with an exhaustively-detailed examination of the evolution of this title, right down to the Pd patches. (Click through for high-res versions.) If your New Year’s Resolution is doing something with patching, you might want to hang onto these answers. Here’s Yann:

The origins of Pugs Luv Beats date back about two years. After making [musical iPhone game] Mujik, Jon (Jonathan Brodsky, aka jonbro) and I were trying to think of other approaches to music mobile app design, and we started thinking more and more about games. Music games, as a whole, are an oddly passive and traditionalist experience – you play along with a premade track, and you are judged on your accuracy and flair (which is strangely reminiscent of music conservatory mindset…). Obviously there are exceptions (RjDj’s Dimensions, Elektroplankton, etc.), but there you go.

Particularly interesting to me was the idea that game mechanics are often very similar to compositional techniques. So for example, when Sonic runs at a normal speed he collects rings at one rate. However when he powers up and goes super fast, he collects rings at a much higher rate. This could be compared to introducing a melody and then speeding it up – and when there are two players, doing this with two melodies. Instant fugue!

We started looking at how we could make a music game where the music and the game elements were fully intertwined and augmented by each other. So Jon prototyped a space shooter drum machine. It was awesome.

To make a (very very very long and boring) story short, our idea and prototype landed us some funding from Channel 4 and Creative Scotland to work on games that focus on musical creativity and composition.

For various reasons, we decided to put aside the space shooter drum machine for a while, and start from scratch. After going through several full prototyping iterations we eventually settled on a core game mechanic that turned out to be in many ways similar to a Tenori-on [Yamaha grid instrument]/Boiingg-style [monome hardware patch] music generation system – in our final prototype, you controlled a series of little dots that moved around the screen, creating loops. This is super fun from a musical perspective because it’s easy and rewarding within a few seconds, and when you have several loops going it can gain some pretty serious rhythmic and melodic depth.

The key from there for us was turning this into a game. We had been using free Internet graphics packs up until then (we hadn’t hired our artist Sean yet) which featured a ladybug, so we had been referring to the main characters as ‘bugs’. During some discussion one of us accidentally said ‘pugs’, and the game idea was born. We constructed a story about pugs and their love for beets (like the vegetables) which create beats (ha!), and how their love turned into greed and got out of control, destroying their world. The game, therefore, is about helping the pugs rebuild their lost civilization by guiding them to create beats. You grow your galaxy by collecting beats, which you do most efficiently when you dress your pugs up in costumes. What’s not to like?

To get to the part that I imagine CDM readers are most interested in, the app development was done by Jon using openFrameworks, [lightweight language] Lua, our own game engine called Blud, and the audio is all done in Pure Data using libpd (through ofxPd). In hindsight we started using libpd really late in the game, just at the very end of the prototyping stage, which was rather silly. Our adoption of libpd basically made our dev cycle about a million times more efficient. My background is as a musician and sound designer, and I have very little coding knowledge. I do, however, have lots of knowledge of Max/MSP, so picking up Pure Data was pretty easy. This allowed Jon to completely pass off all the audio processing (not to mention aesthetic sound design choices) to me, saving him loads of time, giving me direct control over the sound, and letting me test and prototype different approaches to audio within an environment that I knew would be recreated in the game. Also, as Jon mentioned to me recently, by using PD we are able to take advantage of 20 years of audio DSP research and development. Pretty amazing.

How it all works:

The entire audio engine is contained within this patch. Pardon the messiness.

The simplest part of the patch is the “sounds” section, which is used to playback simple sound effects, for the most part linked with interface actions in the game. I did this by creating a very simple patch which plays a sound when it receives a bang. Which sound it plays is dictated by the argument (in this case, the sound of discovering a new capsule). The process for adding a new sound, then, is as simple as adding the sound file to the /assets/sounds/ folder, and making a new instance of “sounds.pd” and naming it the same as the new sound. Jon, in the project code, created a list called “sounds” which is sent into Pure Data. When that list contains “capsule”, a bang is sent into that subpatch, and the sound is played.

A more complex version of what could be done with this type of data is seen in the voice of Mr Puggles, who helps you learn how to play the game. Mr Puggles pops on and off the screen to guide you through the first few worlds, and when he does he send Pure Data a “puggleShow” and “puggleHide” signal. I wanted to give Puggles a funny synthesizer voice that was different every time – dead simple in PD. To do that, I take the puggleShow bang and use it to trigger five more bangs, spaced out over a second. Each of these bangs triggers a random number which is translated into a MIDI note. This note controls the pitch of two oscillators (a sine and a sawtooth), one of which is slightly modified to make them slightly different pitches. These are played through a short volume envelope and a filter which is also controlled by a random number generator. Result? Hilarious beeping boopy Mr Puggles voice, all coming from one bang.

Every time a player buys or selects a planet, a short list is sent to Pure Data comprised of the planet BPM and a random number seed. The BPM is used to calculate delay times and such, and the random number seed is used to create a sort of musical identity for the planet. This is done by choosing a “beat library” and a musical mode.

The mode is created by building a lookup table that chooses the notes from a chromatic scale that would be used in a particular mode. For example, a major scale (ionian mode) uses notes 1, 3, 5, 6, 8, 10, and 12. Each melodic sound library I used is comprised of a full chromatic octave, and the notes that are played on any given planet are controlled by this table. This ensures not only that all of the different sound libraries being played on a planet will be in the same key, but also that a planet will have a strong melodic identity.

The sound libraries in the game are all controlled by the pugs on the planets. As they run around, each time they land they will trigger a sound. The type of sound is dependent on what terrain they are on – thus, if they run through the snow they play a toy piano, if they run through lava a distorted guitar, etc. There are two states of playing the sound, one if the player deliberately tells the pug to go to that tile, and the second if the pug is traveling over that tile to get somewhere else. It’s super easy to do that kind of thing in Pd; just set up two different ‘play sound’ envelopes, maybe a little extra delay or reverb, and you’re done!

The final piece of the puzzle for making the pugs running around into music is to make each tile be a different note. The terrain of each planet is created by making a sort of height map, where different heights correspond with different terrain types (grass, water, snow, etc). This also means that each tile has a unique number between 0 and 1. When the player buys or selects a planet, a giant random number table is generated in Pure Data which creates a number between 1 and 13 for each possible value between 0 and 1. That value is what is used to pick the note of the mode. This somewhat convoluted approach again lets us make sure that each planet will have a unique, but fully reproducible, musical character.

The actual playing of the sounds is probably the messiest part of the patch structure. Purists look away now.

I wanted to make sure this part of the patch was as flexible as possible, so I ended up using the soundfiler and tabread~ objects, rather than tabplay~, which is great in practice though does look rather uncouth. Additionally, I had some limitations imposed upon the structure of the patch – namely, I had to keep the number of tables down as much as possible, to save on memory. So each sound bank has two voice polyphony – there are many sound banks, and the beats and sound effects aren’t counted in this, so that limitation is not really heard in the final product at all. It did mean I had to work out a decent voice allocation system though!

I think my memory issues were probably my only problem with using PD in this project – though only indirectly. As I mentioned, they were hardly a problem artistically, however it took me a while to get used to the idea that not everything I patched on a computer would work on an iPhone. Similarly, I had to be very careful about things like relative volumes. In a generative music game like Pugs Luv Beats, the player could quite easily send 15 pugs running around making sound, which mounts up pretty quickly. It means that all of the patches and sound need to be designed to withstand lots of triggering without distorting. None of these things are problems, really, all they require is regular testing on devices and simulators – something that every mobile developer is already used to.

That’s the Pure Data audio engine in a nutshell. The end result is a flexible and powerful audio engine that sounds really great and is fully integrated into Pugs Luv Beats. The game is a great combination of music, silliness, and strategy – there’s a bit of something in there for everyone. You can definitely just play with the game to make beats, or you can try and collect all of the costumes, or you can try and make the most efficient planet ever. You can also explore the galaxies being made by your Game Center friends, to hear what they’re up to.

The background story:

And, just for fun, a silly promo featuring real pugs. Anyone traumatized by the sight of Pd patches, these should relax you.

More information at the developer site:
http://luckyframe.co.uk/pugsluvbeats/game.html

Graphics are good. Graphics are shiny. But when it comes to reality-bending, emotionally-immersive, perception-shifting power, look to sound and music.

At least that’s the feeling you could get after playing Dimensions. Following their reactive music tools and Inception dream states for iOS, RjDj have turned their mind-altering sonics to gameplay. As with previous releases, these tools are powered by the open source visual development environment Pure Data. Pd engineering wizardry here meetings the compositional and sound design prowess of Hans Zimmer.

You can see a bit of how the musical world works in the teaser video above, and the music sound design video below.

But we wanted quite a lot more information. So, CDM got RjDJ’s Rob, Joe, and Martin to share some detailed thoughts on how the game experience is put together and how it works.

The App

RjDj Team: Most games require your full attention when you play them. You either live your life or play the game. Dimensions is different. It’s designed to be played in parallel with your normal life.

Gameplay is intertwined deeply into your daily life. Some dimensions unlock if you are physically active and others unlock if you are quiet. The app automatically detects what you are doing and syncs the game to it making use of every possible sensor on the iPhone.

You stay immersed in the game by listening to augmented sound and the voice of Emily from Mission Control. She guides you through many exciting challenges like collecting Artifacts and avoiding the dreaded Nephilim.

With Dimensions we are very interested in creating a gameplay experience which is between the device based focus of a casual game and the passive use of listening to music. Its a game which you play by listening – a game that place in parallel to your everyday life.

The Tech: Reading Files

We built our own version of readsf, rj_readsf, in order to be able to read compressed audio and make the samples available for processing in Pd. One advantage of readsf is that possibly lengthy audio assets do not need to be loaded into memory. If memory is limited, especially when Pd may be running in the background, limiting exposure to system memory warnings helps keep the app running and the music playing. Given that compressed audio is roughly ten times smaller in size than uncompressed audio, and that audio assets make up the majority of the size of the entire app, it is a huge benefit to be able to deliver and read compressed audio assets directly, without the need to decompress in memory or onto disk. Dimensions requires that several dozen such players be open and viable at any time, and special consideration was given to concurrent behaviour. rj_readsf can loop a file when it gets to the end, and it indicates with a bang when a file has been loaded (an asynchronous operation) or the end as been reached (in the non-looping case). rj_readsf is built on iOS standard APIs and can read any file format that iOS can.

Ed.: I’m waiting to hear if rj_readsf will be open-sourced. The issue of reading files is one we’ve had around libpd recently. While their rj_readsf sounds great, my sense is the best long-term solution will be a similar object that is independent of the APIs of any one OS, so this same set of problems may need a different solution for the open source community more generally. (Building such a tool is absolutely possible, though it might require more effort.)

The Music, and How the Music Plays with You

The music of Dimensions uses various different techniques from straight sample playback to audio analysis and synthesis:

Realtime manipulation of audio input from the mic:

This is perhaps the most recognisable technique we use. We process audio from the iPhone microphone live in many different ways. It’s kinda like a feeling of being inside the music.

The key thing we do with effects is attempting to analyse the environment of the player / listener and then making appropriate things happen within the effect. For instance, the Flux Dimension features a filterbank on the mic input. We analyse the incoming audio from the players environment and make the filter frequencies change as events occur ( either due to pitch changes or onsets ) this gives the impression that objects and activity around the player is somehow “playing” the music.

In the Ghost Dimension there is an effect which records audio whenever it detects an event, then scrubs repeatedly forwards and backwards through the sample using granular techniques stretching it out in time. This manipulation accentuates the textural and pitch based qualities of the sample as it repeats and works well with the atmospheric music Hans Zimmer composed.

Dynamically-controlled stems:

All the Dimensions use stems and hits from a conventional sequencer in some way, re-arranged live on the device relative to how the player is interacting. These stems were mainly composed in Cubase and Logic.

For example, in the Kinetic Dimension we feed accelerometer data from the device into Pd and drive the music from that. The player hears more energetic beats when they go for a run, but if they stop at the lights to cross the road, the drums immediately drop away. This was achieved with a large number of hits with all the rhythmic sequencing happening in a hybrid reactive / generative way live on the device.

In the Tranquil Dimension, the music introduces more stems the longer the player is quiet. If they make too much noise the music “shrinks away” from them and becomes quieter. If they stay in a Zen like peaceful state, the music grows into a kind of crescendo of serenity.

Reactive synthesis:

We often control parts of the music by doing a frequency analysis of incoming microphone audio from the device and then using those frequencies to determine the notes synths will play within the music. The Travelling Dream in Inception the App uses this extensively. Tranquil Dimension in Dimensions also uses onset and frequency changes to trigger synth melodies in the music.

The synths we use range in complexity from very simple additive synthesis to some great synth patches from the rjlib by Frank Barknecht and Andy Farnell.

Generative approaches:

There are some sections within Dimensions which are generative. These play back prepared samples as well as triggering onboard synthesis. They also feed the results of this through various live sampling and glitching patches. They are governed by various sets of rules which have various long term parameters, like adjusting to the intensity of the audio environment of the listener, or how dense areas of music have been around the present time.

Sample triggering:

Ghost Dimension uses a simple but effective technique of triggering samples from the music on onsets in the environment. This can cause some real jump out of your skin moments. We combined this section with a randomised very short delay on the mic which acts almost like a resonator, turning the mic sounds into creepy atonal pitched noises.

Sound Design

The main hub section in Dimensions, called the Launch screen, acts as a entry point to your augmented adventures. It also displays all available Dimensions via the floating tile icons.

Visually, these represent a snapshot of your previous experience using your location at that time. Sonically we wanted them to have an aura or energy from the Dimensions themselves.

SoundCloud examples:
Dimensions Sound Design Example by rjdjme

Example of using mixture of synthesis and samples to create user feedback when interacting with Dimension icons in the game.

Map Tile Down: several recordings of a synth in Pure Data that is played when the tiles are touched. Each one is slightly different due using two detuned oscillators.

Map Tile Open Only: a sample from Logic Pro for the woosh sound when showing the information view.

Map Tile Click: a sample from Logic Pro for touch events.

Map Tile Open: recording of how it sounds when put together.

Sound is a mixture of samples and real-time synthesis. The energy sound is made using two oscillators (one detuned) to create some modulation for a glowing effect. Added to some harmonics to make it more of a beam sound and some chorus and reverb. The open tile is made in logic, when closed it’s the same sound but reversed and pitched down in Pd.

We wanted the tiles you tap on to feel like each Dimension has some sort of energy radiating out.

Here’s a sense of how the sound design works in the game:

It’s an ambitious app, and the whole cost is US$2.99. I guarantee it’ll change your world more than a latte. (Well … unless we’re talking a really crazy latte. And that might not be legal.) As sometimes-CDM contributor Jaymis Loveday notes, there are terrific choices in coloring Google Maps, and how modes change based on ambient sound and motion.

Requires an iPhone 3GS or better, or third-generation iPod Touch or better, or an iPad.

Dimensions @ iTunes Store

More reading:
Dimensions Augments Reality Purely Through Sound [Leigh Alexander, one of my favorite game writers, for Gamasutra
The Roundabout Tapes – RjDj now plans to game reality with sound [TCTV] [Techcrunch EU]

The stream of iPad and iPhone apps for musicians gushes endlessly, but among that river of software, there are some visible trends. Demanded by users, features for sharing between apps – and other mobile artists – flourish.

Hardware heavyweight KORG has been one of the developers that’s been especially good at offering that kind of support. Their just-announced iKaossilator 2 app adds native iPad screen support (previously iPhone-optimized only), and a new “flex play” for fills and breaks.

But most notably, it offers options for sharing:

• Audio export for saving your audio – ideal for use elsewhere or sharing
• SoundCloud export (increasingly popular in desktop and mobile software of all stripes)
• AudioCopy for sharing audio between apps – adopted by many indie developers, this feature is becoming a demanded addition even if you’re releasing an app costing only a couple of bucks

This is addition to WIST, “WIreless Sync-starT,” Korg’s mechanism for syncing up multiple wireless apps. That’s ideal if you’ve got a friend with a device and want to jam. (It’s, unfortunately, iOS-only based on its reliance on Apple’s wireless sharing tech.)

The upshot of all of these features is, naturally, to help ease the tablet/phone app into the larger workflow, with desktop software and other tools. Korg’s other apps are similarly flexible – their iMS-20 synth works with MIDI and SoundCloud, for instance, and it and iElecTribe will wirelessly sync.

Korg iKaossilator

KORG isn’t alone. An updated Intua BeatMaker – more of a full-fledged beat-making and groove production workstation – added loads of similarly sharing-focused features.

Indeed, Intua goes further than KORG. Developers have been working together to route MIDI signals between apps with something they’re calling Virtual MIDI. (That deserves its own article, clearly, but worth mentioning in this context; see discussion on Google Groups.) As desktop apps have allowed collaboration between plug-ins and hosts, or multiple apps, this allows a MIDI app to control a synth app. It’s less powerful, arguably, on the limited horsepower of an iPad than it might be on a beefy desktop, but it can still be very useful for combining one controller or sequencer with something else that makes sound.

As reported on Synthtopia, Virtual MIDI is just one of a number of MIDI-centric features in the new version:

BeatMaker Getting All Sorts Of MIDI Love [Synthtopia]

There’s MIDI Out, yes, but also Thru and MIDI-over-WiFi for talking to other MIDI gadgets. There’s Virtual MIDI for communicating with other iOS devices. You can hot-plug MIDI and the app keeps working (essential onstage). And in place of SoundCloud support as in the KORG offering, there’s Dropbox file sharing support.

You can export and import MIDI – not just audio, but actual patterns – as well as read and write slice points in Apple Loops.

In fact, Intua even support Korg’s own WIST, so you could sync BeatMaker to KORG’s iElecTribe or the modulation of the iMS-20 and get synchronized rhythms between apps from different developers.

Intua BeatMaker @ iTunes

This is not to say iOS devices are identical to a desktop experience – in fact, their limitations and unique features are clearly part of their appeal. Instead, it seems part of an increased awareness that connectivity with other applications and other users is of growing importance to musicians. iOS developers seem eager to make these central design features, both emulating what’s been done right on desktops – and where there have been missed opportunities. It’ll be fascinating to see if other, non-iOS platforms follow the same trend.

Dig into humanity’s past, and alongside the earliest tools, you’ll find some of the earliest instruments. Designing objects for expression seems to be an essential part of civilization.

Martin Kaltenbrunner, a co-designer of the Reactable tangible music interface, is also a professor in Interface Culture at the Linz University of Arts in Austria. There, in the land of Mozart and Haydn, he works with students to explore what interface design is.

So, when I got to spend some time with Martin in New York in September, I was interested in more than just the flashy coolness of the Reactable, the futuristic table-with-blocks interface for music. We got a chance to talk about instrument design generally. The funny thing about the Reactable is that it is closer to the experience of working with a modular synthesizer and oscilloscope than anything else, with the sense of physical connections of sound to object you’d get from classic synths. It is something unique, truly, but that’s its pedigree.

Martin and I got to give a talk together at the Austrian Cultural Forum New York, a terrific hub in which Austrian artists frequently are paired with New York-based folks, all in a lean, tall modern landmark building in Midtown. We also performed together, which for me was a real pleasure; Martin claims not to be a musician as such, but was good fun as an improvisation partner.

The next day, we headed to Manhattan music education center Dubspot, where Martin’s creation quickly attracted crowds of interested students and educators. Dubspot filmed our encounter for the video at top. Amusingly, the prominent synth sounds you hear at the beginning are not the Reactable, but our own MeeBlip open source synth, which I brought along to illustrate conventional tangible instrument design with switches and knobs. (If you’ve been impatiently waiting for news on the MeeBlip, believe me, I’m even more impatient – more announcements on that this week and next, following a production quality issue with a contractor that required us to reboot the run of new instruments.)

Reactable Live @ Dubspot! Interactive Sound Design Workshop Video Recap [Dubspot Blog]

YouTube commenters, that subtle and thoughtful bunch, are complaining that the tangible Reactable will set you back thousands of Euros. But at ACF and Dubspot, I was also equipped with the far more economical and portable alternative: Reactable Mobile runs on both Android and iOS. (I was pleasantly surprised to discover the app runs perfectly on a Galaxy Tab 10.1 from Samsung; I’m still a long, long way from being able to recommend buying an Android tablet, but if you’ve got one, I can certainly recommend this app.) Now, don’t get me wrong: the experience was nowhere near as fun as using the table. On the other hand, you can’t fit the table into a seat-back pocket on easyJet, and the savings in cash is proportional to the sacrifice in experience. What impresses me is that the design of the physical Reactable “flattens” so nicely onto the screen; I think it’s a user experience triumph that you can make that translation. And I was able to load up a few loops of my own music and jam along with the MeeBlip and Martin on the (real) Reactable.

Looking beyond the Reactable, Martin addressed these larger issues of tangible interface design at TEDx Vienna – a fitting locale for talking the history and future of music. His whole presentation, and a sweeping concept map of what he discussed, is available.

Martin Kaltenbrunner: Tangible Music

If you just want to get your Reactable on and can’t afford the table, see Reactable Mobile below. (Seen here on an iPad 2, but I’ve run successfully on the original iPad and the Galaxy Tab – the experience is more or less identical, thanks to portable code.)

And if you can afford the table, you rockstar, uh, can we be your friend?

http://www.reactable.com/products/mobile/
[the awesome table version]
Martin Kaltenbrunner website [with plenty of academic links]

In the latest take on sonifying data in musical form, iPhone app Astro Cantus plots star data from the universe as musical notes. It turns the the sphere of heavens above the Earth into a massive piano roll.

Co-founding developer Rocky Alvey, according to the creators, dismantled a music box as a kid, and that music box notion (yet again) is a big part of the concept here. What’s notable is that the app’s sonification does indeed represent not only the stars themselves but some of the data – spectra of the stars are translated into pitch. And there are a lot of stars in there.

The musical representation itself is a bit limited: you get either chimes or a piano playing a pentatonic mode, and some control over spectrum and magnitude. Speaking as a composer who has occasionally played with it, that’s the challenge with this sort of work: making musical paradigms represent the data is no small obstacle. But the developers also say this is just a (very pleasing) first step, with more interactive features and live modes and additional sounds and scales to come.

http://astrocantus.com/
US$1.99 on the App Store

Amusingly, I’m writing this as my KCRW music stream is playing Bill Frisell’s cover of The Beatles’ “Across the Universe.” Which is more compelling as a commentary on the world? I’m not sure.

Nothing’s gonna to change my world.

Thanks to West Latta for the link; via TreeHugger’s Jaymi Heimbuch:
iPhone App Creates Music from Stars and Galaxies

Apple’s GarageBand music creation and amp simulation on iPad is now also on the company’s handhelds, with iPhone (3GS, 4, 4S) and iPod touch (3rd-generation and better) support. You only have to buy GarageBand once; the app runs on all those platforms, so if you had the iPad version and also own a compatible device, you can automagically add it.

The iPad is definitely the roomier device, so what can you do with the handheld?

• Touch Instruments (pictured here) let you quickly tap out musical ideas.
• Amp and stompbox models work. As I’ve said in the past, that makes the handhelds into usable practice amps or pocket-ready effects boxes.
• Lay down multiple tracks (recording external audio one at a time), and edit in a simplified GarageBand track editor.
• You can still exchange files – up to eight tracks of recorded or generated music – with GarageBand and Logic on your Mac. That makes this a usable pocket sketchpad.

In short, not only does your Mac have little to fear, the notion is that these handheld apps could actually give you added incentive to do production back on the desktop.

Also in this update are features that will be useful to the iPad version, too, but are clearly intended to make the palm-top edition more usable. “Smart Instruments” let you play along with chords – ideal if you can’t quite twist your fingers into strumming positions on your phone. And there’s a historical musical precedent for this, too: think autoharps and frets and capos, musical innovations intended to make playing an idea easier.

If you want a bit more sophistication, the instruments expand to provide features like glissando, Leslie simulation, tuners, and so on.

Our friend Jim Dalrymple of Apple-focused tech site The Loop spots other enhancements. If you discovered the previous version frustratingly didn’t let you change keys without transposing audio, or didn’t let you set 3/4 or 6/8 time signatures (“do I hear a waltz?”), those holes have been patched – useful in the iPad version, too. Also, you can export to AAC or uncompressed AIFF even without going via GarageBand or Logic, a helpful issue.

US$4.99 new, or free update for existing customers. (Fear not for starving programmers. It turns out that this “Apple” company also makes those “iPhone” and “Mac” things, too.)

But this is all feature talk. What’s impressive to me is the way Apple has boiled down the interface of GarageBand into a smaller space. What’s left is only what is strictly necessary – complete with some photo-realistic imagery, yes, true to Apple’s notion of polish and texture. It makes a stunningly clear and obvious interface design, and that to me is inspiring: not as something I hope other developers will copy, but the kind of clarity I hope they’ll find in their own voice. After all, GarageBand for iOS shares DNA with Logic, not just mobile apps, and therefore a far more complex heritage.

Playing the glass surface of your phone as a musical instrument is likely to be relatively limited – compare a tangible instrument, which feels fun to play. But as a sketchpad, and as a pocket reduction of other things, this has appeal.

Images courtesy Apple. (Check out high-resolution versions.)

Apple App Store Link