Weekend fun, part 1: as Reactable makes the leap from custom, tangible interface to go-anywhere iPhone/iPad app, here’s a look at what the fingertip-controlled music creation experience is like. The first of a series of tutorials, the video above walks you through some basic music production. It should lay to rest any question about whether this kind of interface can work in musical performance or live arrangement. I still think some artists will want to bang on something rather than just gently finger-paint their way through music, but as arrangement tool, it’s intriguing – and this video makes clearer what the thing is about.

(Just a couple of quick posts by way of apology for breaking one of our two servers, causing an outage. My fault.)

If you’ve wished you could use your iPhone, iPod touch, or iPad as a remote control for Logic, now’s your chance. And touch control continues to evolve as an additional option for manipulating music software, alongside good, old-fashioned knobs and faders.

Handheld wireless touch control is certainly coming into the mainstream. As we see new controller integration in tools ranging from Ardour to Renoise, Apple quietly added support for iOS touch control in an update to Logic.

One line in the release notes says it all:

Supports iOS control surface apps that utilize the OSC protocol.

Logic Pro 9.1.2: Release notes

– or, to put it another way, that’s all they say. Fortunately, Sam Greene has written up a great little tutorial / first impressions:
Control Logic using your iOS device – Officially.

Basically, select the awesome TouchOSC app and your device under Control Surfaces, and automagically unlock access to mixing controls and automation. It’s nothing revolutionary, but these devices make perfect remote controls. It’s also nice to see this kind of control as something that’s evolving independent from individual apps. That is, instead of having to buy an app for each software you own, just as with MIDI, there’s some interoperability.

It seems to me that the next logical step is to begin to introduce some standardization to the way in which DAWs and touch controllers interact. But before we get there, this kind of solution is a good place to start; I think without playing with this stuff, it’s hard to know what a “standard” of some kind (lowercase “s”) would look like.

Speaking of playing, let us know how this works for you.

Thanks, Sam, for working this out!

StepPolyArp for iPad controlling an Oberheim FVS from Logan Mannstrane on Vimeo.

Logan Mannstrane sends in this lovely video combining an iPad MIDI step sequencer — with an Oberheim FVS. It’s a striking intersection of analog and digital technology. But I wanted to ask Logan to explain why he’d use the iPad in this case instead of other MIDI tools — why crossing this generational gap mattered. He responds:

That fact that I can interface a synth from the 70′s to new device in 2010 is pretty amazing by iteself. I can have the sequencer in my hands and pull a chair up the window while laying back with my feet up it is very inspiring and a comfortable workflow. Also, for people that have multiple analogue synths scattered around, it is very nice to sequence the synth when you are right next to it. In a world full of DJ applications, rompler sequence programs, it sure does feel
good to have something fun and musical to try out. For a version 1 of the software, it is very neat. I heard more Midi apps are coming to the iPad in the future so this is a great beginning to wireless MIDI.

While TouchOSC is great, there are many people that want to start making music without having to spend a week of building an interface to talk with hardware and software alike. The StepPolyArp software was well thought-out and cleanly executed with a elegant interface. With Analogue synths you have instant control and feedback for designing the sound, and now you can step away from the mouse and chair to sequence. It doesn’t get better than that.

If you like the looks of this software and have an iPad, here it is:
StepPolyArp

It uses the free DS MIDI WiFi, a project born – as the name implies – on Nintendo DS. Viva open source.

There’s no question in my mind that MIDI remains lingua franca for interconnecting devices across the previous decades. Of course, that to me also suggests we need to make more progress on standardizing the way network MIDI protocols work.

Through the grapevine, I’m hearing the iOS SDK will incorporate network MIDI capabilities, but I think there are still some challenges there. Apple’s protoco,l while thoroughly standards-based and still essentially MIDI, is nonetheless for now specific to them. I’d also like to see some solid numbers on performance. New gear may want to investigate Bluetooth and not just WiFi, as Bluetooth could work nicely for embedded hardware, DIY synths, and the like. But it’s certainly an interesting time.

As a counterpoint, here’s Logan with a Pro One – no iPad in sight, just physical knobs. I think there’s something to be learned from the interaction design of each, and something unmistakably wonderful about the connection of hardware like this to sound and experience.

The infamous white faced Pro One from Logan Mannstrane on Vimeo.

For more Oberheim goodness, gaze into the glossy ads the company produced in 1981 and 1982 for Keyboard, and dream of the day when we enjoy electronic music ads again: Retro Synth Ads: Oberheim, at one of my new favorite sites.

Summer has ended, but that leaves time to look back. Among the many parties around the world, Electric Zoo was New York’s biggest electronic festival, with headliners from Moby to Flying Lotus, descending on a dusty, sunny Randall’s Island just east of the island Manhattan.

At top, I took my new Diana mini (lo-fi film camera) out for a spin amongst the music lovers, who gravitated moth-like to the camera. Never let it be said that Americans don’t like electronic music; families and a new, young generation of ravers flooded into the park. Since Moby’s set was off-limits for photography, it seemed to me only appropriate to go hang out with the music fans. And it’s good to remember that, whatever your musical genre, there’s someone whom you can make happy with your work. (Having spent the same weekend on a rooftop and in a barn with monome practitioners and lovers, yes, there’s a place for everything.) Feel free to page through the sets, especially if it’s a rainy, cloudy day.

When you face a crowd of eager fans, the desire to deliver real performance becomes all the greater. In an age of pre-configured DJ sets, it’s a chance to have the same enthusiasm as those in the audience, and yes, to actually sweat a bit. As a study in what’s possible with computer performance, I took in live, non-DJ sets by Jon Hopkins and The Glitch Mob.

Both artists use touch in their performance. The interaction with the music is reasonably limited, but that means the effect is easy to read. As it happens, we’ve profiled the setups of each of these acts before. For Jon Hopkins, multiple KAOSS Pads facilitate quick access to dramatic effects. Ableton Live is just the sound-source; the outboard gear handles both touch control and signal processing. For The Glitch Mob, Lemur multi-touch displays, tilted toward the audience, control parameters in Ableton Live.

More details:
Behind the scenes of The Glitch Mob’s Lemur setup

Jon Hopkins tells CDM about his studio, live rigs and playing the KAOSS Pad

I have to notice that the KAOSS Pads fare a bit better than the Lemurs in regards to tactile access to what you’re doing. The Glitch Mob had to make its touch areas on the Lemur fairly large just to find them; because they’re all on an undifferentiated screen, you have to find the right location by feel. But for both acts, creating big gestures is important, partly so that it reads to the audience, I imagine, but also so that it’s the kinds of gestures that feels good as a player and are easily reproduced. And even with a touchscreen, it’s possible to begin to tap into muscle memory, as was clear as The Glitch Mob used their consistent control layout in their set.

Touch alone, in each case, is augmented by tactile controls. The Korgs have physical encoders and controls, and Hopkins uses MIDI input and computer control for tactile control over sets. The Glitch Mob use Akai drum pad controllers, as well. And fun as the touchscreens are, they can’t compete with good, old-fashioned drumming: the highlight of The Glitch Mob’s new set is when they break out drumsticks and explode into lines worthy of a drum corps. (The Glitch Mob need to meet Caity at Georgia Tech.) You can tell the guys are just having a great time doing it. We talk about all the ways computer performance can become more like instruments, but, of course, there’s no reason not to simply use the traditional instruments we love alongside computers.

There’s still a sense of a divide between the virtual and the physical, the digital interface and the kinetic gesture, and maybe that’s natural. Rather than try to entirely reconcile the two, they can sit side by side – just like my digital Olympus and analog Diana.

I could say more, but I think in this case, the pictures tell the story, a little microcosm of the many musical events of this summer.

Flying Lotus

There’s something to be said for the good, old-fashioned MIDI controlled and laptop combo. FlyLo makes an Akai MPD32 his axe of choice – and it makes it look damned good. Photos courtesy the festival.

The Gear

The Fans

All of this would be meaningless if fans only responded to DJ sets. On the contrary; live sets in electronic sound live and connect in a way that’s special.

All photos (CC-BY-SA) Peter Kirn, unless otherwise noted.

The quickest route to expressing an idea remains the gesture of a hand. That gesture may be crudely interpreted through today’s touch displays, but the immediacy remains. Presumably because of some of the device’s limitations, a lot of the experiments with the iPad have involved controllers that operate independently from sound software, like a remote control. Those interfaces, while useful, largely simulate existing hardware controls in a more flexible form, rather than introduce new ideas. But it seems the long-term potential for touch devices is in designs that unite touch, graphic, and sound in a single piece of software, exploring new paradigms for interaction along the way.

Usine is one of music creation’s most surprising secrets: it’s powerful sound software that incorporates creative touch interfaces as a core design principle. And in the video above, it’s running on a relatively cheap PC two-touch display from Packard Bell. Nay-Seven is one of the founders of the Usine community, all while lecturing internationally, and has been pushing the Usine software to its limits.

Here, he tells us about some of his latest experiments, and the potential they hold.

Always looking for a way to use the computer as a real musical instrument, my latest works try to combine graphics and music using a touchscreen interface. The software Usine from sensomusic gives me the freedom to build my own interfaces. Some examples:

Drawing pitch and pan

Here [at top], the purpose is to draw directly some pitch information on the waveform display of a sample. I’ve also added an LFO [low frequency oscillator for modulation]; this way, the drawing can move slowly according to different speed presets.

[At bottom], I play with pan and volume: the x position of the black ball on the lines gives pan information and y the volume. As I’m on working with a dualtouch screen, I can quickly draw some speed changes. Note that this panel is not only for pan and volume; I can also send this drawing to others parameters like delay and filters, here with the << button.

Geometry …or not

This workspace is also dedicated to drawing. I’ve built four layers, each one with its own color and its own sound. The XY position gives the pitch value of the notes and other parameters, like velocity or pan. The geometry provides sequences; lines give a kind of glissando.

Vertical sequencers and Pads

Using the new Matrix module (thanks to Martin Fleurent), I’ve built this vertical sequencer [seen at top]. I like the idea that notes fly under my hands this way. [At bottom], I‘ve built pads for tablet surfing on the “iPad” mode, adding also a drone option.

Multitouch gestures

On the same idea of movement, here are two screenshots of a video illustrating a new patch made by Olivier Sens (the Usine developer). This patch provides multitouch gesture recognition, opening new doors to ways in which we use our computers and touchscreen. We can easily imagine some new symbols or alphabets, and new forms of interactions in our musical practice. You draw a ‘V,’ you play with volume, you draw a ‘P,’ you play with pitch…

For more on the display, check out the Packard Bell Viseo 200T. It was previewed by Engadget last year and carried a street price – impressively – of only about US$300, all for a 20-inch screen and low latency. I’m gathering either something happened or it was re-branded for distribution outside the UK; anyone with more information, let us know in comments and I’ll update the story.

More on nay-seven’s Flickr:
http://www.flickr.com/photos/usine/

All screen images courtesy nay-seven. Used by permission.

You’re now approved to DJ with your iPhone. Or at least the app is. I’m not sure if I can take credit for getting Apple’s attention, but Apple has approved the TouchDJ application from Amidio. That’s big news, partly because developer Amidio has consistently been at the forefront of musical development on the platform, including their Noise.io synth and wild hexagonal JR Hexatone Pro.

This also is a big blog to the theory that Apple is intentionally blocking DJ apps — and a big boon to the theory that the App Store is just plain clogged, even if it may be disproportionately affecting more sophisticated applications.

Features in the release:

• “Visual mixing,” with a clever interface that uses overlays atop side-by-side waveform views
• Pre-listening using a special left/right adapter
• Faux vinyl and spin effects
• Real-time scratching, looping, positioning, EQ, effects, re-pitching
• Onboard sampler with 3 WAV sample slots, recording from the mic
• Uses a separate MP3 library with companion apps, since it isn’t possible to DJ from the library you sync from iTunes

Now, to me, that last point is a fairly significant one. You have to load tracks you wish to DJ separately, in MP3/M4A format. And I’m sure that this will start various debates about whether you’d want to DJ on your iPhone in the first place. But don’t look at me — I just work here. I’d be remiss if I started out the week talking about apps stuck in iPhone limbo, only to ignore them immediately becoming available. And I will say, Amidio is one of the smartest mobile music developers out there, so it’s worth checking out the range of what they’re doing.

Whether petitions and news stories did help this app to get to the top of the queue or not, I have no idea. I think maybe I’ll start running screaming headlines with things I want in them, if only for good luck.

Tomorrow on CDM: “You Know What Annoys Me? The Fact That We Don’t Have Unicorns. Magic Unicorns. Who Speak OSC.”

multi-touch the storm – interactive sound visuals – subcycle labs from christian bannister on Vimeo.

What if you could mash, mangle, mush, and morph sounds with your fingers on a screen, watching the waveforms dance in response in three dimensions? That “what if” is expressed beautifully in a project by musician-developer Christian Bannister of Portland, Oregon, who works as Subcycle Labs.

The result is like being able to touch sound directly.

Three-dimensional forms morph and vibrate using visuals programmed in Processing, making architectural-organic shapes and spaces that really begin to “look” like sound. These forms can represent synthesis and effects parameters (Christian has done some work with the Massive synth from Native Instruments), or can allow navigation through loops using touch. Gestures remap offsets and duration for audio, scrub and slice, and apply granular resynthesis.

Controls use multiple touch points on a screen (apparently via Community Core Vision and reacTIVision), with sound from Logic, Reaktor, and Max/MSP, and auxiliary control with a joystick array and KORG KAOSS Pad.

Here’s what happens with a Massive bass line:

low frequency entity – subcycle labs from christian bannister on Vimeo.

It’s spectacular, gorgeous work, and I can’t wait to see more. It’s well worth reading through the whole description on the blog for more details, technical, musical, and artistic:

http://www.subcycle.org/

As computer music practice – part composition, part instrumental play – spreads, the idea of software interface as performance tool is becoming second nature. Putting those opposable thumbs and sensitive fingertips to work, multitouch controllers are growing in number, variety, and sophistication. Berlin-based artist Marco Kuhn shows off his beautiful creation, the PlayBox multitouch hardware, and its first app, PlayLive. That first software focuses on Ableton Live performance, but Live could be just the beginning – Marco has worked with Pd in the past and promises other apps to come. He’s interested in selling this device in the future, and he shares with us the tools he used to create this work for those of you doing development along similar lines.

The Project:

“Play Box” is is a User Interface for Natural User Interaction.
? allows multi-touch and object recognition (TUIO marker)
? hovering is also possible
? 22 ” TFT display , 1680 x 1050 pixel
? robust
? plug`n play

“Play Live” is a dedicated multitouch controller surface for Ableton Live.

- GUI Elements support multi-touch interaction
- easy to setup , just load the “Play” Control Surface
- you need no controller assignment
- you can control 32 tracks and 127 scenes, that are 4064 clips
- track controls are mute, solo, record, send1, send2, pan, level
- scene feedback name and state
- clip feedback color, name and state
- Transport control
- 2 Returns
- Master
- support bidirectional communication
- display track level meter, name

The whole app is coded in python.
- use Python Ableton Live API
- and libavg www.libavg.de for the GUI and Trackingengine
- PyPortMidi receive/send Midi Messages

“Play Live” Future plans:
- FX View per Track
- subpage for abstract clip controlling

I tested it with my mac book pro, “Play Live” and “Ableton Live” is running at the same machine. It should work on all platforms (Windows, Linux, Mac OS X). That Project started with my Diploma Thesis in Applied Computer Science 1 year ago.

Everything is coded and built by myself. The GUI – elements has been designed by Gösta Wellmer.

In this work, I created a GUI-Controller Library which allow me to Develop very rapidly Multitouch Interfaces for other Audio Environments.
More Apps coming soon

I [plan] to sell the” Play Box” and Apps like “Play Live” if anyone is interested.
The price is yet not specified.

That`s not my first multitouch Interface. 2 Years ago I created forfour – http://forfour.hi-pi.de/
- used PD, Processing, Reactivision and OGRE.
But the “Play Box” is another level;-)

For more on the project:
www.hi-pi.de/play

I hope to have video to share soon – and yeah, it’s time to plan another visit to Berlin.

There’s plenty of rightful skepticism about the use of mainstream displays for multitouch in general purpose computing. And why not? As a full-time replacement for other input, multitouch probably doesn’t make sense. But for music, the equation is changing. Multitouch capabilities are showing up on commodity-priced PC computers like the multi-touch enabled HP laptop models – the tx2z seen here starts, incredibly, at US$850. And because computer musicians are looking for more control, having a touch-enabled display (even single-touch) just makes sense.

The screen for a laptop musician is a huge piece of real estate. Finally, instead of sitting dumbly in front of you glowing, it can become an X/Y controller or give you shortcuts for controls or provide additional parameters. Yes, using a touchscreen exclusively can result in the dreaded “gorilla arm.” The ergonomics of using a vertically-oriented screen are extremely poor – if you use it exclusively for an extended period of time. But if you look at the way people are using these touchscreens, for incidental control in combination with other things – and the ability of convertible laptops to transform into a horizontal orientation – I think this is no longer the deal killer it once was.

At top, an HP laptop ($850) plus the free version of Sensomusic’s Usine is all you need to create a multitouch interface for Ableton Live. Correction: right now this is limited to single touch only, but multitouch is supported in the hardware, in drivers, soon in Windows 7, and support is promised for a future version of Usine. The point still stands — as does the ability to optimize controls for your fingers. Being able to use more than one at once will, of course, be that much better.

Fractal (see Myspace) uses the combination to play Ableton Live with some simple controls. If you get hooked on Usine, you can get the full “Pro” version for EUR70 with additional patches and objects.

The one major remaining obstacle to multitouch, at least, is cost. If you don’t especially fancy buying a new HP laptop, add-on kits still run in the range of US$800-900 (meaning, ironically, you might as well just buy the HP instead). Laptop vendors are still slow to adopt the technology, though that could change when Windows 7 ships later this year. (On the other hand, tablet PCs, even when they were shipping in relative quantity, often were constrained in available configurations and either skimped on specs or demanded a significant premium.)

But let’s not complain too much. The simple reality is you can add an HP laptop now to a live rig as a performance instrument for under a grand.

To see something else with Ableton Live, here’s a video by Andrew Coenen from earlier this year of Pance Party’s Bartelby playing Live with the open source Max Multitouch Framework. This is a more sophisticated setup – it requires a table-style setup using the Frustrated Total Internal Reflection tracking method. But the idea is basically the same. (By the way, Max 5 is an optimal choice because of its excellent widgets, and it’s great having this choice, but it’s a little odd having an “open source” framework in proprietary software. If you want a fully open source solution, there are options like PyMT, which we recently saw on Create Digital Motion. And that said, there’s no reason you can’t try out both.)

And yes, someone has done Reason, too (poor-quality video, but gives you an idea).

Updated: As I’m posting this, I see that Oliver Chesler is writing about how effective touch interfaces can be for synthesizers – just using iPhone as the example (but the idea still holds). And, in fact, you don’t necessarily even need multitouch to make this work; single touch would be effective.

The example: an upcoming iPhone/iPod touch synth from the folks who gave us the Curtis granular synth, The Strange Agency.

Sound Scope Space for the iPhone [Wire to the Ear]

Sound Scope Space demo from strange agency on Vimeo.

Of course, I have to point out at this point, this is another reason that OSC (OpenSoundControl) support becomes essential. Whether or not conventional gear vendors adopt OSC, it’s a logical way to deal with the growing number of touch-enabled devices, from your own display to your iPhone.

I expect this could all accelerate as we near Windows 7′s release. (You don’t need Windows 7 – HP is doing just fine without it – but the presence of in-box APIs for paging through photo galleries and the like is almost certain to encourage Microsoft’s hardware partners.) Stay tuned.

More Examples

$200 Makes Your Laptop Touch-Enabled; Usine Music Demo

Sensomusic Usine + Ableton Live = Modular Touchscreen Interface

For that reason, you may be intrigued to see this video of Zen Piano, a demo app for the iPhone and iPod touch. The idea: respond not only to the position of your finger taps, but also to how hard you’re tapping the phone That promises “velocity-sensitive” tapping, which would make touchscreen interfaces more powerful.

Here’s the somewhat overheated description by GreatApps, who say their “patent-pending,” “cutting-edge” technology is the result of “having gone through the research and development phases.”

TapForce^TM has been developed from the ground up to provide a completely intuitive way of interaction for users. It can detect more than a hundred different levels of force, and has an accuracy that has to be seen to be believed. And all this can now be done in software, no hardware modifications are necessary. Hundreds of millions of devices currently on the market can make use of the TapForce^TM technology today.

A whole new range of games and apps has just been made possible.

http://greatapps.co.uk/technologies/

Okay, so what is it doing, exactly?

Most likely, it’s simply reading data from the accelerometer. Hit the device harder, and the accelerometer will respond to more force. That’s actually a fairly clever combination of two sensors – it’s just not the sort of stuff you’d necessarily want to trademark or try to get patented, at least, not if you’re a normal person. (TapForce creators, feel free to explain to us that you’re doing something fancier and I’ll eat my words.)

In fact, part of the reason I suspect that’s how they’re doing this is I’ve been tipped off by a developer who’s already implemented just this. He even uses a piano-style keyboard to show it off.

Sadly, that developer and application is Memo and his MSA Remote application, which was inexplicably blocked from the iTunes store – I think because whoever would have understood the app was on a lunch break or something. See, previously:

MSA Remote for iPhone

Apple Rejects Free iPhone Tool For Artists Because of “Minimal User Functionality”

But as it happens, this is something any mobile device can do that has an accelerometer. I may try something like this on the Android app I’m developing. (No one can reject that, because Google allows any application package to be installed on the device should the user chose to do so. Perish the thought.) Accelerometer data alone is usually not very useful, but combined with touch, it could start to make more sense.

It’s another reason to look forward to MSA Remote, and I do still think that the snafu with Apple will get cleared up at some point. (Unfortunately, what we had on CDM were a lot of rants – perhaps even justified rants – but not necessarily the best way to make the argument to Apple’s store.)