Musicians and artists now have the power to fuse visuals, sound, and interaction, to make a spectacle, an album, and a game all at once. But with the blank canvas of three different media before you, what form should that fusion take?

Space shooters with pounding electronic beats behind them have cleared some of the way. Now it’s ambient music’s turn. In the game Osmos, you become a mysterious particle, floating amongst gravity wells in various fields of material. By carefully navigating, applying just the right vector force to move through the shifting landscape, you merge with other particles and escape to safety.

http://www.hemispheregames.com/osmos/

The move from “shoot stuff” to “move” or “eat” seems to be rising in popularity, with games like fl0w and Spore’s initial “cell stage” encouraging nonviolent navigation. To me, there’s something happening to the zeitgeist, perhaps a renewed awareness of cosmic (micro- or macroscopic) being, and of movement that draws on free-floating physics.

Even amongst a wave of games in this mode,when you actually play Osmos, you realize that it is something different and special. The design makes ingenious use of different kinds of movement and pacing through its different modes, at one point calling upon you to hurtle around a black hole, then move at nearly imperceptible speeds through a seemingly impossible-to-traverse petri dish of massive particles. No less than a shooter, it connects to the id and survival instinct. Pac-Man, the most successful arcarde game of all time, and one of the few that sucked in men and women in equal measure, was noted for its emphasis on eating as the mechanic. Consuming stuff appeals to everyone.

Of course, this is on a music site, and with good reason: what makes Osmos work is that Osmos is musical. It’s immediately beautiful and delicate, a perfect aesthetic union of the texture of the music and the on-screen arrangements of particles. More importantly, the music is woven directly into game play, providing subtle cues for dangers, and underscoring the pace of gameplay. You can only solve a level by managing speed and motion, and the music helps provide both the literal indications of speed and help your head get into the right zone to lose yourself in the world. If blips in early arcade games helped create a zone of play trance, now we have spectacular ambient soundtrack of music by Loscil, Gas/High Skies [Microscopics], Julien Neto, and Biosphere.

The music isn’t simply a beautiful soundtrack to the game. The game really feels like an extension of the world of the music. Put it all together, and something magical happens in this $10 game: you hear the music in a new way.

I spoke to the lead designer behind the game, programmer/animator Eddy Boxerman, along with musical-sonic collaborator Mat Jarvis aka Gas aka High Skies.

Peter: I found it amusing that some of the game press have stumbled around looking for a name for a new genre here, the "eat other stuff" category. To me, the basic game controls could be traced back to early titles like Asteroids. What are the games that have inspired you, either specifically or generally?

Eddy: Some people are dubbing the gameplay type as "eat ‘em up", as opposed to the classic "shoot ‘em up". But it’s true, the physics/controls have more in common with classic games such as Asteroids and Gravitar. The only "modern" game that otherwise influenced me was Katamari Damacy. It’s funny: when I sent out the first prototype to friends, I was concerned they would think the game was too similar to Katamari. That’s when I heard about flOw, which I’ve tried to steer stylistically clear of ever since. I guess it’s an archetype though, and the comparisons have been inevitable. As for Spore, Osmos was about one year into development when I saw the first preview footage of its "cell stage". On top of that, I learned that Will Wright had hired Brian Eno to do the music! I definitely had a "why should I bother?" moment at that point. But here we are, a couple years later, and I think we’ve managed to put out a unique game with a great mix of gameplay, sound, and visuals.

Peter: Ha – well, I’m glad you “bothered”! One thing that I think is really unique about Osmos is the gravitational mechanic. How did this come about?

Eddy: I was (and probably still am) a sci-fi kid. And when I read about real phenomena like colliding galaxies, retrograde planets, and the like, my mind goes to stange and wonderful places. That said, the Spacecraft Dynamics course I took during my engineering degree definitely played a large part in putting those mechanics and levels together. Thanks, Professor Misra! :)

Peter: How are the physical mechanics of the game constructed? This is essentially two-dimensional vector math, yes? Were there refinements you needed to make in order to keep performance up, or to keep the levels playable?

Eddy: That’s a big question! But yes, essentially it’s 2D vector math, though we make use of some 3D math (including quaternions) on the particle systems. The majority of the physics is quite simple though — first year bachelor’s stuff: F = ma, conservation of mass and momentum, gravitational laws, basic time integration, etc. We follow the spirit of the laws, but not always the letter. For instance, if you look at the Earth’s solar system in its entirety, you wouldn’t even see most of the planets; that doesn’t make for a very playable game though. As such, we took many liberties when it comes to scale, constants and exponents in the equations. The majority of the work was in the tweaking of those values to make the game /feel /good.

Peter: How did you prototype the game? What was the process of evolution like? Were there any failed attempts along the way?

Eddy: I put together the first prototype starting from a NeHe OpenGL tutorial. I added some basic physics, mouse controls, some highly unoptimised collision detection code, and voila, I had something to play with. After that, I immediately integrated [cross-platform 3D audio API] OpenAL, as the game was just begging for sound and music. I then hunted for some good sounds (discovering freesound.org in the process), put together a simple looping song (my first rough and humbling attempt to create digital music), and sent it out to a few friends. I’ll make that version available for free someday… when I’m feeling brave.

As for failed attempts, there were tons of shelved experiments and features that were cut. One interesting problem was the difficulty curve of the gravitational levels. In fact, the first gravity levels looked a great deal like the "Warped Chaos" levels do today: several free-floating Attractors in a sea of regular motes. I found it incredibly difficult, however, to make a "beginner" version of those levels. If the gravity was too weak, the Attractors had little apparent effect; too strong, and the level became incredibly difficult. I stuggled with this for a long time, until I hit on the idea of putting one, immobile Attractor in the center, with everything else orbiting around it. This allowed for the creation of systems with strong gravity effects, but long-term stability. It seems so obvious now, especially given the example of our solar system, but it wasn’t back then. In the end, these are some of the coolest levels in Osmos — practically its "signature" level type. Moral of the story: necessity really is the mother of invention.

Peter: What is the visual engine like? The sound engine?

Eddy: As I mentioned, I bootstrapped from a NeHe tutorial, but that’s all been replaced at this point. It’s now a homegrown engine using OpenGL. It doesn’t make any use of pixel/vertex shaders, so it runs on a wide variety of hardware. The majority of our texture work is done in Photoshop.

[The sound engine is] a wrapper we’ve built around OpenAL. At a basic level, all we ever do is mix and adjust the gain and pitch of our sounds and music. This allows us to run on generic sound hardware. But we do make extensive use of those "effects", and it’s possible to get a great deal of variety and feedback with them. In the end, it’s all about the quality of our sound sources, and the algorithms that adjust and smooth the gain and pitch of each.

Peter: For pitch shifting, were you able to do that natively in OpenAL?

Eddy: Yes, OpenAL supports pitch shifting at the software level. I ported our sound engine to use DirectSound at one point, and found that it’s pitch shift range is rather limited. We reverted back to OpenAL.

Peter: One thing that really strikes me about the game that is its use of pacing. Even without the obvious technique of allowing the user to control speed, there’s this extraordinary contrast between levels that require you to move quickly, that require you to anticipate the rate of movement along a vector of other objects, or that require you to move almost imperceptibly slowly. Was this an early goal, or something that evolved out of developing the game concepts?

Eddy: It evolved from the game concepts themselves. We tried to fully explore the fundamental controls and game space of Osmos, and converged on a number of interesting regions and structures that were fun to play with/in. Some people actually "complain" that the pacing of the game isn’t consistent across levels — some are fast, some slow — but that wasn’t our goal. In a sense, we’re merely presenting the results of a great deal of research and exploration into the space, with our sole requirement being that the levels are fun and interesting. We wanted it to be a game of concepts and understanding, not speed. The addition of time-warping allowed us to break free from that, expand our scope, and include a much larger variety of levels, as some have both fast and slow moments in them; we wanted the player to be able to control the pace and difficulty to their level of comfort.

Peter: Connecting the action to music, how important is the use of music in conveying time?

Eddy: I think pitch-shifting the music and sound effects helps players track time-warping in an inutitive way. Without these aural cues, the mental connection would be incomplete. That said, I sometimes test the game without sound, and it’s totally playable — just much less immersive.

Peter: At what stage did you involve the musical element? How was that relationship established?

Mat: Eddy first contacted me two or three years ago about using one of my tracks on Osmos (“Gas – Discovery”). He sent me a basic alpha version where the game was literally flat circles on a plain background, but even back then with the simple graphics and no sound it was compelling. I think it was at this early stage that I sent him a copy of another High Skies track, “The Shape of Things to Come,” which he also used a section from. It wasn’t too long later that he sent me a version of Osmos with most of the music that made it to the release version and it all just complimented each other beautifully.

Eddy has done a great job choosing music that compliments the game and graphics, and they also compliment the music. I think he’s done a great job overall as well, keeping his vision consistent for the look and feel of the Osmos world. Even though some of the levels are quite varied; some are quite chilled, others fast paced, nothing seems out of place. He has created a new world that’s both microscopic and macroscopic.

Peter: The musical and sound effect elements really do blend effortlessly. Mat, I know you made substitute sounds – how did this help blend the aesthetic?

Mat: I made the rebound noise when you bounce off the walls/ boundary. The original sound was quite hard and metallic with a lot of reverb, and I suggested a softer echoey sound. There was nothing wrong with the original, but it made the boundary feel quite hard and cold like being in a metal tank. I sent Eddy some analogue samples, using a [vintage Roland keyboard] Jupiter 6 with varying delays/ echoes. Because the tones are so pure and tuned, Eddy pitched them slightly to fit with the various keys of the different music.

Eddy: In general, it was a matter of searching and experimentation for the "right" set of sounds that fit well together — which can be a lengthy but rewarding process. Once integrated, minor gain and pitch adjustments helped fit it all together.

Mat provided the bounce sound, as well as the continuous absorb/being-absorbed sounds. The other sounds were created/shared on freesound by the users Elektrocell, fran_ky and Jovica. (Check out the Osmos credits in the readme.html for details.)

Peter: I recently spoke to Crystal Method, and while they’ve done some notable game scores, they actually said they wouldn’t want their music to be placed in a game context at which the speed changed, that it’d lose something. This seems like the opposite of that. Now, maybe it’s easy to take for granted with ambient music as opposed to something beat-driven like Crystal Method, but do you think there’s something special that allows this music to be adaptive in that way?

Mat: I think that in the right circumstances music with drums could work well and may even highlight the time-shifting more. Of course with the wrong game and wrong music it could sound terrible too.

Eddy: It’s a delicate issue. Out of the context of the game, I think it would seem wrong. There were also some pieces of music I tried which didn’t lend themselves well to this kind of manipulation, and which didn’t get included as a result. But with these songs, and everything working together in-game, I feel the whole experience is stronger as a result. I’m just glad Mat and the other artists agreed — or at least… didn’t object. ;-)

Peter: Hey, I think if you can write music that sounds good played at a different speed, that’s nice.

Osmos seems to me a musical experience, in that the sense of the music is transformed by the visuals and the interaction with them. Do you think it’s possible that audiovisual interfaces could go even further in terms of their impact on the music?

Mat: Yes, it almost seems as though Osmos creates a world for the music to exist.

I’ve always liked music visualisers like the Processing and Cymatics stuff, they’re quite compelling to watch how they react to the music, so it would be interesting to go the other way; by manipulating/ sculpting abstract shapes which then modify or even create sounds and music, especially using the new controllers like the Wii, [Microsoft’s] Project Natal and Sony’s Motion Controller instead of the mouse.

Eddy: I totally agree with Mat. Yes, please! More feedback between music, visuals and interactivity — in all directions. I’d love to experiment more on all of these fronts. In general, I think games such as Audiosurf and Auditorium, while great, have only begun to scratch the surface of what’s possible. Interactive musical "toys" such as [Nintendo/Toshio Iwai’s ]ElectroPlankton or Dub Selector are another great direction; and Rock Band Network is about to expand the market in a huge way. It’s exciting!

Peter: Along those lines, this is obviously a new take on music distribution in a way that goes well beyond what titles like Rock Band have done. Are there other cases in game history that to you have done that? Is there potential in these new outlets, outlets that are more accessible to independent developers (Steam, Direct2Drive, Xbox Live Arcade, iTunes App Store), to really change game development?

Eddy: Wow, that’s another big question. Really, I just felt the music was such an important part of the experience in Osmos that we should show the artist and track names during the game. But now that you mention it, I can’t think of another game that has done this, besides games like Rock Band where the song /is/ the game/level. That said, one way I’d love to push this evolution is to "augment" music videos with interactivity: ie. into music video-games. (The term "game" could be used rather loosely here.) Everyday Shooter does this, though Jon Mak actually created the music /for/ the game in that case — which rocks — but collaborations could lead to some really amazing things in this direction.

Peter: Eddy, Mat, thank you. Whether it’s in the form of a game or an audiovisual performance, we’ll certainly continue to explore these areas. And – hint, hint – Osmos 2, with multiplayer? Just a thought.

Osmos Trailer from hemisphere games on Vimeo.

Take a weekend, and make something: that’s the challenge behind the Music Hack Day, which joins a growing phenomenon of events built around collective creation. (CDM held its own tangible interface hackday online, which I definitely hope to follow up soon!) Initiated by Dave Haynes of music sharing service Soundcloud, the Hack Day has already hit London. Many of the events were Web app-based and focused on consumption rather than creation of music, but we also saw a chordal synth plug-in and beer bottle percussion instrument.

The Berlin Hack Day, which wound up earlier today, offers still more projects focused on the creation side of music hacking. Having Ableton and Native Instruments as sponsors likely helped the mood. And as you’d expect from one of the world capitals of creative hacking, Berliners don’t disappoint.

Among the projects: a beautiful, elegant 3D sequencer, a fun bird-and-sky multitouch soundmaker with multitouch trackpad input, and a robotic xylophone controlled by monome. Someone even worked out a way to turn NI’s Maschine into a rhythm game, complete with Street Fighter sounds.

I’ve got some of my favorite projects here, but see also an eyewitness report (in English and Italian) at Audio News Room:
Just back from Music Hack Day Berlin
… and keep your eye on the wiki:
Berlin Hack Submissions

xylobot run by monome from robb on Vimeo.

Monomist Rob Böhnke and Ramsey Arnaoot created one of my favorite hackday projects so far: a monome-controlled robotic xylophone. The ingredients: one monome grid controller, one Java application for step sequencing to the output, one Arduino open source controller board, and one terrific xylophone “robot” made of an array of servos that strike the bars of the instrument. Oh, and some hot glue and wood, of course.

Project details

Debugging

Audio loop

Of course, what’s especially impressive is nailing this in just a weekend – imagine what they could do with more time and iterations.

Proof that musical visualizers don’t always have to be trippy, futuristic, Tron-like 3D landscapes (and that’s me speaking as a fan of such things), Gernot Poetsch instead chose a whimsical environment with clouds and cartoon birds, inspired by the graphic identity of Twitter. (No actual Twitter is involved, meaning you lose the, ahem, unreliable, buggy, unfiltered chat network but keep the cutesy happy sky! Works for me!)

The visuals are built in Quartz Composer, which via OSC transmits messages to synthesis language ChucK for noisemaking. The surprise is, the multitouch input is not a Lemur or an iPhone – it’s the new MacBook touchpad under Snow Leopard!

iLoveAcid is a beautiful-looking nodal sequencer by Jakob Penca which uses wireframe “tracks” to guide music playback through a sequencer, transmitting events to your soundmaker of choice via MIDI or OSC. By using curved timelines and connections, it’s a veritable model railroad of music, in which formations combine to form more complex structures instead of simply stepping across a grid. Despite appearances, it is so far only two-dimensional – but then, the z displacement could easily be assigned to some form of modulation. I’m really eager to see the video of this.

One ingredient: Processing, which makes it easier to write visual code and to connect to Java libraries.

Project Page

The hardware controller for Native Instruments’ Maschine software drum machine has been adapted to other software, like Ableton Live. But this is surely the first time it’s been made into a game. Using Maschine’s MIDI output as a game control and sounds from Street Fighter, MaschineFighter is a simple, Simon-style rhythm game. Unlike Simon, though, there’s a twist – instead of rote patterns generated in advance, you face off against a friend and try to out-rhythm each other, battle style. I think it’s actually a pretty brilliant idea, and could become a new sensation for us electronic music nerds – not to mention, it’ll finally test our rhythm in a way electronic performance often does not. (Correction: It is Mac-only, making use of the PYMIDI Objective-C based library, which, since everything else that starts with “Py” usually means Python – a la jThings that mean Java – I assumed, incorrectly, was built on Python. But anyway, if you like the idea, carry on! And, actually, having a pure Objective-C CoreMIDI interface is also pretty awesome.)

Hoping for a video of this, too.

If you have a project that didn’t make this list, or if you add documentation after the fact, let us know.

Performance with Cubie from sadmb on Vimeo.

Music sequencing as a Rubik’s Cube-style game, or hypnotic, kinetic rotating wheels – your piano roll won’t know what hit it. New musical art is set to be performed in Argentina, but you can download both tools, free.

Computer interfaces for music date back decades now, but with ingrained notions of hardware sound sequencers, linear media like tape, and hundreds of years of notation in staves and bars, old habits can be hard to kick. Yet it seems that suddenly, a younger generation of audiovisual composers is exploding notions of how musical interface and sequence could work, fully embracing a virtual space in which they themselves have come of age.

Next month’s spectacular-looking 404 Festival could make anyone want to book a flight to Argentina. Two highlighted artists from this festival for me really embody the possibilities of new sequencing metaphors. Both are built in Java.

At top, Cubie by Sadam Fujioka of Japan is free, downloadable software that combines audiovisual performance and game in a rotating cube.

Cubie is a software instrument which provides innovative idea of musical performance, differs from existing musical performance system such as musical notation, DJ systems, DAW systems, etc… It has a novel concept incorporating a new interactive technique based on puzzle games. Music is represented from highly saturated colored letters on a 3D cube. Almost unlimited number of melodies and rhythms can be created from a combination of those letters, and it can be changed on real-time by operations based on puzzle game. Those playful operations push a performer to play repeatedly and get the skill of performing with Cubie. Cubie is free software and you can play just like sadmb do.

More information in both Japanese and English at sadmb site (with lots of other software, as well). Built in Java with the use of JSyn for synthesis.

http://sadmb.com/

If these cubes feel overly rigid to you, though, and you don’t like the mechanical repetition of these lines, enter the crazy, spinning world of Hiroshi Matoba.

Hiroshi Matoba: OVERBUG from antjeverena on Vimeo.

Overbug is a music-performance tool designed to compose Minimal and Dance Music.

Through looping and newly arranging sound patterns, called ‘Bugsounds’, the program creates complex, polyrhythmic sounds. Overbug differs from conventional linear controlled music sequencers, which arrange the sound into a linear timeline from left to right. In Overbug the sound arrangement of the repeating music loops is equal to the visual abstraction of circular actions which built the interface through circles.

I showed a very early sketch I was working on last year of a circle-based sequencer, also built in Processing, though (cough) my chops are nowhere near Hiroshi’s. I was more interested in using the circles to subdivide cycles, as in Indonesian music. Seeing this piece is a major kick in my pants to try to work on my project a bit more and go a different direction.

Here’s a demo video explaining how this works:

More information + free download (just updated this month):
http://www.dominofactory.net/Overbug/

If You’re in Argentina

Don’t miss a terrific-looking exhibition of Japanese works and the rest of the
http://www.404festival.com/
(info in Spanish + English)

These two works clearly belonged together, but I feel bad for not featuring any Latin American (or Argentinian, specifically) work — those of you associated with 404, if you’ve got hot tips, send them in.

As an addendum to the last story, Ivica Ico Bukvic sends along an example of the [myu] Max/MSP + Unity game engine combination in action. Here’s the surprise: Unity isn’t generating visuals. Instead, Unity simulates ripples created by movement in the space, and builds physical models that are sonified and spatialized by Max/MSP.

Speaking of work involving art museums and the combination of Max and Unity, VJ Anomolee notes in comments his own work with the pairing. Lightbent Synth is an in-progress piece with alternative controllers and sensors that produces sound with a novel visual representation (sound’s very quiet in this preview — more hopefully once it progresses):

Lightbent Synth from VJ Anomolee on Vimeo.

Ivica explains the top work:

This past fall [myu] had seen its first real-world implementation in an exhibit that was a part of the grand opening of the Taubman Museum of Art in Roanoke, VA (http://www.taubmanmuseum.org/). The exhibit utilized [myu] as part of an interactive aural installation titled "elemental." An online tech
demo video of the installation, including written synopsis is available also via Youtube at http://www.youtube.com/watch?v=PA-9BOgc1gk. Below is a brief synopsis of the installation:

"elemental" interactive communal soundscape premiered in November 2008 as part of the Revo:oveR collection commissioned for the grand opening of the Taubman Museum of Art in Roanoke, VA. The Youtube video focuses primarily on the technical aspects of the installation. Using Max/MSP/Jitter, a homebrew IR webcam with fish eye lens and a LED-based IR spotlights, entire 24×36-foot exhibit space is converted into an aural sandbox giving visitors an opportunity to generate and shape the
ensuing soundscape. Positional data of up to 20 visitors is forwarded to Unity3d using [myu] Max-Unity interoperability toolkit developed at DISIS (http://disis.music.vt.edu). Unity is used for physical simulation of ensuing ripples and the resulting data is sent back to Max for spatialization across a 12-channel (4×3) ceiling-mounted speaker array. Driven by communal interaction, virtual ripples refract from each other spawning an algorithmically generated aural fireworks. The exhibit ran non-stop for approximately 5 months until March 2009.

Bonus video below: an early prototype that did include visuals. After days of looking at emulated knobs and faders, it certainly does speak to some of the possibilities for musical interface and expression.

Take a powerful game engine (for animation, 2D and 3D graphics, physics, and on-screen interaction). Add the flexibility of a visual development environment for programming with virtual patch cords, for rich sonic and musical capabilities plus easy interaction with data and input. That’s the idea of combining something like Unity 3D with Max/MSP. In the example from earlier today, the solution simply routed basic data from a Unity-based game to a responsive music engine in Max.

In the case of [myu] – the Max Unity Interoperability Toolkit – that integration goes further still. Developed at the DISIS (Digital Interactive Sound & Intermedia Studio) at Virginia Tech, [myu] allows bi-directional integration of the Unity engine with Max or Pd. The two tools use netsend/netreceive to send data via TCP and glue the two together.

For visualists using Jitter, you can even exchange texture data, which offers some mind-blowing powers for live visuals.

Download at Virginia Tech — bonus, an extension of the aka.wiiremote object so you can use the lovely Wii Fit controller, among various other projects
Discussion on the Unity Community Forums
Discussion on the Cycling ‘74 forum
Virginia Tech DISIS

As an interactive prototyping tool, this should have a lot of potential for lovers of patch-style programming.

Thanks to Dr. Ivica Ico Bukvic, DISIS Director and researcher, for sending in his project. I’ll be curious to see what other people might do with this.

This Thursday night, if you’re in NYC, you’ll want to be in Brooklyn – and around the world, stay tuned as always to CDM.

Handmade Music projects will again explode into the nerdster party in Brooklyn, with more ways to get involved worldwide. The science fair-meets-music lounge event hits Thursday night, and this time, you can walk home with your very own noisemakers – no musical or electronic experience required.

Tristan Perich, composer, sound artist, inventor, and 1-bit music maker will be onhand from Loud Objects to share the Noise Toy kit. He’ll walk you through making one, talk about how it works, and we’ll make a little racket.

And once we get a few of those kits made, you’ll be welcome to join in an impromptu Noise Toy Ensemble!

If you fancy higher-fi, digital music and virtual reality, we’ve got you covered, too, with a whole bunch of software projects.

• Noise Toy workshop with Loud Objects / Tristan Perich: Learn how this cheap kit can make glitchy sounds like Bzzzzrrrreeeeepehkhkhkhhhhhhhk! Workshop + kits – make one for free, $10 suggested donation to take it home!
• Force fields: Pulsantes is pulsating musical sequencer software with interconnected rings and force fields generating rhythms, created by Spanish artist Jaime Munarriz. (Jaime can’t be there, so I’m bringing his work!)
• Nintendo instruments and organic musical chemistry: glitchDS is a free cellular autamaton-based musical sequencer, ported from Nintendo DS to PC/Mac – this and other sound toys by Bret Truchan.
• Artificial musical realities: jReality is a Java library for creating real-time interactive audiovisual apps in 3D, with fully three-dimensional sound and visuals, motion tracking, stereo projection, and more. Peter Brinkmann shows off the work of the jReality project, including his own sound components.
• Wireless Sound Objects by Eric Beug are the equivalent of a wire-free modular synthesizer, for improvisation, performance, and education.
• Free business-card kits for exploring basic sound circuitry from PAiA didn’t ship in time for last month’s event, but they’re here now — get your free kit while they last, then draw your own sound controllers with pencils!

Presented by createdigitalmusic.com with our friends at music trend-setters XLR8R.com, DIY bible makezine.com, and self-made marketplace Etsy.com

Hosted by artists’ facility and happening location 3rd Ward

7:30pm, Thursday, March 19 – FREE!
3rd Ward is located at 195 Morgan Ave., at the corner of Stagg St., in East Williamsburg, Brooklyn.
(near the Grand St L train)
Directions
RSVP: handmade@3rdward.com

More on the projects – and many of these are available online, so I’m still working on ways of holding virtual Handmade Music parties, too.

Noise Toy Kits

with Tristan Perich (Loud Objects)

Bzzzzrrrreeeeepehkhkhkhhhhhhhk! Build your own Noise Toy with this kit from electronic noise group the Loud Objects. Plug in your headphones and glitch out, or jack into an amp
and play it as an instrument. These kits come with a custom-printed circuit board, a noise generating microchip from their live performances, two buttons for modulating the sound, headphone jack and battery.

We’re asking for $10 parts if they keep the toy, and they’re welcome to just make them for free if they want.

We’ll jack in noise toys to the mixer for the end of the evening to make a Noise Toy Group Performance! Stick around (maybe have a couple of beers if that helps your Noise Toy technique).

Wireless Sound Objects

by Eric Beug

Wireless Sound Objects are like the modules of a modular synthesizer, exploded into individual physical objects that provide an engaging way to experience unique, collaborative, musical process. They exist as a variety of objects that either make sound or control the sound that other objects are making. These objects can interface with a computer, with other existing music hardware or be used as a stand alone system. They can be used for performance, recording composition, improvisation, and education.

Wireless Sound Objects

jReality: Virtual-Reality Audiovisuals

Sound for the jReality environment by Peter Brinkmann

jReality is a Java library for creating real-time interactive audiovisual applications with three-dimensional computer graphics and spatialized audio. Applications written for jReality will run unchanged on software and hardware platforms ranging from desktop machines with a single screen and stereo speakers to immersive virtual environments with motion tracking, multiple screens with 3D stereo projection, and multi-channel audio. I would like to present an overview of the capabilities of jReality as well as a discussion of its design, with an emphasis on audio.

jReality: http://www.jreality.de/

VisorLab: http://math.sci.ccny.cuny.edu/pages?name=VisorLab

GlitchDS to Roland TR-606 Sync Using Nintendo DS Trigger Mod from LifeInABox Productions on Vimeo.

glitchDS Comes to the PC + Mac

by Bret Truchan

This is Bret. ( I made glitchDS, repeaterDS, cellsDS, and Quotile-Sequencer). I’ve nearly complete with a cellular automaton MIDI sequencer written in Processing for the PC and Mac. It’s modeled after glitchDS. Same look, similar controls, etc. I made it mostly for myself but I’ll be releasing it free very soon. I read about your Handmade Music night and think it’s going to be great fun.

I’m bringing a netbook loaded with the new sequencer and a MachineDrum.

Pulsantes

by Jaime Munarriz

Pulsantes is a Processing work in progress. Simple pulsating objects generate rythms within their inner structure, visible by their coloured rings, and they are interconnected, sending messages to each other.

At the moment, messages stop/start other pulsantes. I’ve tried an slaving relationship, with a dominant imposing his own tempo to others when they move nearby.

The background acts as a force field. One idea, implemented at some of the sketches, is to alter the way the pulsantes react to this forces, being atracted or repelled. The performer can change this, converting the environment into an instrument. I plan to include wind, explosions, that you can control when performing with this system.

Check out this project (among others):
http://tagmagic.wordpress.com/

The idea of the Reactable is to make music tangible, with control of sound mapped to physical objects you move around on a table. But that hasn’t stopped the Psychosynth from creating a virtual version. (Upside: it’s a lot more portable.)

Psychosynth

Watch the video, but they seem to have made the opening minutes as dull as possible to thin out the non-believers. Skip past the generation of the white noise oscillator (wow, white noise!), and somewhere around halfway through, it becomes laugh-out-loud funny, with trance-style vocals about freeing your mind with free software. (Seriously – it’s awesome.)

While it’s in alpha stage, the software is fully free and open source (binaries available for Debian and OpenSUSE) – and that means this could be a good project to snoop around in or code through, those of you who are eager hackers.

At its heart, it’s simply an interactive modular synth inspired by Reactable. Drag objects around and connect them to make sounds and patterns. Underneath is a powerful C++ synth library, a 3D synth, and even a server version – so even if you aren’t sold on this interface, there are pieces here that could be useful. It’s all virtual now, but that’s not to say you couldn’t add input; support for the input library is planned later.

That said, I don’t think they went far enough with the virtual thing. Next, why not simulate virtual players for the virtual Reactable inside the computer. They could even behave like Sims, requiring regular stimulation and bathroom breaks. Eventually, you could unlock Bjork.

Enjoy. If anyone gets this up and running even in alpha state, let us know.

Previously: tables and tangible, like the lovely acoustic sounds of Etiquette and, of course, Spaces / Roots

Processing 1.0 has finished final release status. Why that matters, on Create Digital Motion:

Processing: Revolutionary Creative Coding Tool Now 1.0, No Longer Beta

In my mind, it’s certainly one of the most unusual betas in creative software history. Why this is important for music:

• Recent versions of Processing include the very stable and wonderful Minim audio library
• Processing makes an excellent tool for creating unusual graphical front ends for music, with tools like Reaktor, Pd, Max, SuperCollider, ChucK, Ableton Live and many others handling sound (more on that in a story tomorrow)
• Updates make Processing far more predictable and flexible across platforms, particularly when using new versions of Mac OS, Windows, and Java
• Better, more stable OpenGL rendering makes your software look fantastic, and this is a lot of the change that’s happened in recent builds

But it’s better to show that rather than talk about it. Stay tuned. Look at me: still talking when there’s science to do!

The rumor mill’s conventional wisdom is that iTunes 8 will be part of Apple’s music-themed press event next week. That’s a safe bet — iTunes 7 is clearly due for an update. But Allan White has some interesting speculation with which I’m inclined to agree. There’s an excellent change Robert Hodgin’s excellent Magnetosphere visualizer is going to become an official visualizer for iTunes 8. That’s be a big win for Processing (site | cdmo tag), the visual code “sketching” tool — and a likely time suck for your productivity next week, if true, as you stare into its hypnotic pulsing orbs. (Just fair warning.)

Allan White writes on his blog — a lovely visit for fans of music and visualization:

[Robert] Hodgins built a wonderful iTunes visualizer called Magnetosphere a while back – which mysteriously disappeared from his site a few months back. I wrote him, and he said that it had been sold to a third party. There’s strong evidence that this third party is in fact Apple, and that it may ship with iTunes 8, which could be shown as soon as next week at an iPod Event.

iTunes 8 Rumors: is Magnetosphere the New Visualizer?

One way or another, it looks like we will be getting the visualizer. And getting it officially would be terrific — it’s about time the fairly moribund world of visualizers was reignited. (Just remember, musicians, work with a real VJ/visualist when playing live for the full experience. End public service announcement.)

Magnetosphere Video
(Above, a reskinned take on the original — Robert does wonderful things with iterating his code)

Magnetosphere iTunes Plugin Page

Flight404 on Create Digital Motion

DIY 3D Interface: Tic Tac Toe from Kyle McDonald on Vimeo.

The Theremin, not too far off from its one hundredth birthday (start planning now), was a breakthrough in enabling a touch-free gestural control in space. Using the same principle that allows the Theremin to sense hand position, Kyle McDonald has created a 3D interface, and posted the process on Instructables. CDM gave him some of the inspiration:

Your recent post, "Theremin as AV Controller", inspired me to finish an idea that’s been living in my sketchbook. It operates on the same capacitive sensing idea as the Theremin, but in 3D — using just an Arduino, aluminum foil, and six resistors. I’m planning on using it as an instrument, interfacing with a wave terrain synthesis system. In the meantime, I put together a demo video and an instructable so other people interested in alternative controllers can experiment with it. The code is in Arduino outputs coordinates via serial, and the example code is done in Processing, so it’s only minutes from interfacing with your audio/visual tool of choice.

In the spirit of sharing, Kyle says he’d be happy for people to improve on the design: “If you think you can build one that is simpler and equally accurate, or slightly more complex and more accurate, share in the comments!”

DIY 3D Controller @ Instructables: “Make a 3D interface using an six resistors, aluminum foil, and an Arduino. Take that, Wii.”

Here’s the original post, which came from our friend Sarah Angliss, who’s been using the Theremin as a controller for A/V sets in Max/MSP/Jitter:

Theremin as AV Controller: Technical Details from Spacedog

Updated: Kyle writes with some additional details on what he’s doing musically, and from where he draws some of his inspiration:

I developed this as part of a wave terrain synthesis system. First, you would initiate a virtual 3D space with a "pressure field", so if you traced a path through the space the result would be an audio signal. Imagine instantaneously freezing the air in a noisy room, and moving your ear through the room in various paths at the speed of sound. If you moved towards a sound source, you’d hear the sound like normal, if you moved away it’d be in reverse, assuming it is radiating omnidirectionally you could move in a circle around it and not hear the sound at all. Something like "aural bullet time"? The interface is for tracing, selecting, and modifying these paths. Separate gestures are used for looping the paths, controlling their rate, etc.

[1] http://www.lovid.org/synths/syncarmonica.htm
[2] http://www.turbulence.org/Works/arcangel/
[3] http://www.oskarfischinger.org/Sounding.htm
[4] http://www.seeingwithsound.com/
[5] http://ccrma.stanford.edu/~woony/software/sonart/
[6] http://webcenter.ru/~vsoft/BitmapPlayer.htm
[7] http://www.nicolasfournel.com/audiopaint.htm

Look forward to hearing comments from readers, or (especially) related ideas!