Gazing Back at You: Responsive Typography and Face Tracking [Source]

Camera input is at last going from waving your arms around in front of the screen to some genuinely compelling ideas. And the more designers use the camera in fluid ways, the more expressive video may be as a means of interaction. Croatian designer Marko Dugonjić demonstrates a proof-of-concept implementation of typography that responds to your position. Using facial tracking, the text scales based on the distance of your face to the screen. The transitions are a bit jarring now, but it’s enough to suggest how this might work. http://webdesign.maratz.com/lab/responsivetypography/ There’s source code available for the head tracking on which …

READ MORE →

Face Substitution, Face Scrambling, Straight Out of Sci-Fi

Virtuoso coder and prolific digital artist Kyle McDonald is at it again, here in collaboration with similarly expressive and skilled coder Arturo Castro. Together, working in openFrameworks, they make use of a face tracking library to turn the image of a face into new, terrifying visions once imagined only in science fiction. Here, going beyond a pirate hat or mustache, they transform the appearance of the face. (I hesitate to use the word “avatar” because I start to think of 90s “new media” or James Cameron films, but — damn. Yeah. This is what everyone was imagining.) Arturo and Kyle …

READ MORE →

In Videos, Face Control and Prostheses Make the Craziest Sounds

You may have already seen FaceOSC, free software that eases the use of facial tracking from a computer camera for use as a controller, here with music software (top). Synthtopia picked up the story in July, featuring artist and engineer Kyle McDonald. But one FreeKa Tet has done his own implementation (second from top), and while the video is a bit grainy, he sounds wonderfully terrifying, as if his face is trying to slip out of The Matrix. Sometimes, I’m rendered entirely silent (no, really, it happens), and it’s best to let videos speak for themselves. So here, after the …

READ MORE →