Category Archives: Computational Photography

Slithering: trading dimensions in video

Computational photography is a wide concept with many possible interpretations and directions. I couldn’t choose one project for the course, so I made two, and showed them with my classmates at Pixelache in Augusta Gallery. One project was an extension of some earlier computational photography experiments with Flash+webcam, called PaintCam. The other was a collaboration with Timo Wright called Slithering.

We shot two dance scenes, one with Anna Mustonen and the other with Lucía Merlo, Charlotte Lovera, Elise Giordano and myself. Thanks to Lume studio for helping us set up the lights.

We shot HD video with the Canon 5D Mark III. We thought that it would be important for the dancers to have a preview image to see how different movements would affect the final image, so I made a Processing sketch that would approximate the aspect ratio of the 5D’s output.

Now... how to turn this into a self-texturewrapped 3d model?

We used Kinect for the preview, with the idea that the depth data might interesting to use somehow in the final. The slitscan video (three dimensions shuffled) ended up interesting enough that I left the depth data for future experiments. What could four shuffled dimensions look like?

This is the description that Timo came up with for our piece when we were thinking that the final product of our piece would be still images:

Slithering is a alternative dance documentation where the dancer dances and reacts with the Slithering program. The program scans from a camera a one pixel wide segment and orders these segments to become one long picture in time. In this project the dancer has to find a completely new kind of movement, if she wants to control the visual end result. It also changes the documentation of dance in time and space to now happen only in time. What is dance minus space?

Slithering single still 2

Slithering single still 3

Slithering group still 3

Slithering group still 4

To make the first still images, I wrote a Photoshop script that would take one column of pixels from each frame of video. It took ages. I noticed that changing the column variable ended up with a very different image. What would they look like animated? I managed to write my first C++ application, with the help of Cinder, to shuffle the billions of pixels from one video to an output video. The source for Redimensionator is available freely, without warranty. Here are some experiments with the software, Redimensionating some videos found on YouTube:

Redimensionator wasn’t written until after the dances were filmed. We had the still-image preview while dancing, but had no idea what it would look like in Redimensionated video form. In the future, it would be fun to choreograph a dance piece or music video with the output in mind. Putting some planning into costumes, props, and choreography could make for very interesting output.

(Cross-posted to the new Media Lab Helsinki students blog.)

Introducing PaintCam

I joined the Computational Photography course in November of last year. We were working towards presenting at Pixelache, and it was nice to have the goal of showing some work outside of our little Media Lab family here. I couldn’t decide on one project, so I took on two: Slithering and PaintCam.

PaintCam is an extension of the MegaCam app that I started last year while living in beautiful Tomahawk, NZ. Some of these webcam toys were inspired by Lomo cameras, but this one goes beyond imitating analog photographic effects. My goal was to make a single-purpose application that allows you to composite short video loops in real-time. It works like a paint application, but instead of a color chooser you get the color, image, texture and motion from the webcam.

If you would like to try PaintCam, go to I don’t have a one-click method for saving the animations yet, but if this form doesn’t scare you off you can upload the 3×4 frame image to your favorite image host site and put the image url in. Send me any nice ones that you come up with.

It was fun to see people interacting with PaintCam and the other webcam toys in the gallery setting.

Sembiki-KaleidoCam-1300027890 Sembiki-KaleidoCam-1299939176 Sembiki-ScanCam-1299933667 Sembiki-ScanCam-1299929361

More images made by Pixelache visitors.