Course Projects

Vision course project

Extracts colors of the Rubik's cube from video in real time

vision detection tracking

Machine Learning course project

I wrote a small library for training Restricted Boltzmann Machines

learning rbm nerual network

Animation course project

Attempt to use classic Machine Learning techniques to learn a controller for a physics based biped.

physics controller machine learning

Learning Visual Saliency

Can we collect a database of gazes using an eyetracker, and then build a data-driven classifier for visual saliency? (ongoing course project)

vision saliency machine learning

Smoke Volume Acquisiton

Project involved shining coded light into smoke, observing results with a high speed camera, and using the video to recover smoke density in 3-space

graphics

Extracurricular projects for fun

Sketcher

Simulates an artist drawing an image

vision

Script Bots

Evolutionary Artificial Life simulation of robots who interact with each other.

artificial life evolution

Tetris AI

Program that can learns to play Tetris

artificial intelligence

4 Seasons Animation

Pretty animation of a tree through 4 seasons

computer graphics animation

iPhone app

I had a chance to develop an iPhone app. More than 1000 downloads, and >$1000 money made! :)

iphone

Mini-projects

Sketcher

The input to this program is a single image, and the program then draws the image from scratch, attempting to mimic an artist.



Description

On a high level, the program is very simple: I use the Sobel filter to approximate gradient direction and magnitude at every pixel. Then I start at a place with high gradient magnitude, and follow the direction while drawing. This effectively creates a single stroke. I stop if the magnitude gets below a threshold and repeat from somewhere else. A few more hacks and heuristics here and there are added to make the process look good.

vision animation computer graphics

Code

To my surprise I've actually received a few offers from random people that wanted to buy this program, but I will make the code available for free here. Coming soon! (I need to find it first :s)

It's implemented in Python and uses numpy, PIL, and pygame