Kinect and Processing by Daniel Shiffman

I decided to refamiliarise myself witih the technical aspects of using the Kinect to track objects infront of it. I came across this brilliant guide, written by Daniel Shiffman. He's written books on Processing and also teaches it, so his instructions are always very thorough. I am looking forward to putting this together!

Tracking

The real magic of the kinect lies in its computer vision capabilities. With depth information, you can do all sorts of fun things like say: "the background is anything beyond 5 feet. Ignore it!"

Source: http://www.shiffman.net/p5/kinect/

The above link will take you to Shiffman's guide, whereas the links below are responses to his work and are worth having read.

• https://forum.processing.org/topic/kinect-and-opencv-blob-tracking
• https://forum.processing.org/topic/another-osx-kinect-library

Notes

Unfortunately, b/c the RGB camera and the IR camera are not physically located in the same spot, we have a stereo vision problem. Pixel XY in one image is not the same XY in an image from a camera an inch to the right.

Although this isn't much of an issue, since I don't need per-pixel accuracy, Daniel recommends reading http://nicolas.burrus.name/index.php/Research/KinectCalibration to get a better idea of how to calibrate the Kinect.