Tom Cassey, Tommy Chheng, Jeffrey Lien
We introduce a system to track a user’s hand and head in 3D and real-time for usage with a large tiled display. The system uses overhead stereo cameras and do not require the user to wear any equipment. Hands are detected using Haar-like features with an Adaboost classifier and heads are detected using Hough transforms generalized for circles. Three-dimensional values for the hand and head are obtained by correspondence matching of the paired cameras. Finally, a 3D vector is extrapolated from the centroid of the head to the hand. A projection of the 3D vector to the large tiled display is the pointing location.