Paper and experiment made as part of the course “Automatic Perception” on Medialogy, 4th semester (Aalborg University, Esbjerg – Copenhagen)
Date: June 4, 2003
Supervisors: Volker Krüger and Rune E. Andersen
Written by Camilla Bannebjerre Nielsen, Malene Benkjær, Maria Tønnesen, Mikkel Byrsø Dan, Morten Wang and Simon Lund Larsen.
Abstract
With the use of EyesWeb, we have tried to create an alternative way of controlling a movie- and sound-clip. We have succeeded in developing a system where you can play, pause and fast-forward the clip, zoom in/out and adjust the volume by using your hand and a red glove.
We have used color tracking to track the red glove and afterward performing blob tracking to output coordinates of the movements of the hand. These coordinates are used to perform decisions on which actions to do with the movie- and sound-clip.
We encountered different problems during the experimental work. Some of them were predicted already in the starting phase such as camera noise, resolution, change in illumination, incoming objects and “The Popcorn Problem”. The only problem still standing is the problem concerning incoming objects with the same color as the glove. The well-known illumination problem was partly solved by using the HSI color model instead of RGB. “The Popcorn Problem”, where the system doesn’t know if it is active or not, were solved by defining an open/close command that included clenching the fist.
All in all we have reached our goal, and we are satisfied with the outcome of the project and the final prototype of the Human Remote Control.
The report is divided into two parts. The first part summarizes all the theory used in creating the experiments and the experiments themselves are documented in part two. The theory covers areas such as convolution, digital filters, morphological operators, blob tracking, color models and other relevant subjects. The documentation of the experiments shows the step-wise development used to finalize the EyesWeb patch. The EyesWeb experiments were conducted with success, and the final version of our EyesWeb patch works accordingly to the goals we wished to accomplish.