Hand gesture spotting and recognition using HMMs and CRFs in color image sequences release_5nxuxsugmjdupmxclcmn3nay5a

by Mahmoud Othman Selim Mahmoud Elmezain, Universitäts- Und Landesbibliothek Sachsen-Anhalt, Martin-Luther Universität, Ayoub Hamadi, Bernd Michaelis

Published by Universitätsbibliothek.

2018  

Abstract

Even though automatic hand gesture recognition technology has been applied to real-world applications with relative success, there are still several problems which need to be addressed for wider applications of Human Computer Interaction (HCI). One of such problems which arise in hand gesture recognition is to extract (spot) meaningful gestures from the continuous sequence of the hand motions. Another problem is caused by the fact that there is quite a bit of variability (i.e. in shape, trajectory and duration) in the same gesture even for the same person. Throughout literature, the backward spotting technique is used which first detects the end points of gestures and then tracks back through their optimal paths to discover the start points of gestures. Upon the detection of the start and the end points, in between points trajectory is sent to the recognizer for recognition. So, a time delay is observed between the meaningful gesture spotting and recognition. This time delay is unacceptable for online applications. Given the fact of high variability of corresponding gesture to other gestures, modeling the other gesture patterns (i.e. non-gesture patterns are other movements which do not correspond to gestures) is a vital issue to accommodate the infinite number of non-gesture patterns. In this thesis, a forward gesture spotting system is proposed which handles hand gesture spotting and recognition simultaneously in stereo color image sequences without time delay. In addition, color and depth map which is obtained by passive stereo measuring based on the mean absolute difference and the known calibration data of the camera, are used to localize hands. Moreover, the hand trajectory is obtained by using Mean-shift algorithm in conjunction with depth map. This structure correctly extracts a set of hand postures to track the hand motion and achieves accurate and robust hand tracking with a stereo camera as an input device. One of the main contributions in the work is to examine the capabilities of combined features of [...]
In text/plain format

Archived Files and Locations

application/pdf  10.4 MB
file_sxnhc2tokfaddeaziw5645ii7i
opendata.uni-halle.de (publisher)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article
Stage   published
Date   2018-09-24
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: a1bdacd0-0252-4f96-a5d3-8ea047519d34
API URL: JSON