Real-time Hand Gesture Detection and Recognition for Human Computer Interaction PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Real-time Hand Gesture Detection and Recognition for Human Computer Interaction PDF full book. Access full book title Real-time Hand Gesture Detection and Recognition for Human Computer Interaction by Nasser Hasan Abdel-Qader Dardas. Download full books in PDF and EPUB format.
Author: Nasser Hasan Abdel-Qader Dardas Publisher: ISBN: Category : Gesture Languages : en Pages :
Book Description
This thesis focuses on bare hand gesture recognition by proposing a new architecture to solve the problem of real-time vision-based hand detection, tracking, and gesture recognition for interaction with an application via hand gestures. The first stage of our system allows detecting and tracking a bare hand in a cluttered background using face subtraction, skin detection and contour comparison. The second stage allows recognizing hand gestures using bag-of-features and multi-class Support Vector Machine (SVM) algorithms. Finally, a grammar has been developed to generate gesture commands for application control. Our hand gesture recognition system consists of two steps: offline training and online testing. In the training stage, after extracting the keypoints for every training image using the Scale Invariance Feature Transform (SIFT), a vector quantization technique will map keypoints from every training image into a unified dimensional histogram vector (bag-of-words) after K-means clustering. This histogram is treated as an input vector for a multi-class SVM to build the classifier. In the testing stage, for every frame captured from a webcam, the hand is detected using my algorithm. Then, the keypoints are extracted for every small image that contains the detected hand posture and fed into the cluster model to map them into a bag-of-words vector, which is fed into the multi-class SVM classifier to recognize the hand gesture. Another hand gesture recognition system was proposed using Principle Components Analysis (PCA). The most eigenvectors and weights of training images are determined. In the testing stage, the hand posture is detected for every frame using my algorithm. Then, the small image that contains the detected hand is projected onto the most eigenvectors of training images to form its test weights. Finally, the minimum Euclidean distance is determined among the test weights and the training weights of each training image to recognize the hand gesture. Two application of gesture-based interaction with a 3D gaming virtual environment were implemented. The exertion videogame makes use of a stationary bicycle as one of the main inputs for game playing. The user can control and direct left-right movement and shooting actions in the game by a set of hand gesture commands, while in the second game, the user can control and direct a helicopter over the city by a set of hand gesture commands.
Author: Nasser Hasan Abdel-Qader Dardas Publisher: ISBN: Category : Gesture Languages : en Pages :
Book Description
This thesis focuses on bare hand gesture recognition by proposing a new architecture to solve the problem of real-time vision-based hand detection, tracking, and gesture recognition for interaction with an application via hand gestures. The first stage of our system allows detecting and tracking a bare hand in a cluttered background using face subtraction, skin detection and contour comparison. The second stage allows recognizing hand gestures using bag-of-features and multi-class Support Vector Machine (SVM) algorithms. Finally, a grammar has been developed to generate gesture commands for application control. Our hand gesture recognition system consists of two steps: offline training and online testing. In the training stage, after extracting the keypoints for every training image using the Scale Invariance Feature Transform (SIFT), a vector quantization technique will map keypoints from every training image into a unified dimensional histogram vector (bag-of-words) after K-means clustering. This histogram is treated as an input vector for a multi-class SVM to build the classifier. In the testing stage, for every frame captured from a webcam, the hand is detected using my algorithm. Then, the keypoints are extracted for every small image that contains the detected hand posture and fed into the cluster model to map them into a bag-of-words vector, which is fed into the multi-class SVM classifier to recognize the hand gesture. Another hand gesture recognition system was proposed using Principle Components Analysis (PCA). The most eigenvectors and weights of training images are determined. In the testing stage, the hand posture is detected for every frame using my algorithm. Then, the small image that contains the detected hand is projected onto the most eigenvectors of training images to form its test weights. Finally, the minimum Euclidean distance is determined among the test weights and the training weights of each training image to recognize the hand gesture. Two application of gesture-based interaction with a 3D gaming virtual environment were implemented. The exertion videogame makes use of a stationary bicycle as one of the main inputs for game playing. The user can control and direct left-right movement and shooting actions in the game by a set of hand gesture commands, while in the second game, the user can control and direct a helicopter over the city by a set of hand gesture commands.
Author: Ming-Hsuan Yang Publisher: Springer Science & Business Media ISBN: 1461514231 Category : Computers Languages : en Pages : 188
Book Description
Traditionally, scientific fields have defined boundaries, and scientists work on research problems within those boundaries. However, from time to time those boundaries get shifted or blurred to evolve new fields. For instance, the original goal of computer vision was to understand a single image of a scene, by identifying objects, their structure, and spatial arrangements. This has been referred to as image understanding. Recently, computer vision has gradually been making the transition away from understanding single images to analyzing image sequences, or video understanding. Video understanding deals with understanding of video sequences, e. g. , recognition of gestures, activities, facial expressions, etc. The main shift in the classic paradigm has been from the recognition of static objects in the scene to motion-based recognition of actions and events. Video understanding has overlapping research problems with other fields, therefore blurring the fixed boundaries. Computer graphics, image processing, and video databases have obvious overlap with computer vision. The main goal of computer graphics is to gener ate and animate realistic looking images, and videos. Researchers in computer graphics are increasingly employing techniques from computer vision to gen erate the synthetic imagery. A good example of this is image-based rendering and modeling techniques, in which geometry, appearance, and lighting is de rived from real images using computer vision techniques. Here the shift is from synthesis to analysis followed by synthesis.
Author: Branislav Kisacanin Publisher: Springer Science & Business Media ISBN: 0387278907 Category : Computers Languages : en Pages : 308
Book Description
200Ts Vision of Vision One of my formative childhood experiences was in 1968 stepping into the Uptown Theater on Connecticut Avenue in Washington, DC, one of the few movie theaters nationwide that projected in large-screen cinerama. I was there at the urging of a friend, who said I simply must see the remarkable film whose run had started the previous week. "You won't understand it," he said, "but that doesn't matter. " All I knew was that the film was about science fiction and had great special eflPects. So I sat in the front row of the balcony, munched my popcorn, sat back, and experienced what was widely touted as "the ultimate trip:" 2001: A Space Odyssey. My friend was right: I didn't understand it. . . but in some senses that didn't matter. (Even today, after seeing the film 40 times, I continue to discover its many subtle secrets. ) I just had the sense that I had experienced a creation of the highest aesthetic order: unique, fresh, awe inspiring. Here was a film so distinctive that the first half hour had no words whatsoever; the last half hour had no words either; and nearly all the words in between were banal and irrelevant to the plot - quips about security through Voiceprint identification, how to make a phonecall from a space station, government pension plans, and so on.
Author: Malay K. Kundu Publisher: Springer ISBN: 3642273874 Category : Computers Languages : en Pages : 394
Book Description
This book constitutes the proceedings of the First Indo-Japanese conference on Perception and Machine Intelligence, PerMIn 2012, held in Kolkata, India, in January 2012. The 41 papers, presented together with 1 keynote paper and 3 plenary papers, were carefully reviewed and selected for inclusion in the book. The papers are organized in topical sections named perception; human-computer interaction; e-nose and e-tongue; machine intelligence and application; image and video processing; and speech and signal processing.
Author: Pavel Alexandrovich Popov Publisher: ISBN: Category : Languages : en Pages :
Book Description
The topic of this thesis is Hand Gesture Recognition and Hand Tracking for user interface applications. 3 systems were produced, as well as datasets for recognition and tracking, along with UI applications to prove the concept of the technology. These represent significant contributions to resolving the hand recognition and tracking problems for 2d systems. The systems were designed to work in video only contexts, be computationally light, provide recognition and tracking of the user's hand, and operate without user driven fine tuning and calibration. Existing systems require user calibration, use depth sensors and do not work in video only contexts, or are computationally heavy requiring GPU to run in live situations. A 2-step static hand gesture recognition system was created which can recognize 3 different gestures in real-time. A detection step detects hand gestures using machine learning models. A validation step rejects false positives. The gesture recognition system was combined with hand tracking. It recognizes and then tracks a user's hand in video in an unconstrained setting. The tracking uses 2 collaborative strategies. A contour tracking strategy guides a minimization based template tracking strategy and makes it real-time, robust, and recoverable, while the template tracking provides stable input for UI applications. Lastly, an improved static gesture recognition system addresses the drawbacks due to stratified colour sampling of the detection boxes in the detection step. It uses the entire presented colour range and clusters it into constituent colour modes which are then used for segmentation, which improves the overall gesture recognition rates. One dataset was produced for static hand gesture recognition which allowed for the comparison of multiple different machine learning strategies, including deep learning. Another dataset was produced for hand tracking which provides a challenging series of user scenarios to test the gesture recognition and hand tracking system. Both datasets are significantly larger than other available datasets. The hand tracking algorithm was used to create a mouse cursor control application, a paint application for Android mobile devices, and a FPS video game controller. The latter in particular demonstrates how the collaborating hand tracking can fulfill the demanding nature of responsive aiming and movement controls.
Author: Antonio Camurri Publisher: Springer ISBN: 3540245987 Category : Computers Languages : en Pages : 571
Book Description
Research on the multifaceted aspects of modeling, analysis, and synthesis of - man gesture is receiving growing interest from both the academic and industrial communities. On one hand, recent scienti?c developments on cognition, on - fect/emotion, on multimodal interfaces, and on multimedia have opened new perspectives on the integration of more sophisticated models of gesture in c- putersystems.Ontheotherhand,theconsolidationofnewtechnologiesenabling “disappearing” computers and (multimodal) interfaces to be integrated into the natural environments of users are making it realistic to consider tackling the complex meaning and subtleties of human gesture in multimedia systems, - abling a deeper, user-centered, enhanced physical participation and experience in the human-machine interaction process. The research programs supported by the European Commission and s- eral national institutions and governments individuated in recent years strategic ?elds strictly concerned with gesture research. For example, the DG Infor- tion Society of the European Commission (www.cordis.lu/ist) supports several initiatives, such as the “Disappearing Computer” and “Presence” EU-IST FET (Future and Emerging Technologies), the IST program “Interfaces & Enhanced Audio-Visual Services” (see for example the project MEGA, Multisensory - pressive Gesture Applications, www.megaproject.org), and the IST strategic - jective “Multimodal Interfaces.” Several EC projects and other funded research are represented in the chapters of this book. Awiderangeofapplicationscanbene?tfromadvancesinresearchongesture, from consolidated areas such as surveillance to new or emerging ?elds such as therapy and rehabilitation, home consumer goods, entertainment, and aud- visual, cultural and artistic applications, just to mention only a few of them.
Author: Miguel Sales Dias Publisher: Springer Science & Business Media ISBN: 3540928642 Category : Computers Languages : en Pages : 294
Book Description
This book constitutes the thoroughly refereed post-proceedings of the 7th International Workshop on Gesture-Based Human-Computer Interaction and Simulation, GW 2007, held in Lisbon, Portugal, in May 2007. The 31 revised papers presented were carefully selected from 53 submissions. The papers are organized in topical sections on analysis and synthesis of gesture; theoretical aspects of gestural communication and interaction; vision-based gesture recognition; sign language processing; gesturing with tangible interfaces and in virtual and augmented reality; gesture for music and performing arts; gesture for therapy and rehabilitation; and gesture in Mobile computing and usability studies.
Author: Annelies Braffort Publisher: Springer Science & Business Media ISBN: 3540669353 Category : Computers Languages : en Pages : 322
Book Description
This book constitutes the thoroughly refereed post-proceedings of the International Gesture Workshop, GW'99, held in Gif-sur-Yvette, France, in March 1999. The 16 revised long papers and seven revised short papers were carefully reviewed for inclusion in the book. Also included are four invited papers and the transcription of a round table discussion. The papers are organized in sections on human perception and production of gesture, localization and segmentation, recognition, sign language, gesture synthesis and animation, and multimodality.
Author: Zhihua Cai Publisher: Springer Science & Business Media ISBN: 3642164927 Category : Computers Languages : en Pages : 551
Book Description
Volumes CCIS 107 and LNCS 6382 constitute the proceedings of the 5th International Symposium, ISICA 2010, held in Wuhan, China, in October 2010. ISICA 2010 attracted 267 submissions and through rigorous reviews 53 papers were included in LNCS 6382. The papers are presented in sections on ANT colony and particle swarm optimization, differential evolution, distributed computing, genetic algorithms, multi-agent systems, multi-objective and dynamic optimization, robot intelligence, statistic learning and system design.
Author: Qiguang Miao Publisher: Elsevier ISBN: 0443289603 Category : Computers Languages : en Pages : 225
Book Description
Gesture Recognition: Theory and Applications covers this important topic in computer science and language technology that has a goal of interpreting human gestures via mathematical algorithms. The book begins by examining the computer vision-based gesture recognition method, focusing on the theory and related research results of various recent gesture recognition technologies. The book takes the evolutions of gesture recognition technology as a clue, systematically introducing gesture recognition methods based on handcrafted features, convolutional neural networks, recurrent neural networks, multimodal data fusion, and visual attention mechanisms.Three gesture recognition-based HCI (Human Computer Interaction) practical cases are introduced. Finally, the book looks at emerging research trends and application. - Focuses on the theory and application of gesture recognition, providing a systematic introduction to commonly used datasets in the field as well as algorithms based on handcrafted features, convolutional neural networks, multimodal fusion, and attention mechanisms - Introduces the practical applications of gesture recognition in real-world scenarios, enabling readers to enhance their practical application skills while learning about relevant technologies - Demonstrates four main categories of gesture recognition methods and analyzes their associated challenges
Author: Nasser Hasan Abdel-Qader Dardas
Author: Nasser Hasan Abdel-Qader Dardas
Author: Ming-Hsuan Yang
Author: Branislav Kisacanin
Author: Malay K. Kundu
Author: Pavel Alexandrovich Popov
Author: Antonio Camurri
Author: Miguel Sales Dias
Author: Annelies Braffort
Author: Zhihua Cai
Author: Qiguang Miao