3D- Convolutional Neural Network with Data Enhance Hand Gestures Recognition

Abstract

Computers are part of our daily lives and used in different fields. Traditional input devices like mouse, keyboard, etc. perform human-computer interaction. Hand gestures can be a useful means of interacting with the human-computer and can facilitate interaction. The gestures vary from person to person in orientation and form. In this problem, then, there is no linearity. Supremacy for image representation and classification has been observed experimentally by the Convolutional Neural Network (CNN).In this proposal, hand gestures are recognized using RGB-D sequences captured with a detector. To do so, I used a technique that combines computer vision with profound learning called 3D CNN. The data - set included data increase, including re-scaling, zoom, shearing, rotation, width, and height shift. The model was trained for 7500 images and tested for 1600 images in 12 classes. The proposed method with increased data has obtained 96.18% accuracy, which is almost 3.91% significantly higher than the model without increase, 91.23%.

 Keywords: Convolutional Neural Network, Deep Learning, Image Processing, Hand Gestures.