Multilingual Voice Assistant to Dumb People Based On Hand Gestures

Abstract

Communication is the only medium through which one conveys any information to another either by speech, text or sign language. Since the dumb people cannot communicate with normal people they tend to use sign language which most of them cannot understand. The gesture movement is an expressive way of communication for dumb people to convey a message. The main objective of the paper is to help dumb people by providing voice assistance using their hand gestures. This voice assistant is made in multiple languages which makes it user-friendly in emergencies. This paper explains how gesture is converted into voice output. The system stores the messages the user requirements in emergencies hence, when the gesture is made it recognizes the gesture and gives the particular voice output in the language selected by the user. Users can also add or delete any messages and can select any language as the system uses Google translator for multiple languages output. This article discusses about the various systems built for differently disabled people, system overview and the system design. It also discusses the application of the system.