Design and Fabrication of Voice Generating Assistive Device for Specially-Abled People (Divyangjan)

Abstract

Communication is an essential and vital activity for every human being irrespective of gender and age. Unfortunately, some humans are born without the ability to communicate with each other. Deaf and dumb people are generally isolated, ill-treated and self-disguised in the society. The present world is advancing swiftly, but people with special abilities find it very difficult to adapt to a healthy community. The current technology of communication includes smart and touch screens with Artificial Intelligence (AI) and Machine learning. Many devices were developed which can be operated without touching the system. This paper attempted to creating such a device to generate a voice for the Indian sign language to assist the deaf and mute people when they perform sign language. Here a camera is used to capture the sign language, and are image processed. This data is fed into an AI program to recognise the sign language gestures and generate a voice to assist the ‘Diyangjan’ to communicate to any other human being with ease.

Keywords: Indian Sign Language, Image Processing, Text and Voice Generation and Conventional Neural Network (CNN) and Artificial Intelligence (AI)