Conversion of Sign Language to Text, Speech and Braille Code Using Image Processing

Abstract

Human beings are blessed with five senses, through which we experience life in a better way. On the other hand there are people who are deprived of these abilities. It is a complex task to design a single system which can be used by anyone with any disability to communicate with others. Disabilities affect a person’s ability to communicate using voice, hearing and vision. Such people use other means of communication such as sign language, braille code etc. Communication between deaf-dumb, Blind and a normal person is always a challenging task. We can see people using sign language and braille code quite frequently but, there exists a barrier between people who use these techniques and the people who cannot. With recent advancements in Image Processing there has been promising progress in the fields of motion and gesture recognition. Image Processing is used to design the system in this paper. Deaf and dumb people use sign language to communicate with others. We provide a technique to convert the signs to text, then the text will be converted to speech, thereby a person with vision can communicate with speech disabled person. Braille code of the same text can be visualized through an electromagnetic device, and the visually impaired person can feel the message through his touch