A video chatting interface for deaf people

Abstract

Communication is the only process through which we individuals as a whole can share our thoughts, express our feelings and so on, but for a deaf/dumb people or simply a person with the inability to speak communication poses somewhat of a challenge in their day to day life. Due to these challenges they are more and more likely to experience some sort of social dilemmas as their methods of communication differ from normal people’s such as using sign language or texting. It is fundamentally crucial that communication be treated as an equal factor between both parties. Therefore, the goal of this project is to propose a new system that will help bridge the communication barrier that has existed between deaf/dumb people and normal hearing people. This system will make use of an Android video chatting application that gets inputs in the form of gestures when a deaf/dumb person uses it and takes each frame and it goes through image processing and translates given gestures into text, whereas in the condition for a normal hearing person the application simply translates audio into ASL emoticons which makes it easier for deaf/dumb people to understand rather due to the fact that they are simple hand gesture emoticons.