Sign Language detection application with an integrated chatbot

Abstract

"Sign language allows people to communicate with other individuals in forms on nonverbal communication. It’s the process of communicating with hand gestures or hand signs in order to communicate what we want to say in a nonverbal manner to help us to understand individuals who are hard of hearing or deaf.

There are many platforms and applications that are available to help individuals learn hand gestures or hand signs and how to proper communicate using them but there are limited platforms when it comes to practicing the said gestures. There are ways to practice these gestures like attending classes for it and learning face to face or using a prerecorded video to practice with a fixed conversation.

GestoTalk allows you to communicate using hand gestures or signs with a chatbot in real time which helps individuals have a space where they can freely express them self without the fear of any judgment or worries. The users will perform the gestures in real time and the meaning of that gesture will be taken and sent to the chatbot and the chatbot will reply with an appropriate response which then the user and the chatbot will go back and forth with their conversation."