HearAI - Non-Profit Project for Sign Language Recognition

Abstract

Many people use sign language every day. Some of them understand spoken and/or written native language, while others do not. This presents a huge communication barrier for Deaf people as access to qualified interpreters, due to their low availability and relatively high cost, is difficult. There is no doubt that there is a need to automate the process of sign language translation. Deep learning-based methods are a promising approach to automate this task. In the HearAI non-profit project, we addressed this by investigation of different multilingual open sign language corpora labeled by linguists in the language-agnostic Hamburg Notation System (HamNoSys).