Automatic Translation of Text and Audio to Colombian Sign Language

The communication gap between deaf and hearing people remains a significant issue today, as the language used by both parts creates barriers affecting multiple aspects on people’s lifes. To address this, we propose a system for translation of text and audio into Colombian Sign Language using an accessible and user-friendly mobile application to facilitate communication between both parties. For this prototype, 76 phrases and words that represent signs were selected for the system. Pre-recorded videos of a sign language interpreter were employed to perform translations based on the previously established vocabulary. The service works via video concatenation based on the client’s text or audio request, using a Whisper AI model for audio transcription. In the context of an undergraduate thesis project, a mobile application prototype that translate text and audio into Colombian Sign Language was successfully developed. This project contributes to bridging the communication gap between deaf individuals and the hearing community.