TY - CHAP
T1 - Automatic Translation of Text and Audio to Colombian Sign Language
AU - Becerra, Santiago Fernández
AU - Vargas, Fabián Andrés Olarte
AU - Quenguan, Johan Mateo Rosero
AU - Rendón, Andrés Felipe Vásquez
AU - Rueda-Olarte, Andrea
PY - 2024
Y1 - 2024
N2 - The communication gap between deaf and hearing people remains a significant issue today, as the language used by both parts creates barriers affecting multiple aspects on people’s lifes. To address this, we propose a system for translation of text and audio into Colombian Sign Language using an accessible and user-friendly mobile application to facilitate communication between both parties. For this prototype, 76 phrases and words that represent signs were selected for the system. Pre-recorded videos of a sign language interpreter were employed to perform translations based on the previously established vocabulary. The service works via video concatenation based on the client’s text or audio request, using a Whisper AI model for audio transcription. In the context of an undergraduate thesis project, a mobile application prototype that translate text and audio into Colombian Sign Language was successfully developed. This project contributes to bridging the communication gap between deaf individuals and the hearing community.
AB - The communication gap between deaf and hearing people remains a significant issue today, as the language used by both parts creates barriers affecting multiple aspects on people’s lifes. To address this, we propose a system for translation of text and audio into Colombian Sign Language using an accessible and user-friendly mobile application to facilitate communication between both parties. For this prototype, 76 phrases and words that represent signs were selected for the system. Pre-recorded videos of a sign language interpreter were employed to perform translations based on the previously established vocabulary. The service works via video concatenation based on the client’s text or audio request, using a Whisper AI model for audio transcription. In the context of an undergraduate thesis project, a mobile application prototype that translate text and audio into Colombian Sign Language was successfully developed. This project contributes to bridging the communication gap between deaf individuals and the hearing community.
UR - https://doi.org/10.1007/978-3-031-47372-2_11
U2 - 10.1007/978-3-031-47372-2_11
DO - 10.1007/978-3-031-47372-2_11
M3 - Chapter
SP - 109
EP - 114
BT - Automatic Translation of Text and Audio to Colombian Sign Language
ER -