Real-time Filipino sign language to text translation using region-based convolutional neural network / Lei I. Parato, Angelika V. Braga, and Jemima R. Villamer.

By: Contributor(s): Material type: TextTextDescription: 180 leavesContent type:
  • text
Media type:
  • unmediated
Carrier type:
  • volume
Dissertation note: Undergraduate Theses (BSCS) - Computer Science. Camarines Sur Polytechnic Colleges, 2024. Abstract: Filipino Sign Language (FSL) is the primary communication method for the Deaf com- munity in the Philippines, however limited knowledge of the language among the hearing population creates significant communication barriers. This study addresses this issue by developing a real-time FSL-to-text translation system. While deep learning has shown po- tential in gesture recognition, the lack of high-quality, large-scale FSL datasets hinders progress in this field. To bridge this gap, the study aimed to create a culturally authen- tic FSL dataset, build an accurate recognition model, and develop a system to deal with the current gaps in FSL research. A dataset of 846 video clips featuring 118 FSL ges- tures was created in collaboration with the Deaf community, ensuring linguistic accuracy. The system employed a Faster R-CNN model for gesture recognition, using a server-client architecture for real-time processing. Each frame of the video were extracted using Con- volutional Neural Networks, while Faster R-CNN and Gated Recurrent Units classified the signs. The resulting system achieved 90% accuracy with strong precision, recall, and F1-scores, demonstrating its potential to address communication challenges for the Deaf community.
Tags from this library: No tags from this library for this title. Log in to add tags.
Holdings
Item type Current library Shelving location Call number Copy number Status Date due Barcode
Unpublished Materials Unpublished Materials Main Library Undergraduate Thesis Section UTH BSCS P223r 2024 (Browse shelf(Opens below)) 1-1 Not for loan 007623UM

Undergraduate Theses (BSCS) - Computer Science. Camarines Sur Polytechnic Colleges, 2024.

Includes bibliographical references.

Filipino Sign Language (FSL) is the primary communication method for the Deaf com- munity in the Philippines, however limited knowledge of the language among the hearing population creates significant communication barriers. This study addresses this issue by developing a real-time FSL-to-text translation system. While deep learning has shown po- tential in gesture recognition, the lack of high-quality, large-scale FSL datasets hinders progress in this field. To bridge this gap, the study aimed to create a culturally authen- tic FSL dataset, build an accurate recognition model, and develop a system to deal with the current gaps in FSL research. A dataset of 846 video clips featuring 118 FSL ges- tures was created in collaboration with the Deaf community, ensuring linguistic accuracy. The system employed a Faster R-CNN model for gesture recognition, using a server-client architecture for real-time processing. Each frame of the video were extracted using Con- volutional Neural Networks, while Faster R-CNN and Gated Recurrent Units classified the signs. The resulting system achieved 90% accuracy with strong precision, recall, and F1-scores, demonstrating its potential to address communication challenges for the Deaf community.

There are no comments on this title.

to post a comment.