Overview of Sign Language Translation Based on Natural Language Processing
This paper explores the progress, challenges, and future directions in Sign Language Translation (SLT) within the broader field of Sign Language Processing (SLP), which combines Computer Vision (CV) and Natural Language Processing (NLP) to translate sign language videos into spoken language texts. T...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EDP Sciences
2025-01-01
|
| Series: | ITM Web of Conferences |
| Online Access: | https://www.itm-conferences.org/articles/itmconf/pdf/2025/01/itmconf_dai2024_02010.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1825206593978892288 |
|---|---|
| author | Wang Hanmo |
| author_facet | Wang Hanmo |
| author_sort | Wang Hanmo |
| collection | DOAJ |
| description | This paper explores the progress, challenges, and future directions in Sign Language Translation (SLT) within the broader field of Sign Language Processing (SLP), which combines Computer Vision (CV) and Natural Language Processing (NLP) to translate sign language videos into spoken language texts. The study begins by examining various sign language representation methods, such as video, gesture, symbol systems, and annotation, analyzing their strengths and weaknesses. It highlights the critical need for high-quality, large-scale datasets to advance SLT research, while acknowledging challenges like data scarcity, annotation inconsistencies, and ethical concerns. The paper then reviews recent SLT research, identifying key challenges and proposing solutions, such as expanding datasets through collaboration with the deaf and hard-of-hearing community, and employing advanced data collection techniques. Additionally, it suggests applying NLP methods like transfer learning and large language models to address specific challenges. Finally, the paper advocates for stronger interdisciplinary collaboration between CV and NLP to develop models and algorithms that are better suited to the unique aspects of sign languages. |
| format | Article |
| id | doaj-art-c58e3be1175e4a5f8cb585eefad2e475 |
| institution | Kabale University |
| issn | 2271-2097 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | EDP Sciences |
| record_format | Article |
| series | ITM Web of Conferences |
| spelling | doaj-art-c58e3be1175e4a5f8cb585eefad2e4752025-02-07T08:21:12ZengEDP SciencesITM Web of Conferences2271-20972025-01-01700201010.1051/itmconf/20257002010itmconf_dai2024_02010Overview of Sign Language Translation Based on Natural Language ProcessingWang Hanmo0Software Department, Henan UniversityThis paper explores the progress, challenges, and future directions in Sign Language Translation (SLT) within the broader field of Sign Language Processing (SLP), which combines Computer Vision (CV) and Natural Language Processing (NLP) to translate sign language videos into spoken language texts. The study begins by examining various sign language representation methods, such as video, gesture, symbol systems, and annotation, analyzing their strengths and weaknesses. It highlights the critical need for high-quality, large-scale datasets to advance SLT research, while acknowledging challenges like data scarcity, annotation inconsistencies, and ethical concerns. The paper then reviews recent SLT research, identifying key challenges and proposing solutions, such as expanding datasets through collaboration with the deaf and hard-of-hearing community, and employing advanced data collection techniques. Additionally, it suggests applying NLP methods like transfer learning and large language models to address specific challenges. Finally, the paper advocates for stronger interdisciplinary collaboration between CV and NLP to develop models and algorithms that are better suited to the unique aspects of sign languages.https://www.itm-conferences.org/articles/itmconf/pdf/2025/01/itmconf_dai2024_02010.pdf |
| spellingShingle | Wang Hanmo Overview of Sign Language Translation Based on Natural Language Processing ITM Web of Conferences |
| title | Overview of Sign Language Translation Based on Natural Language Processing |
| title_full | Overview of Sign Language Translation Based on Natural Language Processing |
| title_fullStr | Overview of Sign Language Translation Based on Natural Language Processing |
| title_full_unstemmed | Overview of Sign Language Translation Based on Natural Language Processing |
| title_short | Overview of Sign Language Translation Based on Natural Language Processing |
| title_sort | overview of sign language translation based on natural language processing |
| url | https://www.itm-conferences.org/articles/itmconf/pdf/2025/01/itmconf_dai2024_02010.pdf |
| work_keys_str_mv | AT wanghanmo overviewofsignlanguagetranslationbasedonnaturallanguageprocessing |