EDUCATIONAL TRAINING SIMULATOR FOR MONITORING READING TECHNIQUE AND SPEED BASED ON SPEECH-TO-TEXT (STT) METHODS
The work is devoted to a relevant issue – gamification of the educational process of primary school students with the use of digital mobile devices using the example of educational trainer developed to control the technique and speed of reading. The practical novelty of the study lies in its potent...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Institute for Digitalisation of Education of the NAES of Ukraine
2024-10-01
|
| Series: | Інформаційні технології і засоби навчання |
| Subjects: | |
| Online Access: | https://journal.iitta.gov.ua/index.php/itlt/article/view/5647 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823864058833534976 |
|---|---|
| author | Olesia Barkovska Heorhii Ivashchenko Dmytro Rosinskiy Daniil Zakharov |
| author_facet | Olesia Barkovska Heorhii Ivashchenko Dmytro Rosinskiy Daniil Zakharov |
| author_sort | Olesia Barkovska |
| collection | DOAJ |
| description |
The work is devoted to a relevant issue – gamification of the educational process of primary school students with the use of digital mobile devices using the example of educational trainer developed to control the technique and speed of reading. The practical novelty of the study lies in its potential to optimize the process of controlling reading techniques for children with various speech disorders, such as lisping, rhotacismus, and dyslalia, which remains an unsolved problem for existing computer linguistic models. The practical significance lies in the fact that the use of information and communication technologies and gamification of the learning process motivates to gain knowledge and encourages learning not only due to the game strategy, but also due to the fact that the child receives approval and the opportunity to perform the task again so to improve skills. The proposed and tested trainer for monitoring the technique and speed of reading of primary school students for a mobile digital device recognizes the child’s voice with high accuracy (up to 94.84%), detects misread words and counts the number of words read in the given time period. The architecture of the proposed system consists of the following modules: preparation module, which ensures the correct functioning of the system regardless of the existing speech disorders; the speech-to-text converter directly converts the voice of the child reading the text on the gadget screen into text; The text comparison module is responsible for comparing the text read aloud with the text obtained as a result of conversion. The results of testing children with lisping and rhotacismus problems showed that the Jaro algorithm has a slightly higher accuracy of comparing two texts (by an average of 1.14%), and, at the same time, a shorter comparison time for large text arrays (by 39%). The results of testing children with dyslalia, meaning the rearrangement of sounds in words when reading, also showed that the Jaro algorithm has a shorter line comparison time for large text arrays (by 7%). The reduced operation time in methods for comparing texts in dyslalia cases is attributed to the absence of text array variations, with evaluations solely focusing on potential permutations of sounds.
|
| format | Article |
| id | doaj-art-1e251090fad64e3680cab8779fe054d2 |
| institution | Kabale University |
| issn | 2076-8184 |
| language | English |
| publishDate | 2024-10-01 |
| publisher | Institute for Digitalisation of Education of the NAES of Ukraine |
| record_format | Article |
| series | Інформаційні технології і засоби навчання |
| spelling | doaj-art-1e251090fad64e3680cab8779fe054d22025-02-09T08:37:08ZengInstitute for Digitalisation of Education of the NAES of UkraineІнформаційні технології і засоби навчання2076-81842024-10-01103510.33407/itlt.v103i5.5647EDUCATIONAL TRAINING SIMULATOR FOR MONITORING READING TECHNIQUE AND SPEED BASED ON SPEECH-TO-TEXT (STT) METHODSOlesia Barkovska0https://orcid.org/0000-0001-7496-4353Heorhii Ivashchenko1https://orcid.org/0000-0003-1027-5262Dmytro Rosinskiy2https://orcid.org/0000-0002-0725-392XDaniil Zakharov3https://orcid.org/0009-0006-4676-6599Kharkiv National University of Radio Electronics, Kharkiv, UkraineKharkiv National University of Radio Electronics, Kharkiv, UkraineKharkiv National University of Radio Electronics, Kharkiv, UkraineKharkiv National University of Radio Electronics, Kharkiv, Ukraine The work is devoted to a relevant issue – gamification of the educational process of primary school students with the use of digital mobile devices using the example of educational trainer developed to control the technique and speed of reading. The practical novelty of the study lies in its potential to optimize the process of controlling reading techniques for children with various speech disorders, such as lisping, rhotacismus, and dyslalia, which remains an unsolved problem for existing computer linguistic models. The practical significance lies in the fact that the use of information and communication technologies and gamification of the learning process motivates to gain knowledge and encourages learning not only due to the game strategy, but also due to the fact that the child receives approval and the opportunity to perform the task again so to improve skills. The proposed and tested trainer for monitoring the technique and speed of reading of primary school students for a mobile digital device recognizes the child’s voice with high accuracy (up to 94.84%), detects misread words and counts the number of words read in the given time period. The architecture of the proposed system consists of the following modules: preparation module, which ensures the correct functioning of the system regardless of the existing speech disorders; the speech-to-text converter directly converts the voice of the child reading the text on the gadget screen into text; The text comparison module is responsible for comparing the text read aloud with the text obtained as a result of conversion. The results of testing children with lisping and rhotacismus problems showed that the Jaro algorithm has a slightly higher accuracy of comparing two texts (by an average of 1.14%), and, at the same time, a shorter comparison time for large text arrays (by 39%). The results of testing children with dyslalia, meaning the rearrangement of sounds in words when reading, also showed that the Jaro algorithm has a shorter line comparison time for large text arrays (by 7%). The reduced operation time in methods for comparing texts in dyslalia cases is attributed to the absence of text array variations, with evaluations solely focusing on potential permutations of sounds. https://journal.iitta.gov.ua/index.php/itlt/article/view/5647computer gamereading techniquemobile deviceseditorial distancespeech-to-text |
| spellingShingle | Olesia Barkovska Heorhii Ivashchenko Dmytro Rosinskiy Daniil Zakharov EDUCATIONAL TRAINING SIMULATOR FOR MONITORING READING TECHNIQUE AND SPEED BASED ON SPEECH-TO-TEXT (STT) METHODS Інформаційні технології і засоби навчання computer game reading technique mobile devices editorial distance speech-to-text |
| title | EDUCATIONAL TRAINING SIMULATOR FOR MONITORING READING TECHNIQUE AND SPEED BASED ON SPEECH-TO-TEXT (STT) METHODS |
| title_full | EDUCATIONAL TRAINING SIMULATOR FOR MONITORING READING TECHNIQUE AND SPEED BASED ON SPEECH-TO-TEXT (STT) METHODS |
| title_fullStr | EDUCATIONAL TRAINING SIMULATOR FOR MONITORING READING TECHNIQUE AND SPEED BASED ON SPEECH-TO-TEXT (STT) METHODS |
| title_full_unstemmed | EDUCATIONAL TRAINING SIMULATOR FOR MONITORING READING TECHNIQUE AND SPEED BASED ON SPEECH-TO-TEXT (STT) METHODS |
| title_short | EDUCATIONAL TRAINING SIMULATOR FOR MONITORING READING TECHNIQUE AND SPEED BASED ON SPEECH-TO-TEXT (STT) METHODS |
| title_sort | educational training simulator for monitoring reading technique and speed based on speech to text stt methods |
| topic | computer game reading technique mobile devices editorial distance speech-to-text |
| url | https://journal.iitta.gov.ua/index.php/itlt/article/view/5647 |
| work_keys_str_mv | AT olesiabarkovska educationaltrainingsimulatorformonitoringreadingtechniqueandspeedbasedonspeechtotextsttmethods AT heorhiiivashchenko educationaltrainingsimulatorformonitoringreadingtechniqueandspeedbasedonspeechtotextsttmethods AT dmytrorosinskiy educationaltrainingsimulatorformonitoringreadingtechniqueandspeedbasedonspeechtotextsttmethods AT daniilzakharov educationaltrainingsimulatorformonitoringreadingtechniqueandspeedbasedonspeechtotextsttmethods |