CHATGPT IN FOREIGN LANGUAGE TEACHING AND ASSESSMENT: EXPLORING EFL INSTRUCTORS’ EXPERIENCE

The paper presents the results of the first stage of the research into the specifics of ChatGPT application in assessment development for English as a Foreign Language (EFL) courses. The article aims to investigate the perceptions of English language teachers regarding the utilization of ChatGPT in...

Full description

Saved in:
Bibliographic Details
Main Authors: Inna Zaiarna, Olena Zhyhadlo, Olha Dunaievska
Format: Article
Language:English
Published: Institute for Digitalisation of Education of the NAES of Ukraine 2024-09-01
Series:Інформаційні технології і засоби навчання
Subjects:
Online Access:https://journal.iitta.gov.ua/index.php/itlt/article/view/5716
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1823863896149065728
author Inna Zaiarna
Olena Zhyhadlo
Olha Dunaievska
author_facet Inna Zaiarna
Olena Zhyhadlo
Olha Dunaievska
author_sort Inna Zaiarna
collection DOAJ
description The paper presents the results of the first stage of the research into the specifics of ChatGPT application in assessment development for English as a Foreign Language (EFL) courses. The article aims to investigate the perceptions of English language teachers regarding the utilization of ChatGPT in their teaching and assessment practices obtained through a survey in order to establish the degree of their familiarity with the possibilities of ChatGPT for teaching a foreign language and the mechanics of AI-generated test tasks design. The participants are mostly experienced English language instructors, affiliated with higher education institutions in Ukraine, the EU and the USA. Findings reveal varying levels of respondents’ confidence in ChatGPT's functionalities. A considerable proportion of educators appeared to be either unfamiliar with ChatGPT or possess limited knowledge of its capabilities. Hesitancy in implementing ChatGPT in teaching practice primarily stems from a lack of guidance as to its effective utilization closely followed by academic integrity concerns. However, educators who have employed ChatGPT recognize its potential as an assistant in lesson planning, content creation, task design, and assessment, especially for vocabulary, grammar, and writing. Despite acknowledging the tool's benefits, respondents express reservations about ChatGPT-generated tasks’ accuracy for assessment purposes. Challenges include the need for meticulous proofreading, issues with biased information, and insufficient task complexity. Nonetheless, overall satisfaction levels among educators implementing ChatGPT range from moderate to high, substantiating its value in foreign language teaching. Thus the survey stage of the research revealed the growing interest in ChatGPT’s potential for foreign language teaching and assessment among Ukrainian and international EFL and ESP instructors and underscored the need for guidelines and recommendations to create effective ChatGPT-generated test tasks. Future research will develop criteria for evaluating ChatGPT-generated tasks, provide prompt design guidelines, and formulate ethical policies for AI in assessment, addressing educators' concerns and 
format Article
id doaj-art-2253860eec8a49a0a188508d2c0f1be1
institution Kabale University
issn 2076-8184
language English
publishDate 2024-09-01
publisher Institute for Digitalisation of Education of the NAES of Ukraine
record_format Article
series Інформаційні технології і засоби навчання
spelling doaj-art-2253860eec8a49a0a188508d2c0f1be12025-02-09T08:37:10ZengInstitute for Digitalisation of Education of the NAES of UkraineІнформаційні технології і засоби навчання2076-81842024-09-01102410.33407/itlt.v102i4.5716CHATGPT IN FOREIGN LANGUAGE TEACHING AND ASSESSMENT: EXPLORING EFL INSTRUCTORS’ EXPERIENCEInna Zaiarna0https://orcid.org/0000-0002-9464-096XOlena Zhyhadlo1https://orcid.org/0000-0002-1605-7242Olha Dunaievska2https://orcid.org/0000-0002-0915-428XTaras Shevchenko National University of Kyiv, Kyiv, Ukraine; Institute for Digitalisation of Education of the National Academy of Educational Sciences of Ukraine, Kyiv, UkraineTaras Shevchenko National University of Kyiv, Kyiv, UkraineTaras Shevchenko National University of Kyiv, Kyiv, Ukraine The paper presents the results of the first stage of the research into the specifics of ChatGPT application in assessment development for English as a Foreign Language (EFL) courses. The article aims to investigate the perceptions of English language teachers regarding the utilization of ChatGPT in their teaching and assessment practices obtained through a survey in order to establish the degree of their familiarity with the possibilities of ChatGPT for teaching a foreign language and the mechanics of AI-generated test tasks design. The participants are mostly experienced English language instructors, affiliated with higher education institutions in Ukraine, the EU and the USA. Findings reveal varying levels of respondents’ confidence in ChatGPT's functionalities. A considerable proportion of educators appeared to be either unfamiliar with ChatGPT or possess limited knowledge of its capabilities. Hesitancy in implementing ChatGPT in teaching practice primarily stems from a lack of guidance as to its effective utilization closely followed by academic integrity concerns. However, educators who have employed ChatGPT recognize its potential as an assistant in lesson planning, content creation, task design, and assessment, especially for vocabulary, grammar, and writing. Despite acknowledging the tool's benefits, respondents express reservations about ChatGPT-generated tasks’ accuracy for assessment purposes. Challenges include the need for meticulous proofreading, issues with biased information, and insufficient task complexity. Nonetheless, overall satisfaction levels among educators implementing ChatGPT range from moderate to high, substantiating its value in foreign language teaching. Thus the survey stage of the research revealed the growing interest in ChatGPT’s potential for foreign language teaching and assessment among Ukrainian and international EFL and ESP instructors and underscored the need for guidelines and recommendations to create effective ChatGPT-generated test tasks. Future research will develop criteria for evaluating ChatGPT-generated tasks, provide prompt design guidelines, and formulate ethical policies for AI in assessment, addressing educators' concerns and  https://journal.iitta.gov.ua/index.php/itlt/article/view/5716artificial intelligence (AI)СhatGPTtesting and assessmentforeign language competencesurvey
spellingShingle Inna Zaiarna
Olena Zhyhadlo
Olha Dunaievska
CHATGPT IN FOREIGN LANGUAGE TEACHING AND ASSESSMENT: EXPLORING EFL INSTRUCTORS’ EXPERIENCE
Інформаційні технології і засоби навчання
artificial intelligence (AI)
СhatGPT
testing and assessment
foreign language competence
survey
title CHATGPT IN FOREIGN LANGUAGE TEACHING AND ASSESSMENT: EXPLORING EFL INSTRUCTORS’ EXPERIENCE
title_full CHATGPT IN FOREIGN LANGUAGE TEACHING AND ASSESSMENT: EXPLORING EFL INSTRUCTORS’ EXPERIENCE
title_fullStr CHATGPT IN FOREIGN LANGUAGE TEACHING AND ASSESSMENT: EXPLORING EFL INSTRUCTORS’ EXPERIENCE
title_full_unstemmed CHATGPT IN FOREIGN LANGUAGE TEACHING AND ASSESSMENT: EXPLORING EFL INSTRUCTORS’ EXPERIENCE
title_short CHATGPT IN FOREIGN LANGUAGE TEACHING AND ASSESSMENT: EXPLORING EFL INSTRUCTORS’ EXPERIENCE
title_sort chatgpt in foreign language teaching and assessment exploring efl instructors experience
topic artificial intelligence (AI)
СhatGPT
testing and assessment
foreign language competence
survey
url https://journal.iitta.gov.ua/index.php/itlt/article/view/5716
work_keys_str_mv AT innazaiarna chatgptinforeignlanguageteachingandassessmentexploringeflinstructorsexperience
AT olenazhyhadlo chatgptinforeignlanguageteachingandassessmentexploringeflinstructorsexperience
AT olhadunaievska chatgptinforeignlanguageteachingandassessmentexploringeflinstructorsexperience