Argument-based validation of Chulalongkorn University Language Institute (CULI) test: a Rasch-based evidence investigation
Abstract Chulalongkorn University Language Institute (CULI) test was developed as a local standardised test of English for professional and international communication. To ensure that the CULI test fulfils its intended purposes, this study employed Kane’s argument-based validation and Rasch measurem...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2025-02-01
|
| Series: | Language Testing in Asia |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s40468-025-00346-z |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823861730095136768 |
|---|---|
| author | Apichat Khamboonruang |
| author_facet | Apichat Khamboonruang |
| author_sort | Apichat Khamboonruang |
| collection | DOAJ |
| description | Abstract Chulalongkorn University Language Institute (CULI) test was developed as a local standardised test of English for professional and international communication. To ensure that the CULI test fulfils its intended purposes, this study employed Kane’s argument-based validation and Rasch measurement approaches to construct the validity argument for the CULI test. This study analysed score data from a single test administration involving 237 test-takers and used a dichotomous Rasch model for the data analysis in Winsteps. The Rasch results indicated appropriate psychometric properties of the CULI test. Overall, the Rasch-based evidence reasonably contributes to the validity argument for the CULI test. Specifically, it partly supports the plausibility of the claims that CULI test tasks and contents represent those in the intended target language use (TLU) domain, and CULI test scores accurately summarise test-takers’ performance and reflect test-takers’ performance consistency, the intended construct, and language performance levels in the TLU domain. Although the CULI test showed sound psychometric functioning, the Rasch results indicated the need for further investigation into certain correct and incorrect choices and the difficulty levels of writing items, which could provide valuable insights for optimising test quality. This study offers implications for future research on argument-based and Rasch-based validation. |
| format | Article |
| id | doaj-art-75ff3e81142d498bbe8e6a450f7ca7ca |
| institution | Kabale University |
| issn | 2229-0443 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Language Testing in Asia |
| spelling | doaj-art-75ff3e81142d498bbe8e6a450f7ca7ca2025-02-09T12:49:44ZengSpringerOpenLanguage Testing in Asia2229-04432025-02-0115112410.1186/s40468-025-00346-zArgument-based validation of Chulalongkorn University Language Institute (CULI) test: a Rasch-based evidence investigationApichat Khamboonruang0Chulalongkorn University Language Institute (CULI)Abstract Chulalongkorn University Language Institute (CULI) test was developed as a local standardised test of English for professional and international communication. To ensure that the CULI test fulfils its intended purposes, this study employed Kane’s argument-based validation and Rasch measurement approaches to construct the validity argument for the CULI test. This study analysed score data from a single test administration involving 237 test-takers and used a dichotomous Rasch model for the data analysis in Winsteps. The Rasch results indicated appropriate psychometric properties of the CULI test. Overall, the Rasch-based evidence reasonably contributes to the validity argument for the CULI test. Specifically, it partly supports the plausibility of the claims that CULI test tasks and contents represent those in the intended target language use (TLU) domain, and CULI test scores accurately summarise test-takers’ performance and reflect test-takers’ performance consistency, the intended construct, and language performance levels in the TLU domain. Although the CULI test showed sound psychometric functioning, the Rasch results indicated the need for further investigation into certain correct and incorrect choices and the difficulty levels of writing items, which could provide valuable insights for optimising test quality. This study offers implications for future research on argument-based and Rasch-based validation.https://doi.org/10.1186/s40468-025-00346-zArgument-based validationInterpretive and use argumentValidity argumentCULI testRasch measurementRasch-based evidence |
| spellingShingle | Apichat Khamboonruang Argument-based validation of Chulalongkorn University Language Institute (CULI) test: a Rasch-based evidence investigation Language Testing in Asia Argument-based validation Interpretive and use argument Validity argument CULI test Rasch measurement Rasch-based evidence |
| title | Argument-based validation of Chulalongkorn University Language Institute (CULI) test: a Rasch-based evidence investigation |
| title_full | Argument-based validation of Chulalongkorn University Language Institute (CULI) test: a Rasch-based evidence investigation |
| title_fullStr | Argument-based validation of Chulalongkorn University Language Institute (CULI) test: a Rasch-based evidence investigation |
| title_full_unstemmed | Argument-based validation of Chulalongkorn University Language Institute (CULI) test: a Rasch-based evidence investigation |
| title_short | Argument-based validation of Chulalongkorn University Language Institute (CULI) test: a Rasch-based evidence investigation |
| title_sort | argument based validation of chulalongkorn university language institute culi test a rasch based evidence investigation |
| topic | Argument-based validation Interpretive and use argument Validity argument CULI test Rasch measurement Rasch-based evidence |
| url | https://doi.org/10.1186/s40468-025-00346-z |
| work_keys_str_mv | AT apichatkhamboonruang argumentbasedvalidationofchulalongkornuniversitylanguageinstituteculitestaraschbasedevidenceinvestigation |