Determining the alignment of assessment items with curriculum goals through document analysis by addressing identified item flaws
Abstract Background Assessment shapes educational activities and curriculum mapping, influences learning outcomes, and motivates students. In medical education, aligning assessment items with curricular goals ensures that learning outcomes are accurately measured. Our study aimed to evaluate the ali...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2025-02-01
|
| Series: | BMC Medical Education |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12909-025-06736-4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823861952238059520 |
|---|---|
| author | Humaira Fayyaz Khan Shazia Qayyum Huma Beenish Rehan Ahmed Khan Samina Iltaf Lubna Rani Faysal |
| author_facet | Humaira Fayyaz Khan Shazia Qayyum Huma Beenish Rehan Ahmed Khan Samina Iltaf Lubna Rani Faysal |
| author_sort | Humaira Fayyaz Khan |
| collection | DOAJ |
| description | Abstract Background Assessment shapes educational activities and curriculum mapping, influences learning outcomes, and motivates students. In medical education, aligning assessment items with curricular goals ensures that learning outcomes are accurately measured. Our study aimed to evaluate the alignment of multiple-choice questions (MCQs) with curriculum objectives, identify any flaws in these items, and propose enhancements to improve assessment quality. Methodology A quantitative descriptive study was conducted at Islamic International Medical College, Riphah University, in 2023. Pre-hoc reports from mid-stake assessments across five academic years were analyzed, covering both preclinical and clinical years. A total of 2,400 multiple-choice questions (MCQs) were reviewed for the mid-stake exams against the institutional checklist in which flaws were categorized into three types: test wiseness, irrelevant difficulty, and miscellaneous flaws. Results The analysis revealed a significant misalignment between assessment items and curriculum objectives. Of the 2,400 MCQs reviewed across all five years, 561 flaws were identified: 125 test wiseness flaws, 198 irrelevant difficulty flaws, and and 238 miscellaneous flaws. The latter category was recognized as “alignment flaws” which was not previously documented.The documentation and rectification of these flaws, which included issues such as misaligned learning objectives, incorrect assessment strategies, and disconnects between scenarios and lead-ins, led to their inclusion in the institutional checklist, facilitating ongoing improvements in assessment quality. Conclusions Our study revealed significant gaps in the alignment of multiple-choice questions (MCQs) with curriculum objectives, emphasizing the need for a systematic approach to address these flaws. Document analysis identified misalignments between content objectives, cognitive processes, and assessment strategies, which compromise the quality of evaluations and can hinder the development of critical thinking and problem-solving skills. To address these issues, we propose integrating identified flaws into institutional guidelines and implementing an updated checklist for pre-hoc evaluation of assessment items, with a focus on curriculum alignment and cognitive levels. |
| format | Article |
| id | doaj-art-36099605e43b4277a7c965de584e578f |
| institution | Kabale University |
| issn | 1472-6920 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj-art-36099605e43b4277a7c965de584e578f2025-02-09T12:42:47ZengBMCBMC Medical Education1472-69202025-02-012511910.1186/s12909-025-06736-4Determining the alignment of assessment items with curriculum goals through document analysis by addressing identified item flawsHumaira Fayyaz Khan0Shazia Qayyum1Huma Beenish2Rehan Ahmed Khan3Samina Iltaf4Lubna Rani Faysal5Department of Physiology, Riphah International UniversityDepartment of Pathology, Riphah International UniversityDepartment of Anatomy, NUST School of Health SciencesDepartment of Surgery, Riphah International UniversityDepartment of Pathology, Riphah International UniversityDepartment of Dermatology, Riphah International UniversityAbstract Background Assessment shapes educational activities and curriculum mapping, influences learning outcomes, and motivates students. In medical education, aligning assessment items with curricular goals ensures that learning outcomes are accurately measured. Our study aimed to evaluate the alignment of multiple-choice questions (MCQs) with curriculum objectives, identify any flaws in these items, and propose enhancements to improve assessment quality. Methodology A quantitative descriptive study was conducted at Islamic International Medical College, Riphah University, in 2023. Pre-hoc reports from mid-stake assessments across five academic years were analyzed, covering both preclinical and clinical years. A total of 2,400 multiple-choice questions (MCQs) were reviewed for the mid-stake exams against the institutional checklist in which flaws were categorized into three types: test wiseness, irrelevant difficulty, and miscellaneous flaws. Results The analysis revealed a significant misalignment between assessment items and curriculum objectives. Of the 2,400 MCQs reviewed across all five years, 561 flaws were identified: 125 test wiseness flaws, 198 irrelevant difficulty flaws, and and 238 miscellaneous flaws. The latter category was recognized as “alignment flaws” which was not previously documented.The documentation and rectification of these flaws, which included issues such as misaligned learning objectives, incorrect assessment strategies, and disconnects between scenarios and lead-ins, led to their inclusion in the institutional checklist, facilitating ongoing improvements in assessment quality. Conclusions Our study revealed significant gaps in the alignment of multiple-choice questions (MCQs) with curriculum objectives, emphasizing the need for a systematic approach to address these flaws. Document analysis identified misalignments between content objectives, cognitive processes, and assessment strategies, which compromise the quality of evaluations and can hinder the development of critical thinking and problem-solving skills. To address these issues, we propose integrating identified flaws into institutional guidelines and implementing an updated checklist for pre-hoc evaluation of assessment items, with a focus on curriculum alignment and cognitive levels.https://doi.org/10.1186/s12909-025-06736-4Alignment flawsAssessment qualityDocument analysis |
| spellingShingle | Humaira Fayyaz Khan Shazia Qayyum Huma Beenish Rehan Ahmed Khan Samina Iltaf Lubna Rani Faysal Determining the alignment of assessment items with curriculum goals through document analysis by addressing identified item flaws BMC Medical Education Alignment flaws Assessment quality Document analysis |
| title | Determining the alignment of assessment items with curriculum goals through document analysis by addressing identified item flaws |
| title_full | Determining the alignment of assessment items with curriculum goals through document analysis by addressing identified item flaws |
| title_fullStr | Determining the alignment of assessment items with curriculum goals through document analysis by addressing identified item flaws |
| title_full_unstemmed | Determining the alignment of assessment items with curriculum goals through document analysis by addressing identified item flaws |
| title_short | Determining the alignment of assessment items with curriculum goals through document analysis by addressing identified item flaws |
| title_sort | determining the alignment of assessment items with curriculum goals through document analysis by addressing identified item flaws |
| topic | Alignment flaws Assessment quality Document analysis |
| url | https://doi.org/10.1186/s12909-025-06736-4 |
| work_keys_str_mv | AT humairafayyazkhan determiningthealignmentofassessmentitemswithcurriculumgoalsthroughdocumentanalysisbyaddressingidentifieditemflaws AT shaziaqayyum determiningthealignmentofassessmentitemswithcurriculumgoalsthroughdocumentanalysisbyaddressingidentifieditemflaws AT humabeenish determiningthealignmentofassessmentitemswithcurriculumgoalsthroughdocumentanalysisbyaddressingidentifieditemflaws AT rehanahmedkhan determiningthealignmentofassessmentitemswithcurriculumgoalsthroughdocumentanalysisbyaddressingidentifieditemflaws AT saminailtaf determiningthealignmentofassessmentitemswithcurriculumgoalsthroughdocumentanalysisbyaddressingidentifieditemflaws AT lubnaranifaysal determiningthealignmentofassessmentitemswithcurriculumgoalsthroughdocumentanalysisbyaddressingidentifieditemflaws |