For Good Reason: Analyzing How Students Define Difficulty in RateMyProfessor.com Comments

 Can student comments help solve a problem that student ratings helped create?  We argue that the comment section of student evaluations of teaching (SET) offers a rich site for studying student perspectives on teaching and learning, particularly how students define and value course and instructor...

Full description

Saved in:
Bibliographic Details
Main Authors: Alexis Teagarden, Michael Carlozzi
Format: Article
Language:English
Published: Indiana University Office of Scholarly Publishing 2024-12-01
Series:Journal of the Scholarship of Teaching and Learning
Subjects:
Online Access:https://scholarworks.iu.edu/journals/index.php/josotl/article/view/33932
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1823857023943442432
author Alexis Teagarden
Michael Carlozzi
author_facet Alexis Teagarden
Michael Carlozzi
author_sort Alexis Teagarden
collection DOAJ
description  Can student comments help solve a problem that student ratings helped create?  We argue that the comment section of student evaluations of teaching (SET) offers a rich site for studying student perspectives on teaching and learning, particularly how students define and value course and instructor difficulty. Employing rhetorically grounded approaches to computer-assisted corpus analysis, we compared 4,600 RateMyProfessors.com instructor profiles meeting the criteria of 1) instructors with high difficulty and high overall quality scores or 2) instructors with high difficulty but low overall quality scores. We identify recurring argumentative patterns in both corpora. In contrast to SET scholarship which often assumes students favor ease over all other course characteristics, we see commenters providing a more nuanced evaluation: condemning contrived forms of difficulty but commending authentic ones. Our findings contribute to discussions of student perspectives on learning and their relationship to course evaluations. The results offer evidence in support of the validity hypothesis in SET scholarship and provide avenues for helping faculty better understand their course evaluations and their  students.
format Article
id doaj-art-e6e25b085e3846ac922ed3c5f3249243
institution Kabale University
issn 1527-9316
language English
publishDate 2024-12-01
publisher Indiana University Office of Scholarly Publishing
record_format Article
series Journal of the Scholarship of Teaching and Learning
spelling doaj-art-e6e25b085e3846ac922ed3c5f32492432025-02-12T04:15:06ZengIndiana University Office of Scholarly PublishingJournal of the Scholarship of Teaching and Learning1527-93162024-12-01244For Good Reason: Analyzing How Students Define Difficulty in RateMyProfessor.com CommentsAlexis Teagarden0Michael Carlozzi1UMass DartmouthUniversity of Rhode Island  Can student comments help solve a problem that student ratings helped create?  We argue that the comment section of student evaluations of teaching (SET) offers a rich site for studying student perspectives on teaching and learning, particularly how students define and value course and instructor difficulty. Employing rhetorically grounded approaches to computer-assisted corpus analysis, we compared 4,600 RateMyProfessors.com instructor profiles meeting the criteria of 1) instructors with high difficulty and high overall quality scores or 2) instructors with high difficulty but low overall quality scores. We identify recurring argumentative patterns in both corpora. In contrast to SET scholarship which often assumes students favor ease over all other course characteristics, we see commenters providing a more nuanced evaluation: condemning contrived forms of difficulty but commending authentic ones. Our findings contribute to discussions of student perspectives on learning and their relationship to course evaluations. The results offer evidence in support of the validity hypothesis in SET scholarship and provide avenues for helping faculty better understand their course evaluations and their  students. https://scholarworks.iu.edu/journals/index.php/josotl/article/view/33932student evaluations of teachingcomputer-assisted corpus analysisstudent perceptions
spellingShingle Alexis Teagarden
Michael Carlozzi
For Good Reason: Analyzing How Students Define Difficulty in RateMyProfessor.com Comments
Journal of the Scholarship of Teaching and Learning
student evaluations of teaching
computer-assisted corpus analysis
student perceptions
title For Good Reason: Analyzing How Students Define Difficulty in RateMyProfessor.com Comments
title_full For Good Reason: Analyzing How Students Define Difficulty in RateMyProfessor.com Comments
title_fullStr For Good Reason: Analyzing How Students Define Difficulty in RateMyProfessor.com Comments
title_full_unstemmed For Good Reason: Analyzing How Students Define Difficulty in RateMyProfessor.com Comments
title_short For Good Reason: Analyzing How Students Define Difficulty in RateMyProfessor.com Comments
title_sort for good reason analyzing how students define difficulty in ratemyprofessor com comments
topic student evaluations of teaching
computer-assisted corpus analysis
student perceptions
url https://scholarworks.iu.edu/journals/index.php/josotl/article/view/33932
work_keys_str_mv AT alexisteagarden forgoodreasonanalyzinghowstudentsdefinedifficultyinratemyprofessorcomcomments
AT michaelcarlozzi forgoodreasonanalyzinghowstudentsdefinedifficultyinratemyprofessorcomcomments