There is No Revenge! A Longitudinal Study of How Failed Students Evaluate the Teaching Quality of University Professors

Document Type : Original Article

Author

Assistant Professor, Department of Educational Sciences, Faculty of Humanities, University of Kashan, Kashan, Iran

10.22034/hel.2024.709931

Abstract

Objective: Do students, consciously or unconsciously, show biased attitudes in their evaluation of the teacher's teaching in next semesters? The purpose of the present panel study was to test the hypothesis that failed students will give a lower evaluation score to their professors in the subsequent semesters.
Methods: In order to test this assumption, the data of academic progress and evaluation of students of a specific entry during two consecutive semesters was checked and after conditioning the data according to the design and purpose of the research, a sample of 268 failed students was obtained.
Results: The analyzes showed that, contrary to the initial hypothesis, the average evaluation scores of failed students in the next semester are significantly higher than the previous semester. At the same time, after applying the random effects parameters model and controlling the variance caused by the teacher factor; on the one hand, it was observed that with a decrease of one unit in student's GPA as the main indicator of academic ability and talent, there is a decrease of thirteen percent in the evaluation of the student. On the other hand, with one-unit increase in the score of failed students, there is a significant increase of one percent in their evaluation of professors.
Conclusion: From the sum of these findings, it can be concluded that although there is a relationship between the academic ability and the grade of failed students with their evaluation of their professors, these students’ evaluations is more influenced by impression and understanding of the professor's educational and professional activities in the next semester rather than their poor grade in the previous semester.

Keywords

Main Subjects


References

Baker, Vicki. L.  & Manning, Caroline. E. N. (2021). A Mid-Career Faculty Agenda: A Review of Four Decades of Research and Practice. In: Laura W. Perna, Higher Education: Handbook of Theory and Research. Switzerland: Springer.
Berk, Ronald. A. (2006). Thirteen Strategies to Measure College Teaching. Virginia: Stylus.
Berezvai, Zombor., Lukats, Gergely. D., & Molontay, Roland. (2020). Can professors buy better evaluation with lenient grading? The effect of grade inflation on student evaluation of teaching. Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2020.1821866
Borch, I., Sandvoll, R. & Risor, T. (2020). Discrepancies in purposes of student course evaluations: what does it mean to be “satisfied”? Educational Assessment, Evaluation and Accountability, 32 (1): 83-102.
Buller, Jeffrey. L. (2012). Best practices in faculty evaluation: A Practical guide for academic leaders. San Francisco. Jossey-Bass.
Cannon, Edmund., & Cipriani, Giam. Pietro. (2022). Quantifying halo effects in students’ evaluation of teaching. Assessment & Evaluation in Higher Education, 47 (1): 1-14.
Code, Warren., et al. (2022).  Collaboration and mentoring to enhance professional learning in higher education. In: Helen King, Developing Expertise for Teaching in Higher Education. London: Routledge.
Esarey, Justin., & Valdes, Natalie. (2020). Unbiased, reliable, and valid student evaluations can still be unfair. Assessment & Evaluation in Higher Education, 45:8, 1106-1120.
Griffin, Kimberly. A. (2020). Institutional Barriers, Strategies, and Benefits to Increasing the Representation of Women and Men of Color in the Professoriate In: Laura W. Perna, Higher Education: Handbook of Theory and Research (Volume 35). Philadelphia: Springer.
Gunduz, Necla., & Fokoueb, Ernest. (2021). Understanding students’ evaluations of professors using non-negative matrix factorization. Journal of Applied Statistics, 48 (13-15): 2961-2981.
He, Jibo., & et al. (2022). Reciprocity in college teaching: a big data study based on online student evaluation of 919,750 professors. Assessment & Evaluation in Higher Education, DOI:10.1080/02602938.2022.2067980.
Holmes, Jeffrey. D.  (2016). Great myths of education and learning. Hoboken: Wiley-Blackwell.
Jahangiri, Leila., & Mucciolo, Tom. (2012). A Guide to Better Teaching: Skills, Advice, and Evaluation for College and University Professors. Lanham: Rowman & Littlefield Publishers, Inc.
Johnson, R. Burke., & Christensen, Larry. (2016). Educational research: Quantitative, qualitative, and mixed approaches. Los Angeles: Sage.  
King, Helen. (2022). The characteristics of expertise for teaching in higher education. In: Helen King, Developing Expertise for Teaching in Higher Education. London: Routledge.
Kwok, Kathryna & Potter, Jackie. (2022). Supportive woman, engaging man Gendered differences in student perceptions of teaching excellence. In: Helen King, Developing Expertise for Teaching in Higher Education. London: Routledge.
Kreitzer, R.J., Sweet-Cushman, J. (2022). Evaluating Student Evaluations of Teaching: A Review of Measurement and Equity Bias in SETs and Recommendations for Ethical Reform. Journal of Academic Ethics, 20 (1): 73–84.
Lakeman, Richard., & et al. (2022). Playing the SET game: how teachers view the impact of student evaluation on the experience of teaching and learning. Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2022.2126430
Lloyd, Margaret., & Wright-Brough, Freya. (2022). Setting out SET: a situational mapping of student evaluation of teaching in Australian higher education, Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2022.2130169
Marsh, Herbert. W. (1977). The Validity of Students’ Evaluations: Classroom Evaluations of Instructors Independently Nominated as Best and Worst Teachers by Graduating Seniors. American Educational Research Journal, 14 (4): 441-447.
Marsh, Herbert. W. (2001). Distinguishing between Good (Useful) and Bad Workloads on Students’ Evaluations of Teaching. American Educational Research Journal, 38 (1): 183-212.
Miller, Michael T., & Gearhart, David. (2021). Handbook of Research on the Changing Role of College and University Leadership. Hershey PA, USA: IGI Global.
Pratt, Daniel. D. (1997). Reconceptualizing the Evaluation of Teaching in Higher Education. Higher Education, 34 (1): 23-44.
Smith, Marc., & Firth, Jonathan. (2018).  Psychology in the Classroom: A Teacher’s Guide to What Works. New York: Routledge.
Stroebe, Wolfgang. (2020). Student Evaluations of Teaching Encourages Poor Teaching and Contributes to Grade Inflation: A Theoretical and Empirical Analysis. Basic and Applied Social Psychology, 42 (4): 276-294.