Critical Thinking Assessment: Introducing Traditional and Modern Methods

Document Type : Original Article

Authors

Abstract

In the recent decade, critical thinking as an educational goal has found a special position in many higher education systems. Therefore, recognizing the methods of measuring this skill in order to train it properly requires attention among learners. The present article was conducted to introduce the existing approaches in the process of measuring critical thinking in a documentary method. After searching for related documents in the foreign scientific databases of Science Direct, Wiley, Jstore, ERIC, ProQuest, Web of Science, Taylor and Francis and the domestic databases of SID and Noormags and critical thinking sites, including the Association of American Colleges and Universities, Educational Testing Service, Critical Thinking, American College Test, and Council for Aid to Education, 32 documents were retrieved between 1980 and 2017, and finally, 20 documents were selected based on the criterion of being expert of authors in the field of critical thinking, being up-to-date, and relevance. The analysis of documents was conducted using qualitative content analysis. The findings led to the identification of critical thinking instruments in two traditional and modern approaches. Overall, according to the existing challenges in the tests of the traditional approach, it is expected open-ended instruments in the modern approach with a qualitative method to be considered by experts in this field for creating a desirable status in assessing this skill.

Keywords


خلیلی، حسین؛ سلیمانی، محسن (1382). تعیین اعتماد، اعتبار و هنجار نمرات آزمون مهارت‌های تفکر انتقادی کالیفرنیا فرم ب. مجله دانشگاه علوم پزشکی بابل، 5(2)، 90-84.
کاویانی‌مهر، میترا؛ سلیمی، مجید؛ لیاقت، ریتا (1394). ویژگی‌های روان‌سنجی آزمون تفکر انتقادی واتسون - گلیزر و ارتباط آن با خلاقیت. فصلنامه پژوهش‌های کاربردی روان‌شناختی، 6(2)، 77-90.  
مؤمنی‌راد، اکبر؛ علی‌آبادی، خدیجه؛ فردانش، هاشم؛ مزینی، ناصر (1392). تحلیل محتوای کیفی در آیین پژوهش: ماهیت، مراحل و اعتبار نتایج. فصلنامه اندازه‌گیری تربیتی، 4(14)، 187-222.
Arum, R., & Roksa, J. (2011). Academically adrift: Limited Learning on collede campuses. Chicago, IL: University of Chicago Press.
Association of American Colleges and Universities. (2017). On solid ground: VALUE report 2017. Retrieved from:
Butler, H. A. (2012). Halpern Critical Thinking Assessment predicts real-world outcomes of critical thinking. Applied Cognitive Psychology, 26(5), 721-729. doi: 10.1002/acp.2851.
CAAP Program Management. (2012). ACT CAAP technical handbook 2011–2012. IowaCity, IA: Author.
De Bie, H., Wilhelm, P., & van der Meij, H. (2015). The Halpern Critical Thinking Assessment: Toward a Dutch appraisal of critical thinking. Thinking Skills & Creativity, 17, 33-44. doi:10.1016/j.tsc.2015.04.001.
Ennis, R. H., & Weir, E. (1985). The Ennis–Weir Critical Thinking Essay Test. Pacific Grove, CA: Midwest.
Ennis, R. H. (1993). Critical Thinking Assessment. Theory into Practice, 32(3), 179-186. doi:10.1080/00405849309543594.
Ennis, R. H., Millman, J., & Tomko, T. N. (2005). Cornell Critical Thinking Tests Level X & Level Z Manual (2th ed). Seaside, CA: The Critical Thinking Co.
Elder, L., & Paul, R. (2008). Critical Thinking in a World of Accelerating Change and Complexity. Social Education, 72(7), 345-388.
Educational Testing Service (2010). ETS proficiency profile user’s guide. Princeton, NJ: Author.
Fisher, A. (2011). Critical thinking: An introduction. Cambridge, UK: Cambridge University Press.
Facione, P. A. (1990a). The California Critical Thinking Skills Test-College Level. Technical Report# 1. Experimental Validation and Content Validity. Millbrae, CA: The California Academic Press.
Facione, P. A. (1990b). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction. Millbrae. CA: The California Academic press.
Facione, P. A. (2000). The disposition toward critical thinking: Its character, measurement, and relationship to critical thinking skill. Informal Logic, 20(1), 61-84.
Facione, P. A. (2015). Critical thinking: What it is and why it counts. Retrieved from.
www.insightassessment.com/About-US-Measured-Reasons/pdf_file/Critical_Thinking What_It_Is_and_Why_It Counts.
Glaser, E. M. (1941). An experiment in the development of critical thinking. New York, NY: Teachers College of Columbia University.
Halpern, D. F. (2013). Thought and knowledge: An introduction to critical thinking (4th ed.). Mahwah, NJ: Lawrence Erlbaum Associate.
Ku, K. Y. (2009). Assessing students’ critical thinking performance: Urging for measurements using multi-response format. Thinking Skills & Creativity4(1), 70-76.
Kennedy, M., Fisher, M. B., & Ennis, R. H. (1991). Critical thinking: Literature review and needed research. In L. Idol, & B. F. Jones (Eds.), Educational Values and Cognitive Instruction: Implications for Reform (pp. 11-40). Hillsdale, NJ: Lawrence Erlbaum.
Kobrin, J. L., Sato, E., Lai, E., & Weegar, J. (2016). Examination of the Constructs Assessed by Published Tests of Critical Thinking. Paper presented at the Annual Meeting of the National Council on Measurement in Education. April 9-11, Washington, DC.
Lewis, A., & Smith, D. (1993). Defining higher order thinking. Theory into Practice, 32(3), 131- 137.
Lai, E. R. (2011). Critical thinking: A literature review. Retrieved from http://images.pearsonassessments.com/images/tmrs/CriticalThinkingReviewFINAL.pdf.
Liu, O. L., Frankel, L., & Roohr, K. C. (2014). Assessing critical Thinking in Higher Education: current state and Directions for Next-Generation Assessment. ETS Research Report Series, 14(10), 1-23.
Liu, O. L., Mao, L., Frankel, L., & Xu, J. (2016). Assessing critical thinking in higher education: the HEIghten™ approach and preliminary validity evidence. Assessment & Evaluation in Higher Education, 41(5), 677-694.
McPeck, J. E. (2016). Critical thinking and education. London, UK: Routledge.
Maki, P. L. (2010). Assessing for learning: Building a sustainable commitment across the institution (2th ed.). Sterling, VA: Stylus Publishing.
Norman, Chery I. R. (2017). Student performance on Institutional Learning Outcomes (Doctoral dissertation). University of St. Cloud State, Minnesota. Retrieved from http://repository.stcloudstate.edu/hied _ etds/12.
Paul, R., & Elder, L. (2012). The international Critical Thinking Reading & Writing Test (How to Assess close Reading and Substantive Writing) (2thed.). Dillon Beach, CA: Foundation for Critical Thinking.
Paul, R., & Elder, L. (2013). International Critical Thinking essay Test. Retrieved fromhttp://www.criticalthinking/store/products/international-critical-thinking-essay-test/185.
Pedhazur, E. J., & Schmelkin, L. P. (2013). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Lawrence ErIbaum.
Rhodes, T. L. (2011). Emerging evidence on using rubrics. PeerReview, 13/14, 4(1).4-5. Retrieved from
Sternberg, R. J. (1986). Critical thinking: Its nature, measurement, and improvement. Washington, DC: National Institute of Education.
Sternberg, R. J. (2011). Who is really adrift? Inside Higher Ed. Retrieved from https://www.insidehighered.com/views/2011/02/08/a_critique_of_academically_adrift_and_the_test_behind_many_of_the_findings.
Taube, K. T. (1997). Critical thinking ability and disposition as factors of performance on a written critical thinking test. The Journal of General Education, 46(2), 129–164.
Verburgh, A., François, S., Elen, J., & Janssen, R. (2013). The Assessment of Critical Thinking Critically Assessed in Higher Education: A Validation Study of the CCTT and the HCTA. Education Research International, 2013(1), 1–14. https://doi.org/10.1155/2013/19892.
Watson, G., & Glaser, E. M. (1980). Watson- Glaser Critical Thinking Appraisal, forms A and B manual. San Antonio, TX: The Psychological Corporation.
Watson, G., & Glaser, E. M. (2008). Watson-Glaser critical Thinking appraisal: short form manual. Upper Saddle River, NJ: Pearson Education.
Zahner, D. (2013). Reliability and validity of CLA+. New York, NY: Council for Aid to Education.