ضریب تأثیر مجلات حوزه تعلیم و تربیت: نقد و تحلیلی مستند

نوع مقاله: مقاله پژوهشی

نویسندگان

1 دانشگاه تسالای یونان

2 عضو هیئت علمی سازمان سنجش آموزش کشور

چکیده

مجلات علمی شکل اولیه ارتباط رسمی در حوزه علم هستند. ضریب تأثیر ISI، یک شاخص کتاب‌شناختی است که متوسط نرخ ارجاع در یک مجله را اندازه می‌گیرد و به صورت گسترده‌ای برای سنجش کیفیت تولیدات علمی افراد، تیم‌های پژوهشی یا مؤسسات، مورد استفاده قرار می‌گیرد. هدف این مقاله، معرفی ضریب تأثیر، آزمون محدودیت‌های اصلی در محاسبه آن، کاربردهای آن و ارائه تصویری از ضریب تأثیر مجلات تعلیم و تربیت در بازه زمانی 2005-2000 است. مسائل متعددی در ارتباط با محاسبه ضریب تأثیر وجود دارد که جدی‌ترین آنها مربوط به روایی و اثربخشی آن است. یافته‌ها بیانگر آن است که مجلات علوم تربیتی تحت شمول مجله گزارش‌های استنادات علمی، حدود 11 درصد مجلات فعال، ارجاع داده شده و علمی را به خود اختصاص داده‌اند. همچنین مجلات تعلیم و تربیت در ارزش‌های مطلق و در مقایسه با سایر حوزه‌های علوم اجتماعی به صورت نسبی دارای ضریب تأثیر پایینی می‌باشند. کاربرد و ضریب همبستگی فراکلاسی مبین آن است که مجلات متعلق به طبقه تعلیم و تربیت و تحقیقات آموزشی به صورت نسبی ضریب تأثیر باثباتی در 6 سال مورد آزمون را داشته‌اند. این در حالی است که موردی برای مجلات طبقه «تعلیم و تربیت استثنایی» مشاهده نشد. نتایج این تحقیق ما را به این تصمیم‌گیری هدایت می‌کند که استفاده از ضریب تأثیر برای ارزشیابی مجلات، مقالات و پژوهشگران باید با دقت همراه باشد.


 

عنوان مقاله [English]

Impact Factor of Journals in the area of Education and Training: A documentary critique

نویسندگان [English]

  • Spacia Togia 1
  • Nicolas T. Gillis 1
  • Gholamreza Yadegarzadeh 2
چکیده [English]

Scientific journals are the primary mode of formal communication in science. The ISI Impact factor serves as a bibliometric indicator that measures the average citation rate of an article in a journal and has been widely used for the assessment of the quality of scientific production of individuals, research teams or institutions. The purpose of this paper was to present the impact factor, examine the main limitations in its calculation and applications and to give a general overview of the impact factor of education journals for the period of 2000–2005. Several problems related to the calculation of the impact factor have raised serious concerns about its validity and usefulness. Our findings suggest that education journals included in the Journal Citation Reports (JCR) represent about 11% of the active referred academic journals. Education journals have relatively low impact factors in absolute values and in comparison to other Social Science categories. Application of the supraclass correlation coefficient showed that journals belonging to the Education and Educational Research category had relatively stable impact factor values for the examined 6 years. This was not the case for the journals from the Education and Educational Special category. It was concluded that the use of impact factor for evaluation of journals, articles and researchers must be carried out with considerable care.

 

 

Aguillo, I. F. (1996). Increasing the between-year stability of the impact factor in the Science Citation Index. Scientometrics, 35, 279–282.

Amin, M., & Mabe, M. (2000). Impact factors: Use and abuse. Perspectives in Publishing, 1, 1–6.

Andersen, H. (2000). Influence and reputation in the social sciences—How much do researchers agree? Journal of Documentation, 56, 674–692.

Bloch, S., & Walter, G. (2001). The impact factor: Time for change. Australian and New Zealand. Journal of Psychiatry, 35, 563–568.

Broome, M. E. (2005). Ratings and rankings: Judging the evaluation of quality. Nursing Outlook, 53, 215–216.

Buela-Casal, G. (2004). Assessing the quality of articles and scientific journals: Proposal for weighted impact factor and a quality index. Psychology in Spain, 8, 60–76.

Calza, L., & Garbisa, S. (1995). Italian professorships. Nature, 374, 492.

Carr, J. E., & Britton, L. N. (2003). Citation trends of applied journals in behavioral psychology: 1981–2000. Journal of Applied Behavioral Analysis, 36, 113–117.

Cheek, J., Garnham, B., & Quan, J. (2006). What’s in a number? Issues in providing evidence of impact and quality of research (ers). Qualitative Health Research, 16, 423–435.

Curti, M., Pistotti, V., Gabutti, G., & Klersy, C. (2001). Impact factors and electronic versions of biomedical scientific journals. Haematologica, 86, 1015–1020.

Dong, P., Loh, M., & Mondry, A. (2005). The ‘‘impact factor’’ revisited. Biomedical Digital Libraries, 2, 7–15.

Fassoulaki, A., Papilas, K., Paraskeva, A., & Patris, K. (2000). Impact factor bias and proposed adjustments for its determination. Acta Anaesthesiologica Scandinavica, 46, 902–905.

Gami, A. S., Montor, V. M., Wilczynski, N. L., & Haynes, R. B. (2004). Author self-citation in the diabetes literature. Canadian Medical Association Journal, 170, 1925–1926.

Garfield, E. (1994). The ISI impact factor: Current contents, June 20. Retrieved February 10, 2007 from /http://scientific.thomson.com/free/essays/journalcitationreports/impactfactor/S.

Garfield, E. (1999). Journal impact factor: A brief review. Canadian Medical Association Journal, 161, 979–980.

Glanzel, W., & Moed, H. F. (2002). Journal impact measures in bibliometric research. Scientometrics, 53, 171–193.

Glanzel, W., & Schoepflin, U. (1999). A bibliometric study of reference literature in the sciences and social sciences. Information Processing and Management, 35, 31–44.

Hamilton, D. P. (1991). Research papers: Who’s uncited now? Science, 25, 251.

Hanson, S. (1995). Impact factor as a misleading tool in the evaluation of medical journals. Lancet, 346, 906.

Hecht, F., Hecht, B. K., & Sandberg, A. A. (1998). The journal ‘‘impact factor’’: A misnamed, misleading, misused measure. Cancer Genetics and Cytogenetics, 104, 77–81.

Hicks, D. (1999). The difficulty of achieving full coverage of international social science literature and the bibliometric consequences. Scientometrics, 44, 193–215.

Kaltenborn, K. F., & Kuhn, K. (2004). The journal impact factor as a parameter for the evaluation of researchers and research. Revista Espanola de Enfermedades Digestivas, 96, 460–476.

Kurmis, A. P. (2003). Current concepts review: Understanding the limitation of the journal impact factor. Journal of Bone and Joint Surging—American, Volume, 85, 2449–2454.

Leff, D. (2005). Making an impact: The rise of the impact factor as a measure of journal quality. Journal of the American Dietetic Association, 105, 29–30.

Linardi, P. M., Coelho, P. M., & Costa, H. M. (1996). The ‘‘impact factor’’ as a criterion for the quality of scientific production is a relative, not absolute, measure. Brazilian Journal of Medical and Biological Research, 29, 555–561.

Line, M. B. (1999). Social science information—The poor relation. INSPEL, 33, 131–136.

Lluch, J. (2005). Some considerations on the use of the impact factor of scientific journals as a tool to evaluate research in psychology. Scientometrics, 65, 189–197.

Manske, P. R. (2004). The impact of the impact factor. The Journal of Hand Surgery, 29A, 983–986.

McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30–46.

Nederhof, A. J., Zwaan, R. A., Debruin, R. E., & Derek, P. J. (1989). Assessing the usefulness of bibliometric indicators for the humanities and the social and behavioral sciences: A comparative study. Scientometrics, 15, 423–435.

Neuberger, J., & Counsell, C. (2002). Impact factors: Uses and abuses. European Journal of Gastroenterology and Hepatology, 14, 209–211.

Opthof, T. (1997). Sense and nonsense about the impact factor. Cardiovascular Research, 33, 1–7.

Orr, D. (2004). Research assessment as an instrument for Steering Higher Education—A comparative study. Journal of Higher Education Policy and Management, 26, 345–362.

Rogers, L. F. (2002). Impact factor: The numbers game. American Journal of Roentgenology, 178, 541–542.

Rousseau, R. (2002). Journal evaluation: Technical and practical issues. Library Trends, 50, 418–439.

Saha, S., Saint, S., & Christakis, D. A. (2003). Impact factor: A valid measure of journal quality. Journal of the Medical Library Association, 91, 42–46.

Saper, C. B. (1999). What’s in a citation impact factor? A journal by any other measure. The Journal of Comparative Neurology, 411, 1–2.

Schulman, C. C. (2005). What you have always wanted to know about the impact factor and did not dare to ask. European Urology, 48, 179–181.

Scully, C., & Lodge, H. (2005). Impact factors and their significance; overrated or misused? British Dental Journal, 198, 391–393.

Seglen, P. O. (1997). Why the impact factor of journals should not be used for evaluating research. British Medical Journal, 314, 498–502.

Sevinc, A. (Ed.). (2004). Manipulating impact factor: An unethical issue or an Editor’s choice? Swiss Medical Weekly, 134, 410–411.

Sims, J. L., & McGhee, C. N. J. (2003). Citation analysis and journal impact factors in ophthalmology and vision science journals. Clinical and Experimental Ophthalmology, 31, 14–22.

Smart, J. C. (1983). Stability of education journal characteristics: 1977–1980. Research in Higher Education, 19, 285–293.

Smith, R. (1998). Unscientific practice flourishes in science: Impact factors of journals should not be used in research assessment. British Medical Journal, 316, 1036.

Steele, C., Butler, L., & Kingsley, D. (2006). The publishing imperative: The pervasive influence of publication metrics. Learned Publishing, 19, 277–290.

Sutter, M., & Kocher, M. (2001). Tools for evaluating research output. Evaluation Review, 25, 555–566.

Taubes, G. (1993). Measure for measure in science. Science, 260, 884–886.

Thomson Scientific (2007). The ISI impact factor. Retrieved January 30, 2007, from /http://scientific.thomson.com/free/essays/journalcitationreports/impactfactor/S.

Tsigilis, N., & Theodosiou, A. (2003). Temporal stability of the Intrinsic Motivation Inventory. Perceptual and Motor Skills, 97, 271–280.

Vinkler, P. (1986). Evaluation of some methods for the relative assessment of scientific publications. Scientometrics, 10, 157–177.

Walter, G., Bloch, S., Hunt, G., & Fisher, K. (2003). Counting on citations: A flawed way to measure quality. The Medical Journal of Australia, 178, 280–281.

Whitehouse, G. H. (2002). Impact factor: Facts and myths. European Radiology, 12, 715–717.