تحلیل کتابسنجی مفاهیم ارزیابی بروندادهای پژوهشی علوم انسانی

نوع مقاله : مقاله پژوهشی

نویسندگان

1 کارشناسی ارشد علم اطلاعات و دانش شناسی، دانشگاه اصفهان، اصفهان، ایران

2 دانشیار گروه علم اطلاعات و دانش‌شناسی، دانشگاه اصفهان، اصفهان، ایران.

3 دانشیار گروه علم اطلاعات و دانش‌شناسی، دانشگاه اصفهان، اصفهان، ایران

4 دکترای علم اطلاعات و دانش شناسی دانشگاه اصفهان، اصفهان، ایران

چکیده

هدف: با توجه به تفاوت علوم ‌انسانی با علوم دیگر و نیاز به ارزیابی متفاوت آن، چشم‌انداز این پژوهش شناسایی مفاهیم ارزیابی بروندادهای پژوهشی علوم‌انسانی و بررسی سیر تحول آن‌هاست.
روش‌شناسی: پژوهش حاضر از نظر هدف، کاربردی بوده و با فنون کتابسنجی انجام شده‌است. جامعه آماری شامل مقالات با موضوع ارزیابی بروندادهای پژوهشی علوم ‌انسانی در دو پایگاه استنادی وب‌آوساینس و اسکوپوس از سال 1994 تا 2022 است. از نرم‌افزار بیبلیومتریکس برای تحلیل داده‌ها استفاده شده‌است.
یافته‌ها: انتشار مقالات مرتبط با ارزیابی بروندادهای پژوهشی علوم‌انسانی روند صعودی داشته ‌است. ارزیابی بروندادهای پژوهشی علوم‌انسانی در سال‌های آغازین بیشتر با روش کمّی بوده و از روش‌های ارزیابی علوم دیگر بهره‌گیری شده‌است، اما در سال‌های اخیر وجود کلیدواژه‌های هسته و پرکاربردی چون تأثیر پژوهش، سنجش اثر و اثر اجتماعی نشان‌دهنده تغییر رویکرد از روش ارزیابی صرفاً کمی به ترکیب روش‌های کمی و کیفی است. در مجموع، ساختار دانشی حوزه ارزیابی علوم-انسانی از پنج خوشه تشکیل شده‌است: 1. سنجش اثر، 2. نمایه استنادی، 3. مقاله مجله، 4. عملکرد پژوهش، و 5. مقاله پژوهشی.
نتیجه‌گیری: ارزیابی بروندادهای پژوهشی علوم انسانی در حال تغییر و تحول بوده و خواهد بود و لازم است ذینفعان آن به بروزرسانی دانش و عمل خود مبادرت ورزند.

کلیدواژه‌ها

موضوعات


عنوان مقاله [English]

Bibliometric Analysis of the Evaluation Concepts of Humanities Research Outputs

نویسندگان [English]

  • Nahid Kabiri Khozani 1
  • Ali Mansouri 2
  • mitra Pashootanizadeh 3
  • elahe ebrahimi dorcheh 4
1 MA in Knowledge and Information Sciences, Department of Knowledge and Information Science, University of Isfahan, Isfahan, Iran
2 Associate Professor, Department of Knowledge and Information Science, University of Isfahan, Isfahan, Iran.
3 Associate Professor, Department of Knowledge and Information Science, University of Isfahan, Isfahan, Iran
4 PhD in Knowledge and Information Science, Department of Knowledge and Information Science, University of Isfahan, Isfahan, Iran
چکیده [English]

Purpose: Humanities have a different nature from other sciences, and for this reason, the evaluation of its research outputs needs to be different. By studying the status and evolution of the evaluation components of humanities, it is clear what are its main and secondary topics and what changes it has undergone over time. In this case, the strengths and weaknesses will be revealed and the field will be provided for more targeted research and more accurate policy-making in the future. So, the purpose of the present study is to identify and clearly and comprehensively understand the concepts related to the evaluation of humanities research outputs to help researchers and policymakers in the field of humanities evaluation.
Methodology: The current research is practical in terms of purpose and has been done with bibliometric techniques. To conduct the research, the articles that were indexed in Web of Science and Scopus with the topic of evaluation of humanities research outputs from 1994-2022 were searched according to specific goals and strategies. Our search strategy was: ("research output" OR "scientific output") AND (humanities OR "human science") AND (evaluation OR assessment). Finally, 224 sources were analyzed. After storing and cleaning the data, data analysis was done using the bibliometrix software. Since the two-word keywords had more relevant and precise concepts than the other two types, they were chosen as the investigated keywords. Because the threshold of repeating each keyword at least 6 times was considered, in the end, 224 keywords were left for use and analysis. Various methods such as descriptive statistics, co-word analysis, network analysis, time series analysis, thematic map, and clustering have been used for data analysis according to each research question.
Findings: Based on the findings, the publication of papers related to the evaluation of humanities research outputs has had an upward trend and has progressed in sync with other fields. This statistic has reached from 1 article in 1994 to 45 articles in 2020. This finding shows the growth of evaluation in humanities in recent years. Concepts and thematic areas show that the evaluation method used in the early years was mostly quantitative and the methods of other sciences were used, but in recent years, the existence of core and widely used keywords such as effect evaluation, citation effect, Performance index, bibliography, scientific communication, research impact, and social impact indicate a change in approach from a purely quantitative method to a combination of quantitative and qualitative methods. Based on the time series of concepts, the citation index has boomed since 2005 for the humanities. Bibliometric indicators have been used for many years (2002), but the research impact is more recent and has entered the research of this field since 2013. Among these cases, the social impact and research quality have impressive numbers, which shows the shift from quantity to quality. The concepts of citation index, research performance, and research impact are the most central. The concepts of citation index, impact assessment, and journal article are among the most frequent keywords. In total, based on the reviewed articles, the knowledge structure of the field of evaluation of humanities consists of five clusters: 1. impact assessment, 2. citation index, 3. journal article, 4. research performance, and 5. research article. The impact assessment cluster had the most concepts, the research performance cluster had the highest centrality, and the research article cluster had the most density. The thematic map showed that motor concepts in the evaluation include research performance, bibliometric indicators, journal articles and publication patterns. Basic concepts include research articles and evaluation systems. Research quality is an emerging concept. Citation index and bibliometric analysis are very developed and isolated concepts.
Conclusion: Considering the importance of human sciences, continuous evaluation is necessary to improve its position to advance the expected goals. But what is important and should be given special attention is the difference between humanities and other sciences in the nature and method that should be considered in the evaluation. Therefore, in the evaluation of human sciences, appropriate concepts should be used, and their identification by examining the conducted research is necessary for research and policy-making in this field. The evaluation of humanities research outputs is and will be changing and evolving, and its beneficiaries must update their knowledge and practice.

کلیدواژه‌ها [English]

  • research evaluation
  • research outputs
  • evaluation criteria
  • evaluation indicators
  • humanities