The Relationship Between Textbooks’ Teaching Ranks in World Top Universities and Citation, PageRank and HITS Indicators

Document Type : Research Paper

Authors

1 Ph.D. Candidate in Information Science and Knowledge Studies, Uni-versity of Shiraz

2 Assistant Professor, Department of Information Science and Knowledge Studies

3 Professor, Department of Information Science and Knowledge Studies, University of Shiraz

4 Associate Professor, Department of Information Science and Knowledge Studies, University of Shiraz

Abstract

Purpose: Books are significant scholarly publications which contribute a large part to the diffusion of scholarly findings and aid general knowledge promotion. The major goal of this research was to determine the relationship between teaching ranks of textbooks used in World Top Rank Universities according to Times Higher Education and indicators extracted from the citation, PageRank, and HITS.
Methodology: The current study is applied research and utilizes descriptive correlation method. This research was conducted using citation analysis. The population involved 1869 textbooks from the collections of indexed books in Scopus. The books were identified through matching 168,866 book titles published between 1953- 2017 which were indexed in Scopus and recorded in Open Syllabus Project as teaching resources of World Top Rank Universities. The Library of Congress Classification was used to determine book subjects. The citations count of each book was exported from Scopus. PageRank and HITS algorithms were calculated by books citation networks using the Sci2Tool program.
Findings: The results showed that there was a weak relationship among all three levels of teaching ranks with citation counts. Besides, The correlation between teaching ranks and PageRank were moderate and significant. Of the two ranking scores associated with the HITS algorithm, the correlations between teaching ranks and authority scores were significantly weak, but they were only significant at sub-classification levels with Hub scores. Furthermore, teaching ranks had a significantly moderate correlation with both PageRank and Authority scores in Social Sciences (H), Philosophy, Psychology, Religion (B), Politics (J), Law (K) and World History (D).
Conclusion: Pagerank and authority scores of books calculated based upon the book citation network can be used in determining the teaching impact of books in some fields. Hence, this research suggests international citation indexes to utilize these indicators for books or to make the calculation of such indicators feasible for users. This is the first research conducted to examine the relationship between teaching rank of books with citation network indicators calculated by PageRank and HITS algorithms.

Keywords

References

جمالی زواره، بتول، نصر، احمدرضا، و آرمند، محمد (1387). معیارهای ارزیابی کتاب‌های درسی دانشگاهی. پژوهش و نگارش کتب دانشگاهی، سال سیزدهم (1)، 9-31.
حریری، نجلا، و فیروزی، نگار (1393). تحلیل استنادی کتاب‌های درسی پزشکی سایت آمازون از نظر استناد به مقالات دانشکده‌های داروسازی دولتی ایران. مدیریت اطلاعات سلامت، سال یازدهم (2)، 190-198.
رضی، احمد (1388). شاخصه‌های ارزیابی و نقد کتاب‌های درسی دانشگاهی. پژوهش و نگارش کتب دانشگاهی، سال چهاردهم (1)، 21-.
سارلی، ناصرقلی (1383). کتاب درسی دانشگاهی و معیارسازی زبان. پژوهش و نگارش کتب دانشگاهی، سال هشتم (4)، 9-.
ملکی، حسن (1385). مبانی و معیارهای نقد کتاب درسی دانشگاهی. پژوهش و نگارش کتب دانشگاهی، سال یازدهم (1)، 9-20.
نوذری، سودابه، حری، عباس، حریری، نجلا، و منصوریان، یزدان (1392). تحلیل استنادی منابع کتاب‌ها درباره حافظ. مطالعات ملی کتابداری و سازماندهی اطلاعات، سال بیست و چهارم (1)، 52-75.
یارمحمدیان، محمدحسین، آرمند، محمد، و زارعی، هاجر (1389). ارزیابی کتاب‌های درسی دانشگاهی علوم انسانی بر اساس شاخص‌های مطلوب کتاب‌های درسی دانشگاهی. پژوهش و نگارش کتب دانشگاهی، سال پانزدهم (1)، 36-58.
.Abrizah, A., & Thelwall, M. (2014). Can the impact of non-‏‏‏‏‏Western academic books be measured? An investigation of Google Books and Google Scholar for Malaysia. Journal of the Association for Information Science and Technology, 65(12), 2498-‏‏‏‏‏2508. doi:doi:10.1002/ asi.23145
Bollen, J., Rodriquez, M. A., & Van de Sompel, H. (2006). Journal status. Scientometrics, 69(3), 669-687.
Boyack, K. W., & Klavans, R. (2014). Including cited non-source items in a large-scale map of science: What difference does it make? Journal of Informetrics, 8, 569-580. doi:10.1016/j.joi.2014.04.001
Chen, P., Xie, H., Maslov, S., & Redner, S. (2007). Finding scientific gems with Google’s PageRank algorithm. Journal of Informetrics, 1(1), 8-15.
Chi, P. S., Jeuris, W., Thijs, B., & Glänzel, W. (2015). Book Bibliometrics – A New Perspective and Challenge in Indicator Building Based on the Book Citation Index. Paper presented at the ISSI 2015-The 15th International Conference on Scientometrics and Informetrics, Turkey.
Cronin, B., Snyder, H., & Atkins, H. (1997). Comparative citation rankings of authors in monographic and journal literature: A study of sociology. Journal of documentation, 53(3), 263-273.
Finkstaedt, T. (1990). Measuring research performance in the humanities. Scientometrics, 19(4/5), 407-417.
Furnham, A. F. (1990). Quantifying quality: An argument in favour of citation counts. Journal of Further and Higher Education, 14(2), 105-110.
Griggs, R. A., & Christopher, A. N. (2016). Who’s Who in Introductory Psychology Textbooks: A Citation Analysis Redux. Teaching of Psychology, 43(2), 108–119. https://doi.org/10.1177/0098628316636276
Griggs, R. A., & Proctor, D. L. (2002). A citation analysis of who's who in introductory textbooks. Teaching of Psychology, 29(3), 203-206.
Guidera, J. (2009). Content and Citation Analysis of Interdesciplinary Humanities Textbooks within A Framework of Curriculum Theory.
Hammarfelt, B. (2011). Interdisciplinarity and the intellectual base of literature studies: citation analysis of highly cited monographs. Scientometrics, 86, 705-725. doi:10.1007/s11192-010-0314-5
Hammarfelt, B. (2016). Beyond Coverage: Toward a Bibliometrics for the Humanities Research Assessment in the Humanities (pp. 115-131): Springer International Publishing.
Hicks, D., J. Potter (1991), Sociology of scientific knowledge: A reflexive citation analysis or science disciplines and disciplining science," Social Studies of Science, 21,459-501.
Hicks, D. (1999). The Difficulty of Achieving Full Coverage of International Social Science Literature and the Bibliometric Consequences. Scientometrics, 44(2), 193-215. doi:10.1007/bf02457380
Hoaas, D. J., & Madigan, L. J. (1999). A citation analysis of economists in principles of economics textbooks. The Social Science Journal, 36(3), 525-532.
Hodson, D. (2003). Time for action: Science education for an aternative future. International Journal of Science Education, 25(6), 645-670. DOI: 10.1080/09500690305021
Jaffe, E. D. (1997). International marketing textbooks: a citation analysis as an indicator of the discipline’s boundaries. International Marketing Review, 14(1), 9-19.
Jiang, X., Sun, X., Yang, Z., Zhuge, H., & Yao, J. (2016). Exploiting Heterogeneous Scientific Literature Networks to Combat Ranking Bias: Evidence From the Computational Linguistics Area. Journal of the American Society for Information Science and Technology, 67(7), 1679-1702. doi:10.1002/asi.23463
Kleinberg, J. M. (1999). Authoritative sources in a hyperlinked environment. Journal of the ACM (JACM), 46(5), 604-632.
Knapp, T. J. (1985). Who's who in American introductory psychology textbooks: A citation study. Teaching of Psychology, 12(1), 15-17.
Kousha, K., & Thelwall, M. (2008). Assessing the Impact of Disciplinary Research on Teaching: An Automatic Analysis of Online Syllabuses. Journal of the American Society for Information Science and Technology, 59(13), 2060-2069. doi:10.1002/asi.20920
Kousha, K., & Thelwall, M. (2009). Google book search: Citation analysis for social science and the humanities. Journal of the American Society for Information Science and Technology, 60(8), 1537-1549. doi:10.1002/asi.21085
Kousha, K., Thelwall, M., & Rezaie, S. (2011). Assessing the Citation Impact of Books: The Role of Google Books, Google Scholar, and Scopus. Journal of the American Society for Information Science and Technology, 62(11), 2147-2164. doi:10.1002/asi.21608
Kousha, K., & Thelwall, M. (2015). An Automatic Method for Extracting Citations from Google Books. Journal of the American Society for Information Science and Technology, 66(2), 309-320.
Kousha, K., & Thelwall, M. (2016). An Automatic Method for Assessing the Teaching Impact of Books from Online Academic Syllabi. Journal of the Association for Information Science and Technology, 67(12), 2993-3007. doi:10.1002/asi.23542
Kousha, K., & Thelwall, M. (2017). Are Wikipedia citations important evidence of the impact of scholarly articles and books? Journal of the Association for Information Science and Technology, 68(3), 762-779. doi:10.1002/asi.23694.
Leydesdorff, L. (2009). How are New Citation-Based Journal Indicators Adding to the BibliometricToolbox? Journal of the American Society for Information Science and Technology, 60(7), 1327-1336. doi:10.1002/asi.21024
Leydesdorff, L., & Salah, A. A. A. (2010). Maps on the basis of the Arts & Humanities Citation Index: The journals Leonardo and Art Journal, and ‘‘Digital Humanities’’ as a topic. Journal of the American Society for Information Science and Technology, 61(4), 787-801.
Lee, H., Song, J. K. M., & Kim, C. O. (2015). Coherence analysis of research and education using topic modeling. Scientometrics, 102, 1119-1137. doi:10.1007/s11192-014-1453-x
Lepionka, M. E. (2005). Writing and Developing Your College Textbook Supplements: Atlantic Path Publishing.
Linmans, A. J. M. (2010). Why with bibliometrics the Humanities does not need to be the weakest link: Indicators for research evaluation based on citations, library holdings, and productivity measures. Scientometrics, 83, 337–354. doi:10.1007/s11192-009-0088-9.
Ma, N., Guan, J., & Zhao, Y. (2008). Bringing PageRank to the citation analysis. Information Processing and Management, 44:800-810. doi:10.1016/j.ipm.2007.06.006
Martins, W. S., Gonçalves, M. A., Laender, A. H. F., & Ziviani, N. (2010). Assessing the quality of scientific conferences based on bibliographic citations. Scientometrics, 83(1), 133-155. doi:10.1007/s11192-009-0078-y.
Nederhof, A. J. (1989). Books and chapters are not to be neglected in measuring research productivity, American Psychologist, 734-735.
Nederhof, A. J., Leeuwen, T. N., & Raan, A. F. J. (2009). Highly cited non-journal publications in political science, economics and psychology: a first exploration. Scientometrics, 83(2), 363-374. doi:10.1007/s11192-009-0086-y.
Page, L., Brin, S., Motwani, R., & Winograd, T. (1999). The PageRank citation ranking: Bringing order to the web. Stanford InfoLab.
Pinski, G., & Narin, F. (1976). Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics. Information Processing and Management, 12(5), 297-312.
Radicchi, F., Fortunato, S., Markines, B., & Vespignani, A. (2009). Diffusion of scientific credits and the ranking of scientists. Physical Review E-Statistical, Nonlinear, and Soft Matter Physics, 80(5), 056103.
SENSE (2009). RANKING OF ACADEMIC PUBLISHERS – approved by SENSE General Board in May 2009. Retrieved from http://www.sense.nl/gfx_content/documents/ ABCDEindeling%20Scientific%20Publishers%20SENSE_approved_May_2009.pdf.
Takasuna, M. (2013). Important literature referenced in textbooks on the history of psychology: A preliminary citation analysis using 13 textbooks published after 2001. In: Cheiron.
Vaughan, L., & Shaw, D. (2003). Bibliographic and Web citations: What is the difference? Journal of the American Society for Information Science and Technology, 54(14), 1313–1324.
Waltman, L., Yan, E., & Eck, N. J. v. (2011). A recursive field-normalized bibliometric performance indicator: an application to the field of library and information science. Scientometrics, 89, 301-314. doi:10.1007/s11192-011-0449-z.
Zhou, D., Orshanskiy, S. A., Zha, H., & Giles, C. L. (2007). Co-ranking authors and documents in a heterogeneous network. Paper presented at the IEEE International Conference on Data Mining (ICDM).
Zhuge, H., & Zhang, J. (2010). Topological Centrality and its e-Science Applications. Journal of the American Society for Information Science and Technology, 61(9), 1824-1841. doi:10.1002/asi.21353.
Zuccala, A., Guns, R., Cornacchia, R., & Bod, R. (2015). Can We Rank Scholarly Book Publishers? A Bibliometric Experiment with the Field of History. Journal of the American Society for Information Science and Technology, 66(7), 1333-1347. doi:10.1002/asi.23267.

Files

Share

How to cite

Statistics