Dimensions of Research Impact: A Systematic Review

Document Type : Research Paper

Authors

1 MA in Psychology, Instructor of Iranian Research Institute for Infor-mation Science and Technology (IRANDOC), Tehran, Iran

2 PhD in library and Information Science, Assistant Professor of Iranian Research Institute for Information Science and Technology (IRANDOC), Tehran, Iran.

Abstract

purpose: Scientific institutes repeatedly emphasize that strategies shall be implemented for recognition of research impact. The important problem is how we can evaluate the impact of research with logical and recurrent planning. The purpose of this research is recognition of different dimensions of research impact.
Methodology: The present study was conducted through systematic review in eight steps: assigning topics to the reviews, determining the inclusion/exclusion criteria, syntax control (using the tools available in the database and related standard keywords), locating studies (on Web of Science, Scopus, Lisa, Ovid, Proqest, Ebsco and Persian language database of Ganj, SID, Magiran, Noormags), selecting studies (28722 articles abstracts), assessing study quality (in this stage, after designing a quality evaluation tools, the resources extracted by two researchers were independently studied and scored (112 relevant papers), extracting data, and finally, the analysis and presentation of the results.
Findings: The research results showed ten different dimensions: Academic, Altmetrics, Healthcare, Economy, Security and defense, Social, Culture, Ecology, Policy, and Services. Among them, the most emphasis was on economic, social and health dimensions, with the least emphasis on services, and security and defense.
Conclusion: Ten effective dimensions Identified in this study are used to ensure the effectiveness of research and can be used in the form of an effective research evaluation system.

Keywords

References

احسانی، وحید، اعظمی، موسی، نجفی، سیدمحمدباقر، و سهیلی، فرامرز.(1395 ). اثربخشی پژوهش‌های علمی داخلی بر شاخص‌های توسعه‌ی ایران.. پژوهشنامه پردازش و مدیریت اطلاعات، 32(2):319-347.
     پورنقی، رویا .(1386). سرقت علمی در میان دانشجویان دانشگاه‌ها مطالعه مرور سیستماتیک و متاآنالیز.طرح پژوهشی، پژوهشگاه علوم و فناوری اطلاعا ت ایران.
جمالی مهموئی، حمیدرضا. (1390). ارزیابی پژوهش: رویکردها، شیوه‌ها و چالش‌ها. رهیافت، 49: 39-52.
جمالی مهموئی، حمیدرضا، اسدی، سعید، و صدقی، شهرام. (1391). سنجش اثر پژوهشی در علوم پزشکی، الگوها و روش ها. فرهنگستان علوم پزشکی جمهوری اسلامی ایران.
عزیزی، ،‌فریدون. (1389 ). شاخص‌های ارزیابی علمی کشور. مجله غدد درون ریز و متابولیسم ایران. 12(3):205-207.
نوروزی چاکلی،  علیرضا. (1391). نقش و جایگاه مطالعات علم سنجی در توسعه. پردازش و مدیریت اطلاعات، 27(3): 723-735.
نورمحمدی، حمزه علی، کرامت فر، مهدی، کرامت فر، عبدالصمد، و اسپراپین، فرشته.(1393). پژوهش در کدام حوزه ها؟ تعیین اولویت های پژوهشی کشور بر مبنای تأثیر آن‌ها بر رشد اقتصادی. مجله علم سنجی کاسپین، دانشگاه علوم پزشکی بابل 1(1): 48-53.
 Banzi, R.,  Moja, L., Pistotti, V., Facchini, A. &  Liberati, A. (2011). Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews. Health Res Policy Syst 9.
Battelle Laboratories. (1973). Interactions of Science and Technology in the Innovative Process: Some Case Studies. National Science Foundation Report NSF C667. Columbus, OH: Battelle Columbus Laboratories.
Boaz, A. , Fitzpatrick, S., & Shaw, B. (2008).  Assessing the impact of research on policy: A review of the literature for a project on bridging research and policy through outcome evaluation. Policy Studies Institute & King’s College London.
Bornmann, Lutz.  (2017). Measuring impact in research evaluations: a thorough discussion of methods for, effects of and problems with impact measurements. Available http://Springer.com.
Butler JS, Kaye ID, Sebastian AS, Wagner SC, Morrissey PB, Schroeder GD, Kepler CK, & Vaccaro AR. (2017). The Evolution of Current Research Impact Metrics: From Bibliometrics to Altmetrics? Clinical Spine Surgery.
Choi, H. S. (2016).  RETRACTED ARTICLE: How can SLCA influence change to a product’s life cycle and who listens to the impacts of an SLCA? Environment, Development and Sustainability. 18 (2): 615.
Cochrane Handbook for Systematic Reviews of InterventionsCochrane Book Series. A John Wiley & Sons, Ltd., Publication
Deeming, S., Searles, A. , Reeves, P., & Nilsson, M. (2017). Measuring research impact in Australia’s medical research institutes: a scoping literature review of the objectives for and an assessment of the capabilities of research impact assessment frameworks. Health Research Policy and Systems 15:22.
Drummond, Robyn. 2017. Reflection on: “RIMS: The Research Impact Measurement Service at the University of New South Wales”. Australian Academic & Research Libraries 47 (4):282-285.
Eisenberg, John M. )2001(. Putting research to work: reporting and enhancing the impact of health services research. Health services research 36 (2).
Escribano-Ferrer, B., Webster, J., &  Gyapong, M. (2017). Assessing the impact of health research on health policies: a study of the Dodowa Health Research Centre, Ghana. BMC Health Services Research 17:435.
Greenhalgh , Trisha , & Fahy, N. (2015). Research impact in the community-based health sciences: an analysis of 162 case studies from the 2014 UK Research Excellence Framework. BMC Medicine .  13:232.
Gaunand, A. Hocdé, S. Lemarié, Matt, M., & Turckheim. E. de (2015). How does public agricultural research impact society? A characterization of various patterns. Research Policy 44 (4):849-861.
  Godin, B., &  , Dore. C. (2003).  Measuring the impacts of science: beyond the economic dimension. Montreal, Canadian Science and Innovation Indicators Consortium.
Hall, Kathy. (2003). A systematic review of effective literacy teaching in the 4 to 14 age range of mainstream schooling. EPPI-Centre. Institute of Education, University of London. https://eppi.ioe.ac.uk/cms/Portals/0/PDF%20reviews%20and%20summaries/English_2003review.pdf?ver=2006-03-02-125227-003.(7/2018).
Hammarfelt B. (2014). Using altmetrics for assessing research impact in the humanities. Scientometrics 101 (2):1419-1430.
Hinrichs, S., & Grant, J. (2015). A new resource for identifying and assessing the impacts of research. BMC Med 13:148.
Holt, A. D., Goulding, J.S. , &  Akintoye, A. (2016). Enablers, challenges and relationships between research impact and theory generation. Engineering, Construction and Architectural Management 23(1):20-39.
Knight, S. R. (2014). Social Media and Online Attention as an Early Measure of the Impact of Research in Solid Organ Transplantation. Transplantation, 98(5): 490-496.
Miettinen, R., Tuunainen, J., & Esko, T.(2015). Epistemological, Artefactual and Interactional–Institutional Foundations of Social Impact of Academic Research.  Minerva 53 (3):257-277.
Milat, J. A., Bauman, A.E., & Redman, S. (2015).  A narrative review of research impact assessment models and methods. Health Research Policy and Systems 13:18.
Oancea, Alis. (2013).  Research Impact and Educational Research. European Educational Research Journal 12 )2(.
Okoro, C., &  Elechi,  E. O. (2016).  Bridging the Gap Between Teaching and Research in Accounting Departments of Nigeria. Global Academic group. 7 (1):193.
Ovseiko P. V., Oancea, A., & Buchan, A. M. (2012). Assessing research impact in academic clinical medicine: a study using Research Excellence Framework pilot impact indicators. BMC Health Services Research 12:23.
Pardoe, Simon. (2014). Research Impact Unpacked? A Social Science Agenda for Critically Analyzing the Discourse of Impact and Informing Practice. SAGE Open 4 (2).
Penfield, T., Baker,M. J., Scoble, R. , & Wykes.M.C.(2013). Assessment, evaluations, and Definitions of research impact: Areview. Research Evaluation:1-12.
Pollitt, A., Potoglou, D., Patil, S., Burge, P., Guthrie, S., King, S., Wooding, S., & Grant,. J. (2016). Understanding the relative valuation of research impact: a best-worst scaling experiment of the general public and biomedical and health researchers. BMJ Open 6 (8):e010916.
Ravenscroft J., Liakata, M., Clare,  A., & Duma, D.( 2017). Measuring scientific impact beyond academia: An assessment of existing impact metrics and proposed improvements. PLoS One 12 (3):e0173152
Scoble, R. Dickson, K, .Hanney, S., & Rodgers, G. J. (2010). Institutional strategies for capturing socio-economic impact of academic research. Journal of Higher Education Policy and Management 32 (5):499-510.
Slater, R. (2002). Differentiation and diversification: Changing livelihoods in Qwaqwa, South Africa, 1970-2000. Journal of Southern African Studies, 28(3): 599-614.
Searles, A. Doran, C., Attia, J. ,Knight, D. Wiggers, J., Deeming, S. ,Mattes, J., Webb, B. ,Hannan, S. ,Ling, R. , Edmunds, K. ,Reeves, P. & Nilsson, M.( 2016). An approach to measuring and encouraging research translation and research impact. Health Res Policy Syst 14 (1):60.
Simons, M. (2011). Guidelines for writing systematic reviews: Available from: www.library. mq.edu.au/Guidelines.
Smith, D. R., & Sutherland, A. (2002). Institutionalizing Impact Orientation: Building a Performance Management Approach that Enhances the Impact Orientation of Research Organizations. Chatham, UK: Natural Resources Institute. Also available online at: http://r4d.dfid.gov.uk/pdf/outputs/R8086a.pdf (accessed September 02, 2015).
Spaapen, J., Dijstelbloem, H., & Wamelink, F. (2007) Evaluating Research in Context: A Method for Comprehensive Assessment. Netherlands: Consultative Committee of Sector Councils for Research and Development.
Temple, L., Biénabe, E., Barret, D., & Saint-Martin, G. (2016). Methods for assessing the impact of research on innovation and development in the agriculture and food sectors. African Journal of Science, Technology, Innovation and Development 8 (5-6):399-410.
Terama E., Smallman, M., Lock, S. J.,  Johnson, C., & Austwick, M. Z. (2016). Beyond Academia - Interrogating Research Impact in the Research Excellence Framework. PLoS One 11 (12):e0168533.
Upton, S., Vallance, P., & Goddard,  J. (2014).From outcomes to process: evidence for a new approach to research impact assessment. Research Evaluation , 23(4): 352-365.
Urquhart, C. , & Dunn, S. (2013). A bibliometric approach demonstrates the impact of a social care data set on research and policy. Health Info Libr J 30 (4):294-302.
Wright, RW., ,Brand, RA., Dunn, W., & Spindler. KP. (2007). How to write a systematic review. ClinOrthop Relat R. Feb(455):23-9.
Yazdizadeh, B.,   Majdzadeh, R., &  Salmasian, H. (2010). Systematic review of methods for evaluating healthcare research economic impact. Health Res Policy Syst. 2;8:6.

Files

Share

How to cite

Statistics