Guidelines for performing systematic research projects reviews

  1. Alicia García-Holgado 1
  2. Samuel Marcos-Pablos 1
  3. Francisco José García-Peñalvo 1
  1. 1 Universidad de Salamanca
    info

    Universidad de Salamanca

    Salamanca, España

    ROR https://ror.org/02f40zc51

Revista:
IJIMAI

ISSN: 1989-1660

Año de publicación: 2020

Volumen: 6

Número: 2

Páginas: 136-144

Tipo: Artículo

DOI: 10.9781/IJIMAI.2020.05.005 DIALNET GOOGLE SCHOLAR lock_openDialnet editor

Otras publicaciones en: IJIMAI

Resumen

There are different methods and techniques to carry out systematic reviews in order to address a set of research questions or getting the state of the art of a particular topic, but there is no a method to carry out a systematic analysis of research projects not only based on scientific publications. The main challenge is the difference between research projects and scientific literature. Research projects are a collection of information in different formats and available in different places. Even projects from the same funding call follow a different structure in most of the cases, despite there were some requirements that they should meet at the end of the funding period. Furthermore, the sources in which the scientific literature is available provide metadata and powerful search tools, meanwhile most of the research projects are not stored in public and accessible databases, or the databases usually do not provide enough information and tools to conduct a systematic search. For this reason, this work provides the guidelines to support systematics reviews of research projects following the method called Systematic Research Projects Review (SRPR). This methodology is based on the Kitchenham’s adaptation of the systematic literature review.

Referencias bibliográficas

  • M. J. Grant and A. Booth, “A typology of reviews: an analysis of 14 review types and associated methodologies,” Health Information & Libraries Journal, vol. 26, no. 2, pp. 91-108, 2009, doi: 10.1111/j.1471- 1842.2009.00848.x.
  • M. Borenstein, L. V. Hedges, J. P. T. Higgins, and H. R. Rothstein, Introduction to Meta-Analysis. UK: John Wiley & Sons, 2009.
  • D. Gough and J. Thomas, “Commonality and diversity in reviews,” in Introduction to Systematic Reviews, D. Gough, S. Oliver, and J. Thomas Eds. London: Sage, 2012, pp. 35-65.
  • D. Gough, J. Thomas, and S. Oliver, “Clarifying differences between review designs and methods,” Systematic Reviews, vol. 1, no. 1, p. 28, 2012/06/09 2012, doi: 10.1186/2046-4053-1-28.
  • R. Russell et al., “Systematic Review Methods,” in Issues and Challenges in Conducting Systematic Reviews to Support Development of Nutrient Reference Values: Workshop Summary: Nutrition Research Series, Vol. 2., (Technical Reviews, No. 17.2. Rockville (MD): Agency for Healthcare Research and Quality (US), 2009.
  • B. Kitchenham, “Procedures for Performing Systematic Reviews,” Keele, UK, TR/SE-0401, 2004. Available: http://bit.ly/2yW3zCg
  • B. Kitchenham and S. Charters, “Guidelines for performing Systematic Literature Reviews in Software Engineering. Version 2.3,” EBSE-2007- 01, 2007. Available: http://bit.ly/2Kr7M6l
  • B. Kitchenham, O. Pearl Brereton, D. Budgen, M. Turner, J. Bailey, and S. Linkman, “Systematic literature reviews in software engineering – A systematic literature review,” Information and Software Technology, vol. 51, no. 1, pp. 7-15, 2009/01/01 2009, doi: 10.1016/j.infsof.2008.09.009.
  • OECD, “Main policygaps hindering access to data,” in Enhanced Access to Publicly Funded Data for Science, Technology and Innovation. Paris: OECD Publishing, 2020.
  • OECD, “Business models for sustainable research data repositories,” OECD Science, Technologyand Industry Policy Papers, p. No. 47, 2017, doi: 10.1787/302b12bb-en.
  • E. Taskin, “Analysis of Projects related to the Integration of Migrants,” Horizon Insights, vol. 2, no. 2, 2019, doi: 10.31175/hi.2019.02.
  • K. Petersen, S. Vakkalanka, and L. Kuzniarz, “Guidelines for conducting systematic mapping studies in software engineering: An update,” Information and Software Technology, vol. 64, pp. 1-18, 2015, doi: 10.1016/j.infsof.2015.03.007.
  • C. M. Prager et al., “An assessment of adherence to basic ecological principles by payments for ecosystem service projects,” Conservation Biology, vol. 30, no. 4, pp. 836-845, 2016, doi: 10.1111/cobi.12648.
  • D. R. Marsh, L. Tsuma, K. Farnsworth, K. Unfried, and E. Jenkins, “What Did USAID’s Child Survival and Health Grants Program Learn about Community Case Management and How Can It Learn More?,” Maternal and Child Health Integrated Program (MCHIP), 2012. Available: https://www.mchip.net/sites/default/files/CSHGP-CCM-Report.pdf
  • N. Stamatiadis, R. Sturgill, and K. Amiridis, “Benefits from Constructability Reviews,” Transportation Research Procedia, vol. 25, pp. 2889-2897, 2017, doi: 10.1016/j.trpro.2017.05.275.
  • N. Stamatiadis, R. Sturgill, P. Goodrum, E. Shocklee, and C. Wang, “Tools for Applying ConstructabilityConcepts to Project Development (Design),” University of Kentucky, Kentucky Transportation Center, Kentucky, USA, Research Report KTC -13-15/FRT190-11-1F, 2013. Available: http://uknowledge.uky.edu/cgi/viewcontent. cgi?article=1326&context=ktc_researchreports
  • M. Elf, G. Lindahl, and A. Anåker, “A Study of Relationships Between Content in Documents From Health Service Operational Plans and Documents From the Planning of New Healthcare Environments,” HERD: Health Environments Research & Design Journal, vol. 12, no. 3, pp. 107- 118, 2019, doi: 10.1177/1937586718796643.
  • K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson, “Systematic mapping studies in software engineering,” presented at the Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering, Italy, 2008.
  • M. Petticrew and H. Roberts, Systematic Reviews in the Social Sciences: A Practical Guide. Malden, USA: Blackwell Publishing, 2005.
  • A. García-Holgado and F. J. García-Peñalvo, “Mapping the systematic literature studies about software ecosystems,” in Proceedings of the 6th International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM 2018) (Salamanca, Spain, October 24-26, 2018), F. J. García-Peñalvo Ed., (ACM International Conference Proceeding Series (ICPS). New York, NY, USA: ACM, 2018.
  • A. García-Holgado, S. Verdugo-Castro, C. S. González, M. C. SánchezGómez, and F. J. García-Peñalvo, “European Proposals to Work in the Gender Gap in STEM: A Systematic Analysis,” IEEE-RITA, in press.
  • D. Moher, A. Liberati, J. Tetzlaff, D. G. Altman, and PRISMA Group, “Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement,” PLoS medicine, vol. 6, no. 7, p. e1000097, 2009, doi: 10.1371/journal.pmed1000097.
  • A. García-Holgado, S. Marcos-Pablos, R. Therón, and F. J. GarcíaPeñalvo, “Technological ecosystems in the health sector: A mapping study of European research projects,” J. Med. Syst., vol. 43, no. 100, 2019, doi: 10.1007/s10916-019-1241-5.
  • S. Marcos-Pablos, A. García-Holgado, and F. J. García-Peñalvo, “Trends in European research projects focused on technological ecosystems in the health sector,” in Proceedings of the 6th International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM 2018) (Salamanca, Spain, October 24-26, 2018), F. J. García-Peñalvo Ed., (ACM International Conference Proceeding Series (ICPS). New York, NY, USA: ACM, 2018.
  • A. García-Holgado, S. Verdugo-Castro, M. C. Sánchez-Gómez, and F. J. García-Peñalvo, “Trends in studies developed in Europe focused on the gender gap in STEM,” in Proceedings of the XX International Conference on Human Computer Interaction. New York, NY, USA: ACM, 2019, p. Article 47. - 144 - International Journal of Interactive Multimedia and Artificial Intelligence, Vol. 6, Nº 2
  • Gesundheit Österreich Forschungs und Planungs GmbH, “Study on CrossBorder Cooperation,” European Commission, Directorate-General for Health and Food Safety, Luxembourg, 2018.
  • L. Codina. “Revisiones bibliográficas y cómo llevarlas a cabo con garantías: systematic reviews y SALSA Framework.” http://bit.ly/2lKiDct (accessed 16 May, 2020).
  • A. Onwuegbuzie and R. Frels, 7 Steps to a Comprehensive Literature Review: A Multimodel & Cultural Approach. London: Sage, 2016.
  • F. J. García-Peñalvo, M. J. Rodríguez-Conde, R. Therón, A. GarcíaHolgado, F. Martínez-Abad, and A. Benito-Santos, “Grupo GRIAL,” IE Comunicaciones. Revista Iberoamericana de Informática Educativa, vol. 30, no. 33-48, 2019
Fuente de los datos: Dialnet