Reproducible research and GIScience: an evaluation using AGILE conference papers

PeerJ. 2018 Jul 13:6:e5072. doi: 10.7717/peerj.5072. eCollection 2018.


The demand for reproducible research is on the rise in disciplines concerned with data analysis and computational methods. Therefore, we reviewed current recommendations for reproducible research and translated them into criteria for assessing the reproducibility of articles in the field of geographic information science (GIScience). Using this criteria, we assessed a sample of GIScience studies from the Association of Geographic Information Laboratories in Europe (AGILE) conference series, and we collected feedback about the assessment from the study authors. Results from the author feedback indicate that although authors support the concept of performing reproducible research, the incentives for doing this in practice are too small. Therefore, we propose concrete actions for individual researchers and the GIScience conference series to improve transparency and reproducibility. For example, to support researchers in producing reproducible work, the GIScience conference series could offer awards and paper badges, provide author guidelines for computational research, and publish articles in Open Access formats.

Keywords: AGILE; Data science; GIScience; Open access; Open science; Reproducible conference publications; Reproducible research.

Grants and funding

Carlos Granell is funded by the Ramón y Cajal Programme of the Spanish government (grant number RYC-2014-16913). Daniel Nüst and Markus Konkol are supported by the project Opening Reproducible Research ( funded by the German Research Foundation (DFG) under project numbers PE 1632/10-1 respectively KR 3930/3-1. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.