add references

[mxochicale]

Reproducibility of scientific results in the EU. December 2020

This report scopes the issue of the reproducibility of scientific results, based on a field review and on an expert seminar on the opportunity of policy action in Europe. As such, it aims to increase the European Commission’s understanding of the lack of reproducibility in Europe, and help design a suitable response in the context of EU Research & Innovation. The report identifies the key emerging issues in reproducibility; it is informed by clearly marked expert opinion (in italics), as it emerged from the scoping seminar. Concrete recommendations of possible action by the European Commission are featured in separate ‘Action Boxes’. Overall the report introduces the concept of reproducibility as a continuum of practices. It is posited that the reproducibility of results has value both as a mechanism to ensure good science based on truthful claims, and as a driver of further discovery and innovation. The sections includes a working definition that is conducive for policy making and thus delimits the scope of the subject. Then the report reviews recent claims regarding the increasing lack of reproducibility in modern science, dubbed by some a ‘crisis of reproducibility’. It explores the main traits and underlying causes of the lack of reproducibility, including bias, poor experimental design and statistics, issues with scientific reporting, research culture, career-related factors and economics. Finally, the report reviews recent activities by scientists, research funders and publishers that aim to mitigate the lack of reproducibility; and it catalogues a range of possible remedies to the lack of reproducibility as they are found in the literature. The report provides concrete advice for policy action that may increase reproducibility in three key areas of the EU Research & Innovation, specifically guidelines; the research grant system; and training and careers

https://op.europa.eu/en/publication-detail/-/publication/6bc538ad-344f-11eb-b27b-01aa75ed71a1

KI0320399ENN.en.pdf

[mxochicale]

"Making scientific computations reproducible" Schwab et. al. 2020

M. Schwab; N. Karrenbach; J. Claerbout in Published in: Computing in Science & Engineering ( Volume: 2, Issue: 6, Nov.-Dec. 2000)

To verify a research paper’s computational results, readers typically have to recreate them from scratch. ReDoc is a simple software filing system for authors that lets readers easily reproduce computational results using standardized rules and commands.

schwab2000.pdf

https://ieeexplore.ieee.org/document/881708

[mxochicale]

Guest Editors' Introduction: Reproducible Research

Sergey Fomel; Jon F. Claerbout Published in: Computing in Science & Engineering ( Volume: 11, Issue: 1, Jan.-Feb. 2009)

Abstract: The articles in this special issue provide independent solutions for practical reproducible research systems. The use of Matlab-based tools such as the famous Wavelab and Sparselab packages in promoting reproducible research in computational harmonic analysis has been presented. In particular, the authors point to the success of the reproducible research discipline in increasing the reliability of computational research and reflect on the effort necessary for implementing this discipline in a research group and overcoming possible objections to it. An article also describes a Python interface to the well-known Clawpack package for solving hyperbolic partial differential equations that appear in wave propagation problems. The author argues strongly in favor of reproducible computations and shows an example using a simplified Python interface to Fortran code. An article also represents the field of bioinformatics, which has been a stronghold of reproducible research. It describes the cacher package, which is built on top of the R computing environment. Cacher enables a modular approach to reproducible computations by storing results of intermediate computations in a database. The special issue ends with an article on the legal aspects of reproducible research, including copyright and licensing issues.

Article and more

Guest_Editors_Introduction_Reproducible_Research.pdf

DOI: 10.1109/MCSE.2009.14

[mxochicale]

close via https://github.com/free-cortex/framework/commit/7259ac555af1f65409d553c4ed75385592593cc1 which adds the above references