richelbilderbeek / chapter_paradata

Chapter for edited volume about paradata
https://richelbilderbeek.github.io/chapter_paradata/
GNU General Public License v3.0
0 stars 0 forks source link

How often can code be found? #5

Closed richelbilderbeek closed 1 year ago

richelbilderbeek commented 1 year ago

from https://www.semanticscholar.org/paper/Analysis-of-Open-Data-and-Computational-in-Reports-Obels-Lakens/36b5b9aed9e7c0ba4798887d609441371f65366f

Obels, Pepijn, et al. "Analysis of open data and computational reproducibility in registered reports in psychology." Advances in Methods and Practices in Psychological Science 3.2 (2020): 229-237.

Screenshot from 2023-01-24 11-39-42

Quote from abstract:

Of the 62 articles that met our inclusion criteria, 41 had data available, and 37 had analysis scripts available. Both data and code for 36 of the articles were shared. We could run the scripts for 31 analyses, and we reproduced the main results for 21 articles. Although the percentage of articles for which both data and code were shared (36 out of 62, or 58%) and the percentage of articles for which main results could be computationally reproduced (21 out of 36, or 58%) were relatively high compared with the percentages found in other studies, there is clear room for improvement.

richelbilderbeek commented 1 year ago

From Nicolas Bonneel, David Coeurjolly, Julie Digne, Nicolas Mellado, Code Replicability in Computer Graphics , ACM Trans. on Graphics (Proceedings of SIGGRAPH 2020), 39:4,

https://replicability.graphics/

Screenshot from 2023-01-24 11-54-17

Screenshot from 2023-01-24 11-54-29

richelbilderbeek commented 1 year ago

From https://www.semanticscholar.org/paper/A-computational-reproducibility-study-of-PLOS-ONE-Seibold-Czerny/4615e25e3059708f7a8459597e7a95e38e685390/figure/0

Seibold, Heidi, et al. "A computational reproducibility study of PLOS ONE articles featuring longitudinal data analyses." PloS one 16.6 (2021): e0251194.

Screenshot from 2023-01-24 12-06-30

Screenshot from 2023-01-24 12-09-44

richelbilderbeek commented 1 year ago

It's in the text :+1: