sje30 / sharing-report

INCF draft report for Cambridge 2014 meeting
1 stars 0 forks source link

A few proposals / additions #1

Closed jbpoline closed 9 years ago

jbpoline commented 9 years ago

Hi - still brain storming a little on this - but here's a first PR for you :)

jbpoline commented 9 years ago

That's a great feedback on the replication review.

For the badges: I guess what I'm saying is that I'd like the journals to adopt data and code availability as the standard. The badges give the feeling that article with code and data are special, and I always worry when a new " incentive " is being adopted.

I do agree that for the time being they are better than nothing, but they should be seen in the perspective where all articles have the badges.

The code review will be a very interesting experiment.

benmarwick commented 9 years ago

Yes, I agree with aspiring towards data & code availability as a standard practice. My guess is we're 5-10 years away from that, so we've a lot of time to explore methods to speed up the spread of this behaviour and increase its visibility. Maybe most of them will fail, have no impact, or be abandoned eventually, but I'm interested to try.

I'm suprised to see that even in computer science, which would seem to be the obvious origin of publication + code research products they still seem to feel a need to incentivise sharing with badges, for example the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering have an Artifact Evaluation Committee that gives these out:

clipboard01

jbpoline commented 9 years ago

5-10 years ! I will be dead by that time ! Let's lobby the funding agencies such that they put very strong incentive to do this :)

On Sat, Apr 25, 2015 at 12:12 AM, Ben Marwick notifications@github.com wrote:

Yes, I agree with aspiring towards data & code availability as a standard practice. My guess is we're 5-10 years away from that, so we've a lot of time to explore methods to speed up the spread of this behaviour and increase its visibility. Maybe most of them will fail, have no impact, or be abandoned eventually, but I'm interested to try.

I'm suprised to see that even in computer science, which would seem to be the obvious origin of publication + code research products they still seem to feel a need to incentivise sharing with badges, for example the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering have an Artifact Evaluation Committee http://www.artifact-eval.org/about.html that gives these out:

[image: clipboard01] https://cloud.githubusercontent.com/assets/1262179/7331993/20b0556a-eadf-11e4-8436-b5596a7dedec.png

— Reply to this email directly or view it on GitHub https://github.com/sje30/sharing-report/pull/1#issuecomment-96145116.