betterscientificsoftware / bssw.io

Better Scientific Software Homepage
https://bssw.io
Other
140 stars 90 forks source link

Lack of Evidence In Software Engineering #420

Closed jarrah42 closed 4 years ago

jarrah42 commented 5 years ago

Author: Greg

IEEE Computer has a great article titled "Methodological Irregularities in Programming-Language Research" that everyone should read. In particular, I quote "... [a review] of the evidence standards of research presented at the International Conference on Functional Programming from its founding in 1996 to 2014 and found that not one study followed methodological guidelines... Nevertheless, this research community has vehemently and successfully argued for the inclusion of functional features in popular programming languages such as Java, C++, and Snap!"

https://ieeexplore.ieee.org/document/7999115

jarrah42 commented 5 years ago

I find the down votes surprising, particularly since this is one of the main reasons that CS is not considered "real science". Perhaps there was some other reason for them?

markcmiller86 commented 5 years ago

FWIW...I find this far to the abstract end of the nuts-n-bolts software producitivity spectrum. To be clear, it is interesting. But, I want a mix of nuts-n-bolts and abstract content of about 70/30.

markcmiller86 commented 5 years ago

Also, do we need to provide rationale for our votes? I mean, I could maybe understand if my vote was somehow special. But, with a sufficient number of votes, the average should be sufficient measure of a proposed idea's merit for site without having to engage in discussion about it.

bernhold commented 5 years ago

My thinking is that, in the long run, Topic Review should be a quick thing that shouldn't require a lot of discussion or explanation.

But right now, we're trying to figure out what we want BSSw to be when it grows up, and at this stage, I think the discussions are probably necessary to developing a consensus on the kind of content we want to have.

So right now, I feel like it is fair to ask for rationales and otherwise discuss.

jarrah42 commented 5 years ago

Also, do we need to provide rationale for our votes? I mean, I could maybe understand if my vote was somehow special. But, with a sufficient number of votes, the average should be sufficient measure of a proposed idea's merit for site without having to engage in discussion about it.

The average would work if everyone voted, but I don't think we're at that point yet.

jarrah42 commented 5 years ago

My thinking is that, in the long run, Topic Review should be a quick thing that shouldn't require a lot of discussion or explanation.

I was in agreement until it was my suggestion that got down voted. :wink:

rinkug commented 4 years ago

@prwolfe has interest in reading this and following up

rinkug commented 4 years ago

PR #451 has been opened for this issue