Closed MansMeg closed 3 weeks ago
Quality estimation is also a kind of test and uses similar conceptual workflows. I'm not sure I see the point in a separate folder. Instead:
test/ # quality estimation code goes here along with integrity tests
test/data # data goes here
test/quality-estimates # versioned quality estimations
I would keep the gold standard data in its own folder.. test is very generic and only partially applicable
Ok. Whats your suggested solution Väinö?
Add a gold-standard folder
So your suggestion is like this (I called gold standard data quality-data):
test/ # quality estimation code goes here along with integrity tests
test/test-data # data used in data integration tests goes here
test/quality-estimates # versioned quality estimations
test/quality-data # data used for quality estimation goes here
@ninpnin what do you think of this Väinö?
Sorry this is very late, but I would have the gold standard completely outside the test folder. What do you think?
How would you store it?
Have a quality-data folder in the project root, at the same level as test etc. But I'm not necessarily planning to die on this hill
I agree with you here. So maybe have something like this:
/quality/... -> scripts used for quality estimation /quality/data/... -> data used for quality estimation /quality/estimates/... -> estimates by version stored for easy access
ie mirror the test folder structure.
Now I have updated the file with the decision we discussed. @fredrik1984 , you can now merge this.
Hi!
Here is my proposed structure of the data repository apis. Feel free to comment.