Closed CAMOBAP closed 1 year ago
The way I do development, the long wait on flavour testing is more disruptive than an issue that turns up in documents or templates and not identified in the flavour rspec. The former happens constantly, the latter only happens every few months. I don't think that there is a real problem in identifying flavour-specific issues only when I get to metanorma-cli: the release takes long enough that stopping to debug the flavour (after a very very long wait) is going to end up happening the next day anyway.
@ronaldtse if no objections, I propose to merge this PR
@CAMOBAP @opoudjis I can live with the new proposal. Feel free to merge when ready. Thanks!
This PR to discuss our metanorma test approach
Recently @opoudjis asked me:
For now we do testing documents in 3 places:
metanorma-*
gem changes, we test only specificmn-samples-*
andmn-templates-*
metanorma-cli
gem changes, we test subset of all ourmn-samples-*
andmn-templates-*
, king of smoke testmn-samples-*
andmn-templates-*
changes@opoudjis proposal is to remove processor tests (first row from the list above)
Pros:
Cons:
metanorma-cli
run@ronaldtse any thoughts?
P.S. If we can make development more comfortable for @opoudjis I have no objections to go with this approach