common-workflow-language / common-workflow-language

Repository for the CWL standards. Use https://cwl.discourse.group/ for support 😊
https://www.commonwl.org
Apache License 2.0
1.45k stars 198 forks source link

GitHub repo re-organization #413

Open mr-c opened 7 years ago

mr-c commented 7 years ago

cwltool contains an embedded copy of the spec repo which include far more than is needed

As this copy of the spec repo isn't updated unless there are changes to the CWL schema, the other contents (like the conformance tests) get out of date and can confuse users/developers

manu-chroma commented 7 years ago

From what I understand, it is contents of https://github.com/common-workflow-language/common-workflow-language repo which aren't updated regularly.

We could probably have git submodule of https://github.com/common-workflow-language/common-workflow-language present inside cwltool project. They might be after all be necessary in order to provide conformance testing support/running coverage tests from Makefile.

mr-c commented 7 years ago

And there is another layer: the vNNN/salad directories in this repo come from https://github.com/common-workflow-language/schema_salad (for the metaschema) which also pulls in far more than is needed

Correct, we use git subtree to accomplish things currently.

Ideally these subtree/submodules would only pull in what is needed and no more -- so re-organizing the repos will be required.

tetron commented 7 years ago

The basic problem is that git submodule and git subtree only support embedding a whole repo into the subdirectory of another, and not syncing a subdirectory of one tree to another.

To make this less of a mess, I believe the options are one of: