reanahub / docs.reana.io

REANA documentation web site
http://docs.reana.io
MIT License
3 stars 31 forks source link

List versions of CWL supported? #99

Closed mr-c closed 2 years ago

tiborsimko commented 2 years ago

Hi @mr-c, we should definitely improve the REANA documentation in this respect.

Latest REANA 0.8 release series uses cwltool==3.1.20210628163208.

Eearlier REANA 0.7 release series used cwltool==1.0.20191022103248.

mr-c commented 2 years ago

Thanks @tiborsimko . Using a particular version of cwltool as a library does not automatically mean that particular versions of CWL is fully supported, hence the requests to run the CWL conformance tests and report the results (even if only manually, once per release)

https://github.com/reanahub/reana-workflow-engine-cwl/issues/168

tiborsimko commented 2 years ago

CC @audrium who has been dealting with running the CWL reference test suite lately. We'll upgrade the REANA documentation for each supported workfolw engine and we'll have a look specifically at reporting the CWL conformance test suite results afterwards.

audrium commented 2 years ago

Hi @mr-c, we have just reran the conformance test suite on the latest REANA version and the results are as follows:

179 tests passed, 18 failures, 0 unsupported features
1 tool tests failed

The failures are documented in the reana-workflow-engine-cwl issues if you want to have a look.

We are planning to work on exposing these results in REANA documentation in the upcoming weeks