nf-core / tools

Python package with helper tools for the nf-core community.
https://nf-co.re
MIT License
242 stars 191 forks source link

Update CI workflow for pipelines #2854

Open adamrtalbot opened 8 months ago

adamrtalbot commented 8 months ago

Description of feature

nf-core/fetchngs uses a new strategy based on scraping the information via Python to list and fetch all changed files, plus dependencies. It then lists all relevant nf-test files and uses them in a testing matrix.

ci.yml Python script

We need to migrate this feature to the template. We should just be able to copy+paste the files.

https://github.com/nf-core/fetchngs/pull/271 https://github.com/nf-core/fetchngs/pull/300

adamrtalbot commented 6 months ago

Should be able to merge this after https://github.com/nf-core/tools/pull/2992 is merged

mirpedrol commented 2 months ago

Hi! Having a look at the way you test changed files and dependencies in fetchngs. Could we create an nf-core github action to avoid adding the python script to the pipeline template?

I was also wondering if this can be used in the modules repo. We want to test the subworkflows which use a module that has ben updated. Will this continue working if we completely remove tags?

adamrtalbot commented 2 months ago

Hi! Having a look at the way you test changed files and dependencies in fetchngs. Could we create an nf-core github action to avoid adding the python script to the pipeline template?

Already done! no tags required. We can probably switch this for the native nf-test feature but I haven't tried it yet.