Improve Pipeline cache - Githubissues

metaspace2020 / Lithops-METASPACE

Lithops-based Serverless implementation of the METASPACE spatial metabolomics annotation pipeline

12 stars 4 forks source link

Closed omerb01 closed 4 years ago

omerb01 commented 4 years ago

main changes:

add use_cache flag for Pipeline class.
add --no-cache option parameter for run_pipeline.py script.
move cache from local to ibm cos - this will be useful when the pipeline's steps don't run on the same local machine.
add dedicated class for cache PipelineCacher and organise its all operations.