4dn-dcic / tibanna

Tibanna helps you run your genomic pipelines on Amazon cloud (AWS). It is used by the 4DN DCIC (4D Nucleome Data Coordination and Integration Center) to process data. Tibanna supports CWL/WDL (w/ docker), Snakemake (w/ conda) and custom Docker/shell command.
MIT License
70 stars 28 forks source link

Add cost estimation #315

Closed alexander-veit closed 3 years ago

alexander-veit commented 3 years ago

This PR adds cost estimation to Tibanna workflow runs. Estimated costs can be obtained as soon as the job finished. It is available from the command line by invoking cost_estimate. When the true costs are available, cost_estimate will return the true costs instead of the estimate. The estimated costs will also be automatically added to the metrics report.

The estimated costs seem accurate, when the true price is more than a few cent. In other words, the relative error is large, when the true cost is below 1 or 2 cent, otherwise the relative error is small.

alexander-veit commented 3 years ago

Ok, I think this is better now.

Does that make sense?

SooLee commented 3 years ago

Yup that sounds good.