spack / spack-gantry

A Dynamic Resource Allocation System for Spack CI and Kubernetes
Other
2 stars 0 forks source link

Collect baseline job costs #132

Open cmelone opened 2 weeks ago

cmelone commented 2 weeks ago

Pulled from #93 to collect data before deciding on final cost formula.

Adds the following columns:

The job_cost_instance calculation is made by averaging the value of karpenter_cloudprovider_instance_type_offering_price_estimate during the lifetime of the node and multiplying by the duration of the build job.

This is not a cost per job metric. Use information like cpu_mean, mem_mean, etc to calculate the cost of the job in combination with job_cost_instance.

tested with dev/bulk_collect.py and verified that large migrations work correctly on the prod and staging db