LDMX-Software / LDCS

Lightweight Distributed Computing System repo
0 stars 3 forks source link

Use image dependencies as detailed in image metadata instead of from batch config #19

Closed bryngemark closed 10 months ago

bryngemark commented 11 months ago

Using apptainer inspect, the labels of a container can be seen. With a recent fix to our DOckerfile, all version labels are automatically added based on the version specified for image dependency downloading and building. So now we can use this information directly.

I decided to only do this in the image building step. The resulting image metadata will be copied over to the metadata record of each file produced using it, since the image is treated as an input file to the job.

If in the future we set up to use images from any other process, or we resort to old RTEimages, this assumption breaks. However, the older RTE images aren't guaranteed to have the labels specified anyway.

This resolves #17.