simonsobs-uk / data-centre

This tracks the issues in the baseline design of the SO:UK Data Centre at Blackett
https://souk-data-centre.readthedocs.io
BSD 3-Clause "New" or "Revised" License
2 stars 1 forks source link

Cannot constraint on Arch and/or Microarch #36

Open ickc opened 7 months ago

ickc commented 7 months ago

Hi, @rwf14f, I just try constraining on Arch and/or Microarch but is not successful:

Requirements = (Arch == "INTEL") && (Microarch == "x86_64-v4")

The reason is that apparently the attributes are not available:

❯ sudo condor_status -autoformat Arch Microarch
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined
X86_64 undefined

Is it possible to make it available to the system?

P.S. We know the implication of constraining jobs which reduces the pool of nodes it can be submitted to and therefore increase the queue time for example.

ickc commented 7 months ago

Other attributes are available though, which can be useful in the interim:

❯ sudo condor_status -autoformat Machine Arch Microarch has_avx512f has_avx512dq has_avx512dnni | sort -u
vm71.in.tier2.hep.manchester.ac.uk X86_64 undefined undefined undefined undefined
vm75.in.tier2.hep.manchester.ac.uk X86_64 undefined undefined undefined undefined
wn1905340.in.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn1906370.in.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn3805331.tier2.hep.manchester.ac.uk X86_64 undefined undefined undefined undefined
wn3805340.tier2.hep.manchester.ac.uk X86_64 undefined undefined undefined undefined
wn3805341.tier2.hep.manchester.ac.uk X86_64 undefined undefined undefined undefined
wn3806190.tier2.hep.manchester.ac.uk X86_64 undefined undefined undefined undefined
wn3806191.tier2.hep.manchester.ac.uk X86_64 undefined undefined undefined undefined
wn3806200.tier2.hep.manchester.ac.uk X86_64 undefined undefined undefined undefined
wn3806201.tier2.hep.manchester.ac.uk X86_64 undefined undefined undefined undefined
wn3806240.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn3806241.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn3806250.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn3806251.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn3806290.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn3806291.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn3806300.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn3806301.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn5914090.in.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn5914340.in.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn5916090.in.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn5916340.in.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
wn5917090.in.tier2.hep.manchester.ac.uk X86_64 undefined true true undefined
ickc commented 7 months ago

The AVX-512 attributes are used in commit fed61cf.