search

hep-gc / cloud-scheduler

Automatically boot VMs for your HTC jobs
http://cloudscheduler.org
Apache License 2.0
3 stars 0 forks source link

Remove obsolete classads #393

Closed crlb closed 9 years ago

crlb commented 9 years ago

When OpenStack VMs are terminated by CS, often the classads for the terminated VMs persist for an extended period; until the Collector cleans them up after some configurable time period (normally 20 to 30 minutes). Thess obsolete classads interfere with the scheduling of jobs on current VMs. CS, which polls the VM classads and tracks VMs, should remove obsolete classads via use of the "condor_advertise" command, thereby improving the scheduling of jobs.

mhpx commented 9 years ago

notes: general commands: condor_advertise INVALIDATE_MASTER_ADS condor_advertise INVALIDATE_STARTD_ADS

can use -pool to specify pool other than default local pool the contains: MyType="Query" TargetType="Machine" Requirements=Name=="" includes the slot1@ part.

can also use -multiple flag and separate entries in the file with a blank line, similar to condor_off will need to do 2 commands, once for master, and once for the startds using -multiple. Will need to create tmp files.

mhpx commented 9 years ago

This seems to be working now, will probably adjust the logging some more to be less spammy

mhpx commented 9 years ago

May also need to do something to play nice with non CS classads.. but that may not be a priority