HTCondor & Pulsar deployment

[Dirowa]

hi @hexylena here are the changes to which i believe make pulsar and condor work together

Files added:

• galaxy_old.yml, extra addition is certbot and pulsar
• groupvars/galaxy_old.yml pulsar and certbot added
• pulsar.yml
• groupvars/pulsarservers.yml

files changed:

• group_vars/all/secrets.yml, addition of pulsar_password
• templates/galaxy/config/job_conf.xml.j2. addition of a if statement. depending on which grouphostname is used. a different param will be selected. i use this to keep the same file but change the jobrunner between HTcondor or pulsar
• hosts, added galaxy_old and pulsarservers.

further to look into because I,m not sure:

rabbitmq_vhosts:
  - /pulsar/galaxy_midgard
  - /pulsar/galaxy_asgard

rabbitmq_users:
  - user: pulsar_admin
    password: "{{ pulsar_password }}"
    tags: administrator
    vhost: /

  - user: galaxy_asgard
    password: "{{ pulsar_password }}"
    vhost: /pulsar/galaxy_asgard

  - user: galaxy_midgard
    password: "{{ pulsar_password }}"
    vhost: /pulsar/galaxy_midgard 

[hexylena]

let's merge tomorrow when we have time for things to go wrong.

[Dirowa]

I tried fixing it so far but we have our meeting soon.

what have i done:

• install pulsar with jenkins
• Fiddle with groupvars/pulsarservers.yml

Original error

fatal: [galaxy.bioinformatics-atgm.nl]: FAILED! => {"changed": false, "msg": "AnsibleUndefinedVariable: {{ pulsar_yaml_config_default | combine(pulsar_yaml_config | default({})) }}: {'tool_dependency_dir': '{{ pulsar_dependencies_dir }}', 'persistence_directory': '{{ pulsar_persistence_dir }}', 'staging_directory': '{{ pulsar_staging_dir }}', 'job_metrics_config_file': \"job_metrics_conf.{{ (pulsar_job_metrics_plugins is defined) | ternary('yml', 'xml') }}\"}: {{ galaxy_job_metrics_plugins }}: 'galaxy_job_metrics_plugins' is undefined"}

Tried to correct the variable pulsar_job_metrics_plugins: by filling in the path to : "//srv/galaxy/config/job_metrics_conf.xml and other various paths

resulting error is

fatal: [galaxy.bioinformatics-atgm.nl]: FAILED! => {"changed": false, "msg": "AnsibleUndefinedVariable: 'str object' has no attribute 'keys'"}

what wil i do now.

Try to figure out what actual has to be in here