search

dmwm / CRABServer

15 stars 37 forks source link

rationalize configurations and common functions #8528

Open belforte opened 4 days ago

belforte commented 4 days ago

We have a lot of duplication here and there of both code and configuration parameters. We should aim for

  1. capture in some common functions the details and how we instantiate CRABServer, DBSClient, RucioClient so that we simply pass a configuration object to them and reuse those everywhere.
  2. reorganize configuration files to have one section for each such service so that we can e.g. do something like 
    config = loadConfigFromFile()
rucioClient = getRucioClient(config.Rucio)
crabServer = getCrabServer(config.REST)
    1. reorganize puppet templates and hiera variables so that we avoid duplications. E.g. reflect the current practice that one TW VM will point all its services (TW, Publishers) to same REST instance.

This includes the work already laid out in #7624 and correlates with #7765 and the reorganization of utility functions discussed in there.

Up for discussion in the group !