search

SGCI / sgci-resource-inventory

This contains all the computational resource entities
https://sgci-resource-inventory.readthedocs.io/en/latest/introduction.html
Apache License 2.0
6 stars 2 forks source link

Where should the batch scheduler host and submit host be specified? #16

Closed ericfranz closed 3 years ago

ericfranz commented 3 years ago

At OSC on our Owens cluster, we have several hosts:

  1. owens.osc.edu is the host for ssh access to the login node
  2. owens-slurm01.ten.osc.edu is the host used to submit jobs to
  3. o0647.ten.osc.edu is an example host of a compute node (which users can ssh to)

In OnDemand we minimally need to know:

  1. owens-slurm01.ten.osc.edu so we can specify it when using sbatch, squeue, scontrol, etc. (scheduler host)
  2. owens.osc.edu if specified to be the host OnDemand should ssh to prior to executing sbatch (submit host)

What would be the appropriate locations for these? My guess is that for the "submit host" you could specify in the compute resource connections section a proxyHost but maybe that wasn't the exact intention of useProxy/proxyHost/proxyPort?

Some resources require to tunnel the connection through a proxy host

Also it seems to me that the access to the login node of a cluster is being specified in the connections section of the storageResources, so it is not clear to me what purpose the connections section of the computeResources serves besides a redundancy in this case.

When on a login node you can just use sbatch without specifying the scheduler host to submit jobs. But on a web VM where OnDemand runs we need to know owens-slurm01.ten.osc.edu in order to submit jobs to. Where in the scheme is it appropriate to specify this?

I would expect it to be a property of the batchSystemDefinition. But if not, perhaps in the compute resource connections list? Though in this case it is not clear to me what the connection would be.

Maybe my confusion comes from the fact that host is actually specified at the top level, instead of being specified as a property of a connection.

ericfranz commented 3 years ago

Add optional scheduler host name to batchSystemDefinition since it is a property of the batchSystemDefinition.

But the submit host as described above is a property and configuration that is gateway specific.

ericfranz commented 3 years ago

Rename proxy host and proxy port to service host and service port