ucsf-wynton / wynton-website-hpc

The Official Wynton HPC User Website
https://wynton.ucsf.edu/hpc/
2 stars 14 forks source link

SPECS: Number of nodes and cores are outdated #82

Closed HenrikBengtsson closed 1 year ago

HenrikBengtsson commented 2 years ago

On https://wynton.ucsf.edu/hpc/about/specs.html we present data based on:

https://github.com/ucsf-wynton/wynton-website-hpc/blob/f78b94cf789cc2db408123e3829f31bcb585aae6/docs/_data/specs.yml#L1-L8

These are outdated. What are the new counts? Which of these can be automatically generated?

ellestad commented 2 years ago

Related to #84

jlbl commented 2 years ago

With a consultant taking a look at Wynton soon, we should make this a priority. At first glance, nodes, physical cores, gpu nodes, gpus and msg_4gpu* should be easy to generate automatically. Who wants to take ownership of this?

murashka-ucsf commented 2 years ago

I can hop on this one.

Just happened to be updating:

I cobbled this POC script together quickly and was going to gather the individual node info into a SQLite database (specs.db) under wynton-bench's home dir (/wynton/home/admins/wynton-bench/wynton-specs).

[wynton-bench@gpudev1 wynton-specs]$ ./gather_node_info.py
distro name    : centos
  distro version : 7.9.2009
  kernel_version : 3.10.0
num_cores: 16
# gpus: 2
  gpu.id: 0
    Tesla K80
    total GPU memory: 11441.0
    gpu temp: 32.0C
  gpu.id: 1
    Tesla K80
    total GPU memory: 11441.0
    gpu temp: 26.0C
HenrikBengtsson commented 1 year ago

I cobbled this POC script together quickly and was going to gather the individual node info into a SQLite database (specs.db) under wynton-bench's home dir (/wynton/home/admins/wynton-bench/wynton-specs).

This is great. Can you make it available to "other", because I, and more importantly, the website generation tools, don't have access:

$ ls /wynton/home/admins/wynton-bench/wynton-specs
ls: cannot access /wynton/home/admins/wynton-bench/wynton-specs: Permission denied
ellestad commented 1 year ago

@HenrikBengtsson

I have made /wynton/home/admins/wynton-bench/wynton-specs readable by other.