NordicHPC / slurm2sql

Dump slurm accounting database to sqlite3 database for easy analysis
MIT License
9 stars 6 forks source link

Ability to run against a SLURM DB dump - without need for slurm #13

Open ds-04 opened 1 year ago

ds-04 commented 1 year ago

Hi,

Not an issue, more of a feature request.

I just wondered if there was any appetite to make this also work against a DB and not a slurm install. So then it can be run against a dump of a DB from a slurm cluster on a VM or somewhere, without needing slurm itself.

Interested to hear thoughts on this.

thanks

rkdarst commented 2 months ago

This is indeed a good idea. I think anything that is able to have columns with names would work.

If I would try to support getting data from a dump, what format would you suggest I work with? (This would also be useful for testing. I have some complex manually generated file which I use for tests, but it's hard to maintain it. This feature would simplify that, if the format is easy enough to edit in some editor).

ds-04 commented 2 months ago

apologies for the slow reply, the slurmdb dump would still need imported into a new database instance, e.g. mariadb/mysql.

(not sure if that answers the Q posed)

but if the data could be extracted from the DB instance without slurm and slurm tools needing to be installed, then it saves a bunch of setup