No XDMoD Data for PEARC 21

johrstrom commented 3 years ago

I'm working through the OOD + XDMoD integration. Got that to work, but I see there are no jobs in XDMoD after I run /srv/xdmod/scripts/shred-ingest-aggregate-all.sh.

Am I missing something? That's the command the instructions say to run, is that the right script?

Here are snippets from the output of that command that may be useful.

2021-07-14T17:12:34.382 [INFO] archive indexer starting
2021-07-14T17:12:34.442 [INFO] archive indexer complete
2021-07-14T17:12:35.005 [WARNING] Autoperiod library not found, TimeseriesPatterns plugins will not do period analysis
2021-07-14T17:12:35.009 [INFO] Processing resource hpc
2021-07-14T17:12:35.026 [INFO] Processing 0 jobs
...
2021-07-14T17:12:34.382 [INFO] archive indexer starting
2021-07-14T17:12:34.442 [INFO] archive indexer complete
2021-07-14T17:12:35.005 [WARNING] Autoperiod library not found, TimeseriesPatterns plugins will not do period analysis
2021-07-14T17:12:35.009 [INFO] Processing resource hpc
2021-07-14T17:12:35.026 [INFO] Processing 0 jobs

The widgets in OnDemand show everything empty

Same with XDMoD

ryanrath commented 3 years ago

Have you run the submit_jobs.sh script on the frontend node? Pretty sure that needs to be run or there's nothing to shred / ingest / aggregate.

johrstrom commented 3 years ago

Nope! I see that's a part of the XDMoD tutorial, so I'll do that. Thanks!

ryanrath commented 3 years ago

@johrstrom np! Also, not sure if you're pulling peoples names over to OOD from XDMoD. But if you are then you'll also want to run xdmod-import-csv -t names -i /srv/xdmod/historical/names.slurm.csv and then re-run sudo -u xdmod /srv/xdmod/scripts/shred-ingest-aggregate-all.sh. to get those names to show up.

johrstrom commented 3 years ago

Good looking out. We do have to do that otherwise it doesn't seem to recognize hpcadmin's jobs to that user.

ubccr / hpc-toolset-tutorial

No XDMoD Data for PEARC 21 #96