NAICNO / Jobanalyzer

Easy to use resource usage report
MIT License
0 stars 1 forks source link

Saga quarterlies/monthlies ignore data pre january 2024 #384

Closed lars-t-hansen closed 8 months ago

lars-t-hansen commented 8 months ago

Not sure what this is about. We should have data for 2023 for Saga, so quarterly reports should be generated properly, but they start on jan 7.

image

lars-t-hansen commented 8 months ago

mlx data do not have this problem.

lars-t-hansen commented 8 months ago

This could look like it's because of the spurious localhost.localdomain host that showed up in december. It causes sonalyze to error out, after which naicreport errors out. The last quarterly reports in the reports dir are from 29 january, which is when we made the 2023 data available.

I guess sonalyze needs to be made more resilient to this type of problem. There was a bug for this, and some things were fixed, but apparently we should do things a little differently. Because this is a bug in the data. So it would be OK to just discard the stream.

lars-t-hansen commented 8 months ago

Probably, aggregate_and_print_load should discard the stream, then accumulate a list of warnings, and then return the warnings as the success result instead of unit.

lars-t-hansen commented 8 months ago

Two problems:

The hackaround would be to not print warnings, but I don't really like that. Somewhat better would be to look at the exit code: if the exit code is zero, we should not treat error output as an error.

lars-t-hansen commented 8 months ago

Confirmed fixed.