search

NCAR / kcor-pipeline

Pipeline code for KCor
Other
3 stars 2 forks source link

PDF version of observer logs for 2022 not on MLSO webpage #294

Closed jburkepile closed 2 years ago

jburkepile commented 2 years ago

This is not a high priority but needs to be fixed at some point. The pdf versions of the observer logs are not available for 2022. I believe the eod pipeline generates these, They should go in this directory:

/hao/ftpd5/mlso/log/observer/2022

The text versions are in that directory and available to our users from the MLSO webpage. The PDF versions are available for years prior to 2022. Only 2022 is not available.

mgalloy commented 2 years ago

The PDF versions where created by a one-time process up to the end of 2021. I need to create a daily process to process them to a PDF on a time schedule.

mgalloy commented 2 years ago

I just created the PDFs for the logs up to yesterday (2022d096).

I also created a cronjob on dawn:

5 0 * * * /home/mgalloy/bin/yesterday_olog2pdf.sh

that creates the PDF for the observer log for yesterday each morning.

mgalloy commented 2 years ago

I verified that the cronjob ran early this morning and produced a PDF for the observer log that came in last night for yesterday.

jburkepile commented 2 years ago

Thanks Mike!

mgalloy commented 2 years ago

This looks like the observer logs are being created now, but the webpage is not finding the observer logs when day-of-year is before 100, i.e., two digits. So April 9 is:

mlso_observer_log.2022d099.pdf

not

mlso_observer_log.2022d99.pdf
mgalloy commented 2 years ago

NCAR/mlso-utilities@386548273708a96d354bce4497ce6d7b3836a1a3 changes umask to fix permissions of created PDFs.

mgalloy commented 2 years ago

Permissions were correct on the PDF created last two nights.

mgalloy commented 2 years ago

@kolinski has fixed issue with website. I can download the PDF observer logs from the website now.

jburkepile commented 2 years ago

I have spot-checked multiple days and years and the pdfs are available from the webpage. The pdfs for DOY < 100 is also working for this year and previous years.

Thanks to Mike and Don for fixing these. Looks to me like this ticket can be closed.