Produce more NRGFs from the Kodiak pipeline

[bberkeyU]

It would be good if the kodiak pipeline would produce NRGF's more often.

For troubleshooting issues on Mauna Loa I often want to get a full NRGF image after making a small change to the system. The current assumptions for the Boulder pipeline. Toss out the first X images of the day and only create NRGF images every 2 minutes; tend to make it hard to quickly check if changes in the instrument affect the data quality.

For today's issue, I attempted to clean the O1 to remove the extreme fringing and found a very short window of clear skies. 7 images passed the gates to create L2 images but no NRGF image was created. After this I kept the dome open hoping to get another image that might pass the L2 levels; where other days I would have closed the dome for similar weather.

[mgalloy]

You can force an NRGF out of the pipeline with, for example:

$ kcor nrgf --filename 20201117_023337_kcor.fts.gz -f production 20201116

To get this to work, make sure to put /home/mgalloy/production-pipeline/kcor-pipeline/bin in your PATH or specify it directly on the command line.

[bberkeyU]

Thanks Mike

What level image do I run this on. L0, l1 or the l2

[bberkeyU]

Running from my home directory I get the following error:

kcor nrgf —filename
/export/data1/Data/KCor/raw/20201116/level0/20201117_021706_kcor.fts.gz  -f production 20201116
[18993] /home/mgalloy/production-pipeline/kcor-pipeline/bin/runkcor_nrgf.sh production 20201116 /export/data1/Data/KCor/raw/20201116/level0/20201117_021706_kcor.fts.gz
% Program caused arithmetic error: Floating divide by 0
% Program caused arithmetic error: Floating underflow
% Program caused arithmetic error: Floating illegal operand

[mgalloy]

Don't worry about those "errors", they are actually just warnings. Your NRGF was produced:

level2$ ll 20201117_021706*
-rw-rw-r-- 1 mgalloy mlso  78K Nov 17 09:04 20201117_021706_kcor_l2_cropped.gif
-rw-rw-r-- 1 berkey  mlso 4.1M Nov 17 09:04 20201117_021706_kcor_l2.fts
-rw-rw-r-- 1 mgalloy mlso 2.5M Nov 16 16:19 20201117_021706_kcor_l2.fts.gz
-rw-rw-r-- 1 mgalloy mlso 147K Nov 17 09:04 20201117_021706_kcor_l2.gif
-rw-rw-r-- 1 berkey  mlso 2.1M Nov 17 09:04 20201117_021706_kcor_l2_nrgf.fts
-rw-rw-r-- 1 berkey  mlso 695K Nov 17 09:04 20201117_021706_kcor_l2_nrgf.gif

[bberkeyU]

Gotcha forgot to check the l2 directory.

[mgalloy]

@bberkeyU If the command line solution is sufficient, I am going to close this issue.

[bberkeyU]

@mgalloy The command line is sufficient thanks.