NCAR / kcor-pipeline

Pipeline code for KCor
Other
3 stars 2 forks source link

2 minute average and replace NRGF with 2 minute average NRGF #43

Closed mgalloy closed 6 years ago

mgalloy commented 7 years ago

In the end-of-day processing, create a two minute average at the same times NRGF images are created. Also, replace existing NRGFs with an NRGF of the two minute average files. Create FITS and fullres/lowres GIFs for each of these files.

Steps

mgalloy commented 6 years ago

Database

KCOR_NRGF

kolinski commented 6 years ago

Added new fields to mlso_numfiles:

Since the NRGF realtime files will be replaced at end of day, only one new entry for the daily average was added for this type.

jburkepile commented 6 years ago

Need to make filename changes to the averaging code:

Here is the filename format to use for the 2-min average images:

Need to generate NRGFs from average FITS

The NRGF images will be replaced with average images and we will keep the old filenames. No need to put the word 'avg' in there.

Make changes to cropped GIF annotation

I would like to change the annotation in the GIF images:

New annotation

20180110_021508_kcor_cropped_avg

Current version that needs to be changed

20180110_021508_kcor_cropped

mgalloy commented 6 years ago

To make production database ready for release, need to add "nrgfavg", "pbavg", "pbdailyavg", and "nrgfdailyavg" product types to the mlso_producttype table.

mgalloy commented 6 years ago

05dd8ef08fbdc2181d22a1e852a2d525bad1030b makes, distributes, and adds daily NRGFs to the database.