search

pacificclimate / crmprtd

Utility to download near real time weather data and insert it into PCIC's database
GNU General Public License v3.0
0 stars 2 forks source link

Network dfo_ccg_lighthouse always shows 0 observations to process #154

Open rod-glover opened 1 year ago

rod-glover commented 1 year ago

This may be real, or it may be a bug. If it's a bug, logs seem to suggest the early stages -- normalize, align, or filter -- as the likely culprit.

jameshiebert commented 1 year ago

Looks like the database variable entries have spurious white space in them, so align can't match the variables.

crmp=> select net_var_name from meta_vars natural join meta_network where network_name = 'DFO_CCG_lighthouse';
   net_var_name   
------------------
 wnd_dir_code    +

 tot_cld_amt_code+

 vis             +

 wnd_spd         +

 dwpt_temp       +

 cld_bas_hgt_1   +

 cld_bas_hgt_2   +

 cld_bas_hgt_3   +

 cld_amt_code_1  +

 cld_amt_code_2  +

 cld_amt_code_3  +

 air_temp        +

(12 rows)

@cdmballantyne would you be able to fix the net_var_name entries for the DFO_CCG_lighthouse network?

cdmballantyne commented 1 year ago

Sorry for taking a while to get to this, the names have been fixed.

jameshiebert commented 1 year ago

Alright! We're getting data :)

image

Would you be able to go back and post-process all of the cache files (In /home/crmprtd/dfo_ccg_lighthouse/cache) that we've downloaded for that network to capture the data that we missed?