There are a number of useful plots I make to inspect various aspects of each day's SoCal data.
The main plots I generate:
Daily RV timeseries
Daily RV timeseries in green & red channels
Daily pyrheliometer irradiance timeseries
I currently generate these on shrek using a couple scripts. The daily steps are, at the end of a day:
Generate the .csv of irradiance values by using a ktl query on kpfeng and then copy over to shrek:
[kpfeng@kpfserver] ~/bin > python copy_pyrheliometer_for_date.py YYYYMMDD
Extract the RVs from the FITS headers and store in a seperate RV
rrubenza@shrek /data/user/rrubenza/mydrp $ python process_socal.py -s YYYYMMDD
This second step uses functions from socal_plots.py in the same directory which contains the actual code for generating the above plots, as well as a few other utility modules I have scattered about. It also performs the clearness calculations and flags cloudy and clear observations in the output/scr/rrubenza/socal/rvs/daily/YYYYMMDD_socal_rv.csva separate note to myself to change this directory structure to instead nest these files in year and month subdirectories rather than one flat folder called daily
The resulting plots are saved to /scr/rrubenza/socal/plots/daily_rvs/ and /scr/rrubenza/socal/plots/daily_irradiance/
It would be of interest to many to have these plots somewhere easily viewable, e.g., Jump and auto-generated each day. This issue is to discuss how best to do that. @awhoward @bjfultn @MNBrod @shalverson
There are a number of useful plots I make to inspect various aspects of each day's SoCal data.
The main plots I generate:
Daily RV timeseries
Daily RV timeseries in green & red channels
Daily pyrheliometer irradiance timeseries
I currently generate these on shrek using a couple scripts. The daily steps are, at the end of a day:
[kpfeng@kpfserver] ~/bin > python copy_pyrheliometer_for_date.py YYYYMMDDrrubenza@shrek /data/user/rrubenza/mydrp $ python process_socal.py -s YYYYMMDDThis second step uses functions fromsocal_plots.pyin the same directory which contains the actual code for generating the above plots, as well as a few other utility modules I have scattered about. It also performs the clearness calculations and flags cloudy and clear observations in the output/scr/rrubenza/socal/rvs/daily/YYYYMMDD_socal_rv.csva separate note to myself to change this directory structure to instead nest these files in year and month subdirectories rather than one flat folder calleddailyThe resulting plots are saved to
/scr/rrubenza/socal/plots/daily_rvs/and/scr/rrubenza/socal/plots/daily_irradiance/It would be of interest to many to have these plots somewhere easily viewable, e.g., Jump and auto-generated each day. This issue is to discuss how best to do that. @awhoward @bjfultn @MNBrod @shalverson