2022/03/15 HARP Weekly Work Session

[rburghol]

• RB last week:
  • did full basin test for Roanoke: https://github.com/HARPgroup/model_meteorology/issues/29
  • Did a full basin runoff export from P6, and ran in the James https://github.com/HARPgroup/cbp_wsm/issues/59#issuecomment-1066873055
  • All my work leverages the new scripts that are outlined in detail here: HARPgroup/model_meteorology#29
  • And I developed a short, land segment specific workflow here: HARPgroup/HARParchive#166
• What are F land segments? HARPgroup/HARParchive#164
• Synthetic Meteorology datasets. See HARPgroup/HARParchive#141
  • Creates alternative lseg_csvs files for import into WDM
  • Use R
  • Open a historic meteorology lseg_csv
  • manipulate it:
    • Create climate change distortions (tbd, but in general: peaks go up, et goes up, small rain may go down?)
    • Create drought mash-ups, i.e, Jan-1-2018 to 12-31-2021 + 1-1-2002 to 12-31-2002
    • Finish updated downloads and then do Jan-1-2018 through 3/1/2022 and append mashups
• Land Segs with QA needs
  • A51810 : see Chowan (Meherrin/Nottoway) in HARPgroup/HARParchive#166
  • I think this one is in HARPgroup/HARParchive#98

 PROBLEM ERROR Hourly data outside valid range
 data=    1127.18115

• Running lseg visualization script:

  Error in file(file, "rt") : cannot open the connection
  In addition: Warning message:
  In file(file, "rt") :
  cannot open URL 'http://deq1.bse.vt.edu:81/met/out/lseg_csv/1984010100-2020123123/A51810.HSET': HTTP status was '404 Not Found'

• Most file are there, did I miss a step in my process?

  
  ls out/lseg_csv/1984010100-2020123123/A51810.* -lhrt
  -rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.DPT
  -rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.PET
  -rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.PRC
  -rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.RAD
  -rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.TMP
  -rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.WND

[alexwlowe]

Update 3/23/2022 The data outside valid range error is shown below:

 PROBLEM ERROR Hourly data outside valid range
 data=    1127.18115

It appears to occur in Gopal's wdm_insert_ALL funciton. The line that produces the error is here. The error can also be produced six more times in the script, one for each metric (prp, pet, rad, etc.). I think this means that the function does not like the land segment data it is receiving.

[alexwlowe]

Update 3/23/2022 The .HSET error occurs because the hargreaves samani method of evapotranspiration has not been run for every land segment (ie it is not in our current functionalized workflow). I am currently working on functionalizing the creation of .HSET so that they can be incorporated in the workflow!

The two functions that I have created are located in /backup/meteorology/R

• hset_generation.R: runs generate_lseg_hset and writes output to desired directory
• generate_lseg_hset.R: creates hset csv files from precip and radiation data