Closed mpartio closed 4 years ago
Can you send me the offending data? If you can find a single lead time where the problem occurs then that would minimise the volume.
It was the last ie 54th hour. Script:
library(harpIO)
read_eps_interpolate(
start_date = Sys.getenv("HARP_BEGINDATE"),
end_date = Sys.getenv("HARP_ENDDATE"),
eps_model = Sys.getenv("HARP_MODEL"),
parameter = NULL,
by = Sys.getenv("HARP_FCST_FREQUENCY"),
lead_time = seq(54, 54, 3),
members_in = eval(parse(text=Sys.getenv("HARP_MEMBERS"))),
lags = eval(parse(text=Sys.getenv("HARP_LAGS"))),
file_path = Sys.getenv("HARP_VFLD_DIR"),
file_template = "ecfadm_vfld{eps_model}/{YYYY}/{MM}/{DD}/vfld{eps_model}mbr{MBR3}{YYYY}{MM}{DD}{HH}{LDT2}",
sqlite_path = Sys.getenv("HARP_FCST_SQLITE_DIR"),
sqlite_template = "{eps_model}/{YYYY}/{MM}/FCTABLE_{parameter}_{YYYY}{MM}_{HH}.sqlite"
)
Environment is the same as above. Output:
$ Rscript vfld2sqlite.R
Warning: No stations specified. Default station list used.
Generating file names.
Reading data for 202002040000
Date assumed to be YYYYMMDDHHmm
Reading: /data/24_nb/metcoop/opdata/elin4/verif//ecfadm_vfldMEPS_prod/2020/02/04/vfldMEPS_prodmbr000202002040054
Reading: /data/24_nb/metcoop/opdata/elin4/verif//ecfadm_vfldMEPS_prod/2020/02/04/vfldMEPS_prodmbr001202002040054
Reading: /data/24_nb/metcoop/opdata/elin4/verif//ecfadm_vfldMEPS_prod/2020/02/04/vfldMEPS_prodmbr002202002040054
Warning: Unable to read: /data/24_nb/metcoop/opdata/elin4/verif//ecfadm_vfldMEPS_prod/2020/02/04/vfldMEPS_prodmbr002202002040054
Error: Column `p` not found in `.data`
<error/rlang_error_data_pronoun_not_found>
Column `p` not found in `.data`
Backtrace:
█
1. ├─harpIO::read_eps_interpolate(...)
2. │ └─`%>%`(...)
3. │ ├─base::withVisible(eval(quote(`_fseq`(`_lhs`)), env, env))
4. │ └─base::eval(quote(`_fseq`(`_lhs`)), env, env)
5. │ └─base::eval(quote(`_fseq`(`_lhs`)), env, env)
6. │ └─harpIO:::`_fseq`(`_lhs`)
7. │ └─magrittr::freduce(value, `_function_list`)
8. │ ├─base::withVisible(function_list[[k]](value))
9. │ └─function_list[[k]](value)
10. │ ├─dplyr::mutate(...)
11. │ └─dplyr:::mutate.tbl_df(...)
12. │ └─dplyr:::mutate_impl(.data, dots, caller_env())
13. ├─purrr::map2(...
In addition: Warning message:
In get("station_list") :
input string 'Végeirsstadir-i-Fnjoskadal' cannot be translated to UTF-8, is it valid in 'ANSI_X3.4-1968'?
Execution halted
fixed: 2954e0e9c43bf05e09b26728c69ab5ba0d9e7368
Works with the latest change. Thanks!
I'm trying to run vfld to sqlite generation for our new production CMEPS system, but I get the following error:
Any help is appreciated!
Harp version is picked from ~mid January. Script:
Environment:
Output: