search

DFO-Ocean-Navigator / netcdf-timestamp-mapper

Maps timestamps (and variables) to a corresponding nc file using sqlite3.
https://dfo-ocean-navigator.github.io/netcdf-timestamp-mapper/
GNU General Public License v3.0
1 stars 1 forks source link

An odd behavior when defining the FQD path for the --file-list option #24

Open dwayne-hart opened 4 years ago

dwayne-hart commented 4 years ago

(index-tool) sdfo504@usr-svc-sci-ctn038:~$ ./netcdf-timestamp-mapper/build/nc-timestamp-mapper -n riops-fc-2d-ll -i /home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops --file-list /home/sdfo504/riops-fc-2dll.lst --keep-file-list -o netcdf-timestamp-mapper/build/db -h Found list of non-indexed files. Only the files contained in this list will be indexed... Creating list of all .nc files in /home/sdfo504/riops-fc-2dll.lst... Building dataset description from 12 .nc file(s).

NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020022000_000_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020021806_001_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020022200_001_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020022006_000_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020022006_001_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020022100_000_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020021806_000_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020022100_001_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020022106_000_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020022106_001_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020022000_001_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 NetCDF error in: "/home/sdfo504/home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops/2020022200_000_2D_latlon0.1x0.1.nc" No such file or directory file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp line:88 100% [|||||||||||||||||||||||||||||||||||||||||||||||||||||]

Failed to find the time dimension in any of the NetCDF files. (index-tool) sdfo504@usr-svc-sci-ctn038:~$ ./netcdf-timestamp-mapper/build/nc-timestamp-mapper -n riops-fc-2d-ll -i /home/sdfo501/eccc_forecasts/riops_20191231/main/netcdf/prog/riops --file-list riops-fc-2dll.lst --keep-file-list -o netcdf-timestamp-mapper/build/db -h Found list of non-indexed files. Only the files contained in this list will be indexed... Creating list of all .nc files in riops-fc-2dll.lst... Building dataset description from 12 .nc file(s).

100% [|||||||||||||||||||||||||||||||||||||||||||||||||||||]

Opening database... Inserting new values into database... All done.

dwayne-hart commented 3 years ago

A similar event occurred when I was using a text file located in /tmp. For whatever reason it prepended the file location with the string /tmp.

(index-tool) root@sm-node0-r9:/mnt/ramdisk/tools/netcdf-timestamp-mapper/bin# ./nc-timestamp-mapper -n giops-2dll -o /mnt/ramdisk/dbs -i /mnt/onav-data/dd.weather.gc.ca/model_giops/netcdf/lat_lon/2d --file-list /tmp/giops-2dll.txt --keep-file-list -h

Error message when the command is launched;

file: /home/conda/feedstock_root/build_artifacts/netcdf-cxx4_1574774950339/work/cxx4/ncFile.cpp  line:88
NetCDF error in: "/tmp/mnt/onav-data/dd.weather.gc.ca/model_giops/netcdf/lat_lon/2d/12/009/CMC_giops_iicevol_sfc_0_latlon0.2x0.2_3h-mean_2020082312_P009.nc"
No such file or directory