search

ClimateGlobalChange / tempestextremes

Extreme weather detection and characterization
83 stars 30 forks source link

Error when executing StichNodes_test.sh #43

Closed kminzoo closed 1 year ago

kminzoo commented 1 year ago

hi!

My "DetectNodes_test.job" file looks like this:

image

When I executed DetectNodes_test.job, the candidates were successfully selected and stored at "/home/climate_finance/TC_algorithms/study/papier_trackers/trackers/OWZ/bdd/ERA5/NETCDF/GLOBAL_025/4xdaily/AN_PL/2020/nodes" under the name of "202008.txt".

But I got the error when I tried to execute StitchNodes_test.sh.

StitchNodes_test.sh looks like this:

#!/bin/bash

yr=2020

ls /home/climate_finance/TC_algorithms/study/papier_trackers/trackers/OWZ/bdd/ERA5/NETCDF/GLOBAL_025/4xdaily/AN_PL/${yr}/nodes/*.txt > /home/climate_finance/TC_algorithms/study/papier_track
ers/trackers/OWZ/bdd/ERA5/NETCDF/GLOBAL_025/4xdaily/AN_PL/${yr}/tmp/nodeslist.txt

file_name=/home/climate_finance/TC_algotithms/study/OWZ_file/fOWZ_${yr}.csv

StitchNodes \
        --in_list /home/climate_finance/TC_algorithms/study/papier_trackers/trackers/OWZ/bdd/ERA5/NETCDF/GLOBAL_025/4xdaily/AN_PL/${yr}/tmp/nodeslist.txt \
        --out $file_name \
        --in_fmt "lon,lat,owz850,owz500" \
        --range 5.0 \
        --mintime "48h" \
        --maxgap "24h" \
        --threshold "owz850,>=,0.00006,9;owz500,>=,0.00005,9" \
        --out_file_format "csv"

Here is the error:

Arguments:
  --in <string> [""]
  --in_list <string> ["/home/climate_finance/TC_algorithms/study/papier_trackers/trackers/OWZ/bdd/ERA5/NETCDF/GLOBAL_025/4xdaily/AN_PL/2020/tmp/nodeslist.txt"]
  --in_connect <string> [""]
  --out <string> ["/home/climate_finance/TC_algotithms/study/OWZ_file/fOWZ_2020.csv"]
  --in_fmt <string> ["lon,lat,owz850,owz500"]
  --range <double> [5.000000] (degrees)
  --mintime <string> ["48h"]
  --time_begin <string> [""]
  --time_end <string> [""]
  --min_endpoint_dist <double> [0.000000] (degrees)
  --min_path_dist <double> [0.000000] (degrees)
  --maxgap <string> ["24h"]
  --threshold <string> ["owz850,>=,0.00006,9;owz500,>=,0.00005,9"] [col,op,value,count;...]
  --caltype <string> ["standard"] (none|standard|noleap|360_day)
  --allow_repeated_times <bool> [false]
  --out_file_format <string> ["csv"] (gfdl|csv|csvnohead)
------------------------------------------------------------
Parsing thresholds
..owz850 greater than or equal to 0.000060 at least 9 time(s)
..owz500 greater than or equal to 0.000050 at least 9 time(s)
..Done
Loading candidate data
..Discrete times: 124 (2020-08-01 00:00:00 to 2020-08-31 18:00:00)
..Done
Creating KD trees at each time level.. Done
Populating set of path segments.. Done
Constructing paths
..Paths rejected (mintime): 1186
..Paths rejected (minendpointdist): 0
..Paths rejected (minpathdist): 0
..Paths rejected (threshold): 189
..Total paths found: 264
..Done
Writing results
..EXCEPTION (/home/conda/feedstock_root/build_artifacts/tempest-extremes_1643338652905/work/src/base/NodeFileUtilities.cpp, Line 575) Error opening file "/home/climate_finance/TC_algotithms/study/OWZ_file/fOWZ_2020.csv" for writing

how can I solve this?

paullric commented 1 year ago

Very strange. The file writer in StitchNodes is nothing special. Are you sure you have write permissions to that directory? Can you try writing to the same directory where DetectNodes was successful at writing?

On Wed, Feb 15, 2023 at 00:11 kminzoo @.***> wrote:

hi!

My "DetectNodes_test.job" file looks like this:

[image: image] https://user-images.githubusercontent.com/123060518/218965360-0c7ddba3-f272-4b2d-b08b-93549d6dcdf1.png

When I executed DetectNodes_test.job, the candidates were successfully selected and stored at "/home/climate_finance/TC_algorithms/study/papier_trackers/trackers/OWZ/bdd/ERA5/NETCDF/GLOBAL_025/4xdaily/AN_PL/2020/nodes" under the name of "202008.txt".

But I got the error when I tried to execute StitchNodes_test.sh.

StitchNodes_test.sh looks like this:

!/bin/bash

yr=2020

ls /home/climate_finance/TC_algorithms/study/papier_trackers/trackers/OWZ/bdd/ERA5/NETCDF/GLOBAL_025/4xdaily/AN_PL/${yr}/nodes/*.txt > /home/climate_finance/TC_algorithms/study/papier_track ers/trackers/OWZ/bdd/ERA5/NETCDF/GLOBAL_025/4xdaily/AN_PL/${yr}/tmp/nodeslist.txt

file_name=/home/climate_finance/TC_algotithms/study/OWZfile/fOWZ${yr}.csv

StitchNodes \ --in_list /home/climate_finance/TC_algorithms/study/papier_trackers/trackers/OWZ/bdd/ERA5/NETCDF/GLOBAL_025/4xdaily/AN_PL/${yr}/tmp/nodeslist.txt \ --out $file_name \ --in_fmt "lon,lat,owz850,owz500" \ --range 5.0 \ --mintime "48h" \ --maxgap "24h" \ --threshold "owz850,>=,0.00006,9;owz500,>=,0.00005,9" \ --out_file_format "csv"

Here is the error:

Arguments: --in [""] --in_list ["/home/climate_finance/TC_algorithms/study/papier_trackers/trackers/OWZ/bdd/ERA5/NETCDF/GLOBAL_025/4xdaily/AN_PL/2020/tmp/nodeslist.txt"] --in_connect [""] --out ["/home/climate_finance/TC_algotithms/study/OWZ_file/fOWZ_2020.csv"] --in_fmt ["lon,lat,owz850,owz500"] --range [5.000000] (degrees) --mintime ["48h"] --time_begin [""] --time_end [""] --min_endpoint_dist [0.000000] (degrees) --min_path_dist [0.000000] (degrees) --maxgap ["24h"] --threshold ["owz850,>=,0.00006,9;owz500,>=,0.00005,9"] [col,op,value,count;...] --caltype ["standard"] (none|standard|noleap|360_day) --allow_repeated_times [false] --out_file_format ["csv"] (gfdl|csv|csvnohead)

Parsing thresholds ..owz850 greater than or equal to 0.000060 at least 9 time(s) ..owz500 greater than or equal to 0.000050 at least 9 time(s) ..Done Loading candidate data ..Discrete times: 124 (2020-08-01 00:00:00 to 2020-08-31 18:00:00) ..Done Creating KD trees at each time level.. Done Populating set of path segments.. Done Constructing paths ..Paths rejected (mintime): 1186 ..Paths rejected (minendpointdist): 0 ..Paths rejected (minpathdist): 0 ..Paths rejected (threshold): 189 ..Total paths found: 264 ..Done Writing results ..EXCEPTION (/home/conda/feedstock_root/build_artifacts/tempest-extremes_1643338652905/work/src/base/NodeFileUtilities.cpp, Line 575) Error opening file "/home/climate_finance/TC_algotithms/study/OWZ_file/fOWZ_2020.csv" for writing

how can I solve this?

— Reply to this email directly, view it on GitHub https://github.com/ClimateGlobalChange/tempestextremes/issues/43, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABIVPZEHCFHFKQ5M4KGYO7DWXSFTVANCNFSM6AAAAAAU4QUCG4 . You are receiving this because you are subscribed to this thread.Message ID: @.***>

kminzoo commented 1 year ago

oh, i found that there was a typo when writing the path....sorry... it works fine now!!