HydrologicEngineeringCenter / Vortex

data processing utilities
MIT License
26 stars 7 forks source link

asc Format-File names #36

Closed hahabibi88 closed 2 years ago

hahabibi88 commented 3 years ago

I am trying to import several asci format rainfall data (not PRISM) to dss. The data is in 15 minutes time interval. The importer.exe works just fine and convert the data to dss but it doesn't fill out Part C, D and part E of dss file which are related to variable (like precipitation), and Start and End time. Is there any specific file name that I should use for asci format data? Thank you!

joshuarwillis commented 3 years ago

@hahabibi88 just make sure that the file names (.asc and .prj) contain the start time and end time in format "yyyy_MM_dd't'Hmm". For example, "2018_01_01t1100_2018_01_01t1115.asc" should import correctly.

hahabibi88 commented 3 years ago

@joshuarwillis Thank you, Worked! Could you also let me know how to include "PRECIPITATION" in the Part C? should "ppt" be included in a particular way in the .asc and .prj filename?

joshuarwillis commented 3 years ago

@hahabibi88 glad it worked. It doesn't look like there is a way to include PRECIPITATION as the C Part with your dataset currently. Do you mind sharing the source of your precipitation grids? We may be able to make improvements in future releases so that Vortex better handles other precipitation sources.

tanveerahmed-89 commented 3 years ago

Dear good people, hope everyone is doing well. I am trying to follow the example provided for 15-minutes time interval and replicate the things for 1-hr time interval by changing the naming format of the ascii files like this: "2016_08_12t1200_2016_08_12t1300.asc". The importer.exe was able to convert the data into dss but unfortunately when I was trying to plot the data, the Grid Display is blank. (I have attached an image for your reference).

The same ascii file works if I just follow the naming format for 15-minutes time interval as: "2016_08_12t1100_2016_08_12t1115.asc". Is there any specific format that should be followed for 1-hr time interval?

I have also attached the ascii files I am working with for your reference. Any suggestions will be much appreciated. ASCII_Files_TA_20210907.zip Thank you.

15_min_time_interval

1_hr_time_interval

hahabibi88 commented 3 years ago

@tanveerahmed-89 I think you need to remove the "00" for the minute part. It probably will work with this format for 1-hr intervals: "2016_08_12t12_2016_08_12t13". try it.

tanveerahmed-89 commented 3 years ago

@hahabibi88 thank you very much for your suggestion. I tried it. It solves the issue for grid display but now part D and part E i.e. "timestamp" of the DSS file are empty. If you have any other idea will be glad to know and try. Appreciate your help.

image

hahabibi88 commented 2 years ago

@tanveerahmed-89 I just tested with "00", it is working, see the image bellow! image

This is the file name, I tried. 2016_08_12t1200_2016_08_12t1300.asc 2016_08_12t1200_2016_08_12t1300.prj

hydrouser commented 2 years ago

@tanveerahmed-89 I just tested with "00", it is working, see the image bellow! image

This is the file name, I tried. 2016_08_12t1200_2016_08_12t1300.asc 2016_08_12t1200_2016_08_12t1300.prj

I have really no explanation, why import works for some file names (e.g. the files cited above). I change the filename to "1999_08_12t1200_1999_08_12t1300" and filling part D and part E won't work anymore. Is there any workaround? Thanks for the effort

Edit: By switching region settings in Windows to USA the problem is solved. The above date format works now.

danhamill commented 2 years ago

I tried the suggested 2016_08_12t1200_2016_08_12t1300.tif file name structure for a GTIFF file and could not get the partD/PartE to populate correctly. I ended up finding you an add precip_ as a prefix to the start and end dates for the grid worked. Something like: precip_2016_08_12t1200_2016_08_12t1300.tif

This is similar to #18

tombrauer commented 2 years ago

Hopefully this documentation helps clarify expectations for date parsing in file names.

tombrauer commented 2 years ago

Marking as closed.