UMEP-dev / UMEP

Urban Multi-scale Environmental Predictor
https://umep-docs.readthedocs.io/
59 stars 15 forks source link

SUEWS PREPARE DOES NOT GENERATE-list index out of range #366

Closed phemiobe closed 2 years ago

phemiobe commented 2 years ago

Hello, I am using suews prepare in the UMEP pre-processor to generate inputs to run SUEWS . I was able to prepare the met data from ERA5 and the grids as described in the tutorial. However, I encountered the error pasted below in suews prepare. Can anyone kindly assist? Thanks for your time..the main error is list index out of range.

Operations cancelled, process unsuccessful! See the General tab in Log Messages Panel (speech bubble, lower right) for more information.

2022-02-04T22:42:43 INFO UMEP - SuPy Version installed: 2021.11.22 2022-02-04T22:42:45 INFO UMEP - SuPy Version installed: 2021.11.22 2022-02-04T22:42:52 INFO Application state: QGIS_PREFIX_PATH env var: C:/PROGRA~1/QGIS32~1.3/apps/qgis Prefix: C:/PROGRA~1/QGIS32~1.3/apps/qgis Plugin Path: C:/PROGRA~1/QGIS32~1.3/apps/qgis/plugins Package Data Path: C:/PROGRA~1/QGIS32~1.3/apps/qgis/. Active Theme Name: default Active Theme Path: C:/PROGRA~1/QGIS32~1.3/apps/qgis/./resources/themes\default\icons/ Default Theme Path: :/images/themes/default/ SVG Search Paths: C:/PROGRA~1/QGIS32~1.3/apps/qgis/./svg/ C:/Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/svg/ User DB Path: C:/PROGRA~1/QGIS32~1.3/apps/qgis/./resources/qgis.db Auth DB Path: C:/Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/qgis-auth.db

2022-02-04T22:44:32 INFO Setting up tab: Paved 2022-02-04T22:44:32 INFO Setting up tab: Building 2022-02-04T22:44:32 INFO Setting up tab: Evergreen 2022-02-04T22:44:32 INFO Setting up tab: Decidious 2022-02-04T22:44:32 INFO Setting up tab: Grass 2022-02-04T22:44:32 INFO Setting up tab: Bare Soil 2022-02-04T22:44:32 INFO Setting up tab: Water 2022-02-04T22:44:32 INFO Setting up tab: Conductance 2022-02-04T22:44:32 INFO Setting up tab: Snow 2022-02-04T22:44:32 INFO Setting up tab: Snow clearing 2022-02-04T22:44:32 INFO Setting up tab: Anthropogenic 2022-02-04T22:44:32 INFO Setting up tab: Irrigation 2022-02-04T22:44:32 INFO Setting up tab: Water Use (Manual) 2022-02-04T22:44:32 INFO Setting up tab: Water Use (Automatic) 2022-02-04T22:44:32 INFO Setting up tab: ESTM Coefficients 2022-02-04T22:49:47 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range 2022-02-04T22:52:10 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range 2022-02-04T23:08:08 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range 2022-02-04T23:49:10 INFO Setting up tab: Paved 2022-02-04T23:49:10 INFO Setting up tab: Building 2022-02-04T23:49:10 INFO Setting up tab: Evergreen 2022-02-04T23:49:10 INFO Setting up tab: Decidious 2022-02-04T23:49:10 INFO Setting up tab: Grass 2022-02-04T23:49:10 INFO Setting up tab: Bare Soil 2022-02-04T23:49:10 INFO Setting up tab: Water 2022-02-04T23:49:10 INFO Setting up tab: Conductance 2022-02-04T23:49:10 INFO Setting up tab: Snow 2022-02-04T23:49:10 INFO Setting up tab: Snow clearing 2022-02-04T23:49:10 INFO Setting up tab: Anthropogenic 2022-02-04T23:49:10 INFO Setting up tab: Irrigation 2022-02-04T23:49:10 INFO Setting up tab: Water Use (Manual) 2022-02-04T23:49:10 INFO Setting up tab: Water Use (Automatic) 2022-02-04T23:49:10 INFO Setting up tab: ESTM Coefficients 2022-02-04T23:50:53 INFO Setting up tab: Paved 2022-02-04T23:50:53 INFO Setting up tab: Building 2022-02-04T23:50:53 INFO Setting up tab: Evergreen 2022-02-04T23:50:53 INFO Setting up tab: Decidious 2022-02-04T23:50:53 INFO Setting up tab: Grass 2022-02-04T23:50:53 INFO Setting up tab: Bare Soil 2022-02-04T23:50:53 INFO Setting up tab: Water 2022-02-04T23:50:53 INFO Setting up tab: Conductance 2022-02-04T23:50:53 INFO Setting up tab: Snow 2022-02-04T23:50:53 INFO Setting up tab: Snow clearing 2022-02-04T23:50:53 INFO Setting up tab: Anthropogenic 2022-02-04T23:50:53 INFO Setting up tab: Irrigation 2022-02-04T23:50:53 INFO Setting up tab: Water Use (Manual) 2022-02-04T23:50:53 INFO Setting up tab: Water Use (Automatic) 2022-02-04T23:50:53 INFO Setting up tab: ESTM Coefficients 2022-02-04T23:55:22 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range 2022-02-04T23:57:24 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range 2022-02-04T23:58:48 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range 2022-02-05T00:02:31 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range 2022-02-05T00:08:12 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range 2022-02-05T00:09:30 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range 2022-02-05T00:12:35 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range 2022-02-05T00:18:06 CRITICAL EXCEPTION IN C:\Users/User/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\UMEP\SUEWSPrepare\prepare_worker.py, LINE 355 "IMP_wai = split[8]" ERROR MESSAGE: list index out of range

biglimp commented 2 years ago

An update in the Morphometric calculator was recently added where also wai (wall area index) was included. Regenerate your building morphology file using the lastest UMEP version and try again.

phemiobe commented 2 years ago

Thanks @biglimp

I have the latest version installed yet the wai was not calculated. I have attached the LCZ_build_MPGrid_isotropic.txt file LCZ_build_MPGrid_isotropic.txt

Installed version 3.19.1 Available version (stable) 3.19.1 updated at Tue Jan 18 07:36:04 2022 Changelog 3.19.1: Removed import of geopandas which resulted in a plugin failure in QGIS 3.22

biglimp commented 2 years ago

Could it be possible that you calculated this file in an earlier version. I chacked the code and wai should be included (https://github.com/UMEP-dev/UMEP/blob/eda97006d7304bdfd6ae6ef565ff3a7ce8908ea9/ImageMorphParam/impgworker.py#L275). Please recalculate and report back.

phemiobe commented 2 years ago

I have recalculated it, yet no wai. here is the header ID pai fai zH zHmax zHstd zd z0 1 0.003 0.002 0.070 0.140 0.032 -9999.000 -9999.000 2 0.002 0.002 0.051 0.102 0.023 -9999.000 -9999.000

LCZ_build_MPGrid_isotropic.txt

biglimp commented 2 years ago

I cannot replicate your error. Here is a file that I calculated just now using Morphometric Calculator (Grid), UMEP 3.19.1.

id pai fai zH zHmax zHstd zd z0 wai
  1 0.212 0.331 8.176 17.265 3.736 5.723 0.818 0.338
  2 0.177 0.191 10.838 26.701 4.202 7.586 1.084 0.319

I suggest you uninstall and reinstall UMEP

phemiobe commented 2 years ago

Thanks. I have uninstalled and installed yet no wai. dont just know why mine isnt working.... to replicate my error. I used Lagos Nigeria LCZ from wudapt. the vector grid is created from GPWv4 pop density from (WCS) for 2010 (with 5000m grids resolution at the LCZ map extent).

and then used the default parameters for the LCZ in the LCZ converter.. and set the pervious distribution to same for all lCZ's(see attached...

phemiobe commented 2 years ago

set up

biglimp commented 2 years ago

Aha, now I see. WE have forgotten to include wai in the output from the LCZ converter. This will not be a quick fix as we need to come up with numbers of this parameter for each LCZ.

phemiobe commented 2 years ago

thanks for your quick response. In the mean time what do you suggest I do? which DSM did you use to calculate the morphometric properties here..

id pai fai zH zHmax zHstd zd z0 wai 1 0.212 0.331 8.176 17.265 3.736 5.723 0.818 0.338 2 0.177 0.191 10.838 26.701 4.202 7.586 1.084 0.319

can I use SRTM?

phemiobe commented 2 years ago

Morphometric

biglimp commented 2 years ago

I quickfix is to just manually add a wai-column in your LCZ_build_MPGrid_isotropic.txt and specify 1.0. If you are using standard settings in SUEWS, wall area is not used. IT is only used if you calculate storage with the ESTM-scheme, which you probably dont.

phemiobe commented 2 years ago

O yeah. you are making sense sense.. it works . I am able to generate SUEWS prepare. However, I encountered another error in running SUEWS advanced..

"SuPy stopped entering simulation due to invalid initial states!"

Check: C:\Users\User\Documents\SuPy.log

Please report any errors to https://github.com/UMEP-dev/UMEP/issues

Please find below the tail of supy.log [0] at index 292 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 293 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 294 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 295 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 296 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 297 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 298 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 299 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 300 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 301 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 302 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 303 enddls should be between [1, 366] but 1 outliers are found at: [0] at index 304 2022-02-07 17:03:18,828 - SuPy - CRITICAL - df_state_init is NOT valid to initialise SuPy!

phemiobe commented 2 years ago

supy.log file is attached SuPy.log

biglimp commented 2 years ago

@sunt05, can you assist with the SuPy issue.

sunt05 commented 2 years ago

this looks to me to be an issue due to incorrect setting in SiteSelect, where EndDLS is set with something outside of the valid range [1,366].

phemiobe commented 2 years ago

Thats true I initially used 0 as the start and end of my DLS because Lagos (my ROI) has no DLS. and then I have the supy error. I afterward used the defaults values 85 and 302 and it works.

Thanks