qgis / QGIS

QGIS is a free, open source, cross platform (lin/win/mac) geographical information system (GIS)
https://qgis.org
GNU General Public License v2.0
10.44k stars 2.99k forks source link

Hydrology Fill/Sinks not funtioning #38776

Closed ECO38 closed 4 years ago

ECO38 commented 4 years ago

Describe the bug I am running through a data set and want to simultate flood risks however the hydrology fill/sinks does not work and end up with program not responding. I have tried all fill/sinks options to no avail.

Processing logs as follows: 2020-09-15T20:40:58 INFO SAGA execution commands io_gdal 0 -TRANSFORM 1 -RESAMPLING 3 -GRIDS "C:/Users/ebert/AppData/Local/Temp/processing_PbbyEj/32ee5bd6beeb4839ae97f820ed6969e8/MergedDSM.sgrd" -FILES "C:/Users/ebert/Desktop/Water Shed QGIS/Merged DSM.tif" ta_preprocessor "Fill Sinks (Planchon/Darboux, 2001)" -DEM "C:/Users/ebert/AppData/Local/Temp/processing_PbbyEj/32ee5bd6beeb4839ae97f820ed6969e8/MergedDSM.sgrd" -MINSLOPE 0.01 -RESULT "C:/Users/ebert/Desktop/Water Shed QGIS/Filled DEM.sdat" 2020-09-15T20:45:36 INFO SAGA execution console output

         C:\Windows\System32>set SAGA=C:/PROGRA~1/QGIS3~1.14/apps\saga-ltr

         C:\Windows\System32>set SAGA_MLB=C:/PROGRA~1/QGIS3~1.14/apps\saga-ltr\modules

         C:\Windows\System32>PATH=C:\PROGRA~1\QGIS3~1.14\apps\qgis\bin;C:\PROGRA~1\QGIS3~1.14\apps\Python37;C:\PROGRA~1\QGIS3~1.14\apps\Python37\Scripts;C:\PROGRA~1\QGIS3~1.14\apps\qt5\bin;C:\PROGRA~1\QGIS3~1.14\bin;C:\Windows\system32;C:\Windows;C:\Windows\system32\WBem;C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\pywin32_system32;C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\numpy\.libs;C:/PROGRA~1/QGIS3~1.14/apps\saga-ltr;C:/PROGRA~1/QGIS3~1.14/apps\saga-ltr\modules

         C:\Windows\System32>call saga_cmd io_gdal 0 -TRANSFORM 1 -RESAMPLING 3 -GRIDS "C:/Users/ebert/AppData/Local/Temp/processing_PbbyEj/32ee5bd6beeb4839ae97f820ed6969e8/MergedDSM.sgrd" -FILES "C:/Users/ebert/Desktop/Water Shed QGIS/Merged DSM.tif"
         ____________________________

         ##### ## ##### ##
         ### ### ## ###
         ### # ## ## #### # ##
         ### ##### ## # #####
         ##### # ## ##### # ##
         ____________________________

         SAGA Version: 2.3.2 (64 bit)

         ____________________________
         library path: C:\PROGRA~1\QGIS3~1.14\apps\saga-ltr\modules\
         library name: io_gdal
         library : GDAL/OGR
         tool : Import Raster
         author : O.Conrad (c) 2007 (A.Ringeler)
         processors : 16 [16]
         ____________________________

         Parameters

         Grids: No objects
         Files: "C:/Users/ebert/Desktop/Water Shed QGIS/Merged DSM.tif"
         Select from Multiple Bands:
         Alphanumeric Sorting: yes
         Transformation: yes
         Resampling: B-Spline Interpolation

         loading: C:/Users/ebert/Desktop/Water Shed QGIS/Merged DSM.tif

         Driver: GTiff

         Bands: 3

         Rows: 20000

         Columns: 20000

         loading: Merged DSM [1/3]

         Save grid: C:/Users/ebert/AppData/Local/Temp/processing_PbbyEj/32ee5bd6beeb4839ae97f820ed6969e8/MergedDSM.sgrd_2...

         Save grid: C:/Users/ebert/AppData/Local/Temp/processing_PbbyEj/32ee5bd6beeb4839ae97f820ed6969e8/MergedDSM.sgrd_3...

         C:\Windows\System32>call saga_cmd ta_preprocessor "Fill Sinks (Planchon/Darboux, 2001)" -DEM "C:/Users/ebert/AppData/Local/Temp/processing_PbbyEj/32ee5bd6beeb4839ae97f820ed6969e8/MergedDSM.sgrd" -MINSLOPE 0.01 -RESULT "C:/Users/ebert/Desktop/Water Shed QGIS/Filled DEM.sdat"

         C:\Windows\System32>exit

Python Warning: 2020-09-15T20:39:23 WARNING warning:C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py:743: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses mod = _builtin_import(name, globals, locals, fromlist, level)

         traceback: File "", line 1, in 
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 354, in startPlugin
          if not _startPlugin(packageName):
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 334, in _startPlugin
          plugins[packageName] = package.classFactory(iface)
          File "C:/Users/ebert/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\Climb\__init__.py", line 37, in classFactory
          from .Climb import Climb
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/Users/ebert/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\Climb\Climb.py", line 38, in 
          from .Climb_provider import ClimbProvider
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/Users/ebert/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\Climb\Climb_provider.py", line 33, in 
          from .Climb_algorithm import ClimbAlgorithm
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/Users/ebert/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\Climb\Climb_algorithm.py", line 49, in 
          import processing
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python/plugins\processing\__init__.py", line 26, in 
          from processing.tools.general import * # NOQA
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python/plugins\processing\tools\general.py", line 32, in 
          from processing.core.Processing import Processing
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python/plugins\processing\core\Processing.py", line 56, in 
          from processing.algs.qgis.QgisAlgorithmProvider import QgisAlgorithmProvider # NOQA
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python/plugins\processing\algs\qgis\QgisAlgorithmProvider.py", line 51, in 
          from .HypsometricCurves import HypsometricCurves
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python/plugins\processing\algs\qgis\HypsometricCurves.py", line 27, in 
          from osgeo import gdal, ogr, osr
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\osgeo\__init__.py", line 41, in 
          _gdal = swig_import_helper()
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\osgeo\__init__.py", line 15, in swig_import_helper
          import imp
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\imp.py", line 33, in 
          DeprecationWarning, stacklevel=2)

2020-09-15T20:39:30 WARNING warning:C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\objcreator.py:152: DeprecationWarning: 'U' mode is deprecated plugin = open(filename, 'rU')

         traceback: File "", line 1, in 
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 354, in startPlugin
          if not _startPlugin(packageName):
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 334, in _startPlugin
          plugins[packageName] = package.classFactory(iface)
          File "C:/Users/ebert/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\coordinator\__init__.py", line 35, in classFactory
          from .coordinator import Coordinator
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/Users/ebert/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\coordinator\coordinator.py", line 38, in 
          from .coordinator_dockwidget import CoordinatorDockWidget
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/Users/ebert/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\coordinator\coordinator_dockwidget.py", line 43, in 
          os.path.dirname(__file__), 'coordinator_dockwidget_base.ui'))
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\__init__.py", line 198, in loadUiType
          winfo = compiler.UICompiler().compileUi(uifile, code_string, from_imports, resource_suffix, import_from)
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\Compiler\compiler.py", line 53, in __init__
          qtproxies.QtWidgets, CompilerCreatorPolicy())
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\uiparser.py", line 177, in __init__
          self.factory = QObjectCreator(creatorPolicy)
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\objcreator.py", line 85, in __init__
          if self.load_plugin(filename, plugin_globals, plugin_locals):
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\objcreator.py", line 152, in load_plugin
          plugin = open(filename, 'rU')

2020-09-15T20:39:31 WARNING warning:C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\objcreator.py:152: DeprecationWarning: 'U' mode is deprecated plugin = open(filename, 'rU')

         traceback: File "", line 1, in 
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 354, in startPlugin
          if not _startPlugin(packageName):
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 334, in _startPlugin
          plugins[packageName] = package.classFactory(iface)
          File "C:/Users/ebert/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\floodrisk2\__init__.py", line 35, in classFactory
          from .floodrisk2 import FloodRisk2
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/Users/ebert/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\floodrisk2\floodrisk2.py", line 32, in 
          from .ProjectManagement.ProjectManagementDialog import ProjectDialog
          File "C:/PROGRA~1/QGIS3~1.14/apps/qgis/./python\qgis\utils.py", line 743, in _import
          mod = _builtin_import(name, globals, locals, fromlist, level)
          File "", line 983, in _find_and_load
          File "", line 967, in _find_and_load_unlocked
          File "", line 677, in _load_unlocked
          File "", line 728, in exec_module
          File "", line 219, in _call_with_frames_removed
          File "C:/Users/ebert/AppData/Roaming/QGIS/QGIS3\profiles\default/python/plugins\floodrisk2\ProjectManagement\ProjectManagementDialog.py", line 120, in 
          os.path.dirname(__file__), 'ProjectManagementDialog_base.ui'))
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\__init__.py", line 198, in loadUiType
          winfo = compiler.UICompiler().compileUi(uifile, code_string, from_imports, resource_suffix, import_from)
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\Compiler\compiler.py", line 53, in __init__
          qtproxies.QtWidgets, CompilerCreatorPolicy())
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\uiparser.py", line 177, in __init__
          self.factory = QObjectCreator(creatorPolicy)
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\objcreator.py", line 85, in __init__
          if self.load_plugin(filename, plugin_globals, plugin_locals):
          File "C:\PROGRA~1\QGIS3~1.14\apps\Python37\lib\site-packages\PyQt5\uic\objcreator.py", line 152, in load_plugin
          plugin = open(filename, 'rU')

Plugins Log: 2020-09-15T20:39:20 INFO Loaded Geometry Checker (Path: C:/PROGRA~1/QGIS3~1.14/apps/qgis/plugins/geometrycheckerplugin.dll) 2020-09-15T20:39:20 INFO Loaded GPS Tools (Path: C:/PROGRA~1/QGIS3~1.14/apps/qgis/plugins/gpsimporterplugin.dll) 2020-09-15T20:39:20 WARNING Failed to load C:/PROGRA~1/QGIS3~1.14/apps/qgis/plugins/grassplugin7.dll (Reason: Cannot load library C:\PROGRA~1\QGIS3~1.14\apps\qgis\plugins\grassplugin7.dll: The specified module could not be found.) 2020-09-15T20:39:20 WARNING Failed to load C:/PROGRA~1/QGIS3~1.14/apps/qgis/plugins/grassprovider7.dll (Reason: Cannot load library C:\PROGRA~1\QGIS3~1.14\apps\qgis\plugins\grassprovider7.dll: The specified module could not be found.) 2020-09-15T20:39:20 WARNING Failed to load C:/PROGRA~1/QGIS3~1.14/apps/qgis/plugins/grassrasterprovider7.dll (Reason: Cannot load library C:\PROGRA~1\QGIS3~1.14\apps\qgis\plugins\grassrasterprovider7.dll: The specified module could not be found.) 2020-09-15T20:39:20 INFO Loaded OfflineEditing (Path: C:/PROGRA~1/QGIS3~1.14/apps/qgis/plugins/offlineeditingplugin.dll) 2020-09-15T20:39:21 INFO Loaded Topology Checker (Path: C:/PROGRA~1/QGIS3~1.14/apps/qgis/plugins/topolplugin.dll) 2020-09-15T20:39:21 INFO Loaded Calculate Geometry (package: CalculateGeometry) 2020-09-15T20:39:24 INFO Loaded Climb (package: Climb) 2020-09-15T20:39:29 INFO Loaded Contour plugin (package: contour) 2020-09-15T20:39:30 INFO Loaded Coordinator (package: coordinator) 2020-09-15T20:39:31 INFO Loaded CSMapMaker (package: CSMapMaker) 2020-09-15T20:39:32 INFO Loaded FloodRisk2 (package: floodrisk2) 2020-09-15T20:39:33 INFO Loaded LAStools (package: LAStools) 2020-09-15T20:39:33 INFO Loaded Online Routing Mapper (package: OnlineRoutingMapper) 2020-09-15T20:39:34 INFO Loaded OSMDownloader (package: OSMDownloader) 2020-09-15T20:39:34 INFO Loaded QuickOSM (package: QuickOSM) 2020-09-15T20:39:34 INFO Loaded Value Tool (package: valuetool) 2020-09-15T20:39:35 INFO Loaded DB Manager (package: db_manager) 2020-09-15T20:39:37 INFO Loaded MetaSearch Catalog Client (package: MetaSearch) 2020-09-15T20:39:39 INFO Loaded Processing (package: processing) How to Reproduce image

QGIS and OS versions QGIS version 3.14.0-Pi QGIS code revision 9f7028fd23 Compiled against Qt 5.11.2 Running against Qt 5.11.2 Compiled against GDAL/OGR 3.0.4 Running against GDAL/OGR 3.0.4 Compiled against GEOS 3.8.1-CAPI-1.13.3 Running against GEOS 3.8.1-CAPI-1.13.3 Compiled against SQLite 3.29.0 Running against SQLite 3.29.0 PostgreSQL Client Version 11.5 SpatiaLite Version 4.3.0 QWT Version 6.1.3 QScintilla2 Version 2.10.8 Compiled against PROJ 6.3.2 Running against PROJ Rel. 6.3.2, May 1st, 2020 OS Version Windows 10 (10.0) Active python plugins CalculateGeometry; Climb; contour; coordinator; CSMapMaker; floodrisk2; LAStools; OnlineRoutingMapper; OSMDownloader; QuickOSM; valuetool; db_manager; MetaSearch; processing

Additional context My system spec are as follows: image

gioman commented 4 years ago

@ECO38 please attach your DEM.

ECO38 commented 4 years ago

Wish I could the file appears to be too big. I am following a tutorial so can tell you where the source files are. The following 4 files forms part of the DEM data:

image and can be found at the following location:

[https://ftp.maps.canada.ca/pub/elevation/dem_mne/highresolution_hauteresolution/dsm_mns/1m/ON/2016-17-Peterborough/utm17/]

The following zip files provides the shape files for the DEM:

Roads-shp.zip Building-shp.zip Hydrography_Polygon-shp.zip Pedestrian_Network_Polygon-shp.zip

gioman commented 4 years ago

The following 4 files forms part of the DEM data:

@ECO38 those are not DEMs are RGB images, this is the reason the tool is not working. You mudt download the real elevation data.

Also in your original report you have python errors that are returned by 3rd party plugins, not QGIS itself.