search

qgis / QGIS

QGIS is a free, open source, cross platform (lin/win/mac) geographical information system (GIS)
https://qgis.org
GNU General Public License v2.0
10.51k stars 2.99k forks source link

Unable to generate previews for non-COPC Pointcloud LAS #48798

Closed hamishcampbell closed 12 months ago

hamishcampbell commented 2 years ago

What is the bug or the crash?

Using QGIS nightlies (82e9dbed42), unable to generate previews for non-COPC LAS files.

Fails while running "Generating Pointcloud Index" with the error:

Untwine error: unordered_map::at: key not found

Attached file where this error occurs.

island.las.zip

Note that COPC files are fine (presumably because the indexing is not required)

Steps to reproduce the issue

  1. Add a non-COPC LAS file to the map
  2. Await the indexing process
  3. Eventually fails with the error Untwine error: unordered_map::at: key not found
  4. Only PC extent is displayed

Versions

QGIS version 3.25.0-Master QGIS code revision 82e9dbed42
Qt version 5.15.2
Python version 3.9.5
GDAL/OGR version 3.3.2
PROJ version 8.1.1
EPSG Registry database version v10.028 (2021-07-07)
GEOS version 3.9.1-CAPI-1.14.2
SQLite version 3.35.2
PDAL version 2.3.0
PostgreSQL client version unknown
SpatiaLite version 5.0.1
QWT version 6.1.6
QScintilla2 version 2.11.5
OS version macOS 12.3
       

Active Python plugins kart | 1.0.0 koordinatesexplorer | 1.0.0 LAStools | 1.4 pluginbuilder3 | 3.2.1 QuickWKT | 3.1 plugin_reloader | 0.9.1 processing | 2.12.99 sagaprovider | 2.12.99 grassprovider | 2.12.99 db_manager | 0.1.20

Supported QGIS version

New profile

Additional context

This was working in QGIS 3.24.3-Tisler (current stable), so appears to be a regression.

wonder-sk commented 2 years ago

Hmm... works for me fine on linux. Anyone on Mac to confirm?

hamishcampbell commented 2 years ago

@wonder-sk What build are you using?

wonder-sk commented 2 years ago

I'm using self-compiled QGIS master build, ubuntu 20.04.

soester commented 2 years ago

I got the same error here.

QGIS version 3.25.0-Master QGIS code revision 1113c08e3b
Qt version 5.15.2
Python version 3.9.5
GDAL/OGR version 3.3.2
PROJ version 8.1.1
EPSG Registry database version v10.028 (2021-07-07)
GEOS version 3.9.1-CAPI-1.14.2
SQLite version 3.35.2
PDAL version 2.3.0
PostgreSQL client version unknown
SpatiaLite version 5.0.1
QWT version 6.1.6
QScintilla2 version 2.11.5
OS version macOS 10.15
       

Active Python plugins QgisModelBaker | v6.3.4 DataPlotly | 3.9 VectorBender | 0.2.1 changeDataSource | 3.1 quick_map_services | 0.19.11.1 AnotherDXF2Shape | 1.2.4 SRTM-Downloader | 3.1.9 pg_history_viewer | 2.2 swiss_locator | 1.3.4 processing | 2.12.99 sagaprovider | 2.12.99 db_manager | 0.1.20

Using data from here:

http://geolion.zh.ch/geodatensatz/show?giszhnr=24

wonder-sk commented 2 years ago

@hamishcampbell @soester if you try to open your data in QGIS 3.24, will things work fine?

soester commented 2 years ago

@wonder-sk yes, i am able to open the same dataset with this setup:

QGIS version 3.24.2-Tisler QGIS code revision 573ca40c96
Qt version 5.15.2
Python version 3.9.5
GDAL/OGR version 3.3.2
PROJ version 8.1.1
EPSG Registry database version v10.028 (2021-07-07)
GEOS version 3.9.1-CAPI-1.14.2
SQLite version 3.35.2
PDAL version 2.3.0
PostgreSQL client version unknown
SpatiaLite version 5.0.1
QWT version 6.1.6
QScintilla2 version 2.11.5
OS version macOS 10.15
       

Active Python plugins QgisModelBaker | v6.3.4 DataPlotly | 3.9 VectorBender | 0.2.1 changeDataSource | 3.1 quick_map_services | 0.19.11.1 AnotherDXF2Shape | 1.2.4 SRTM-Downloader | 3.1.9 pg_history_viewer | 2.2 swiss_locator | 1.3.4 processing | 2.12.99 sagaprovider | 2.12.99 db_manager | 0.1.20

soester commented 2 years ago

@wonder-sk just tested again in qgis-dev 3.25: It works fine if i take a laz-file which i allready used in 3.24. The issue only occurs if i pull in a 'fresh' laz file.

3.24 creates a ept_filename folder with these subfolders

3.25 creates a filename.copc.laz_tmp folder with lots of .bin files.

hope this helps to understand the issue

hamishcampbell commented 2 years ago

Have since updated to 3943ef5e10, same error persists.

wonder-sk commented 2 years ago

Confirmed as an upstream issue in untwine: https://github.com/hobuinc/untwine/issues/123

hobu commented 2 years ago

Fixed upstream at https://github.com/hobuinc/untwine/commit/4e60f8a7f5edd094d4e5d44e7093677e841a1213 please test and confirm.

dvmepi commented 2 years ago

I am having the same issue on Mac OS - tried both QGIS 3.26 and 3.22

"Layer [xyz]: Untwine error: unordered_map::at: key not found"

hobu commented 2 years ago

rename the file with ascii characters until 3.26.1 is released.

dvmepi commented 2 years ago

rename the file with ascii characters until 3.26.1 is released.

Please provide me some additional information, I haven't used QGIS in quite a long time. Thanks.

soester commented 2 years ago

@hobu my filenames don't contain non-ascii characters: 10_Geodata/00_Grundlagen/LIDAR_Laserscanning-Punktwolke_-_2017-2018_-OGD/2673_1252.laz

saberraz commented 2 years ago

Could you copy/move the file to another location (e.g. Documents)?

soester commented 2 years ago

Indeed the other directory was on a shared network volume (smb)

With: /Users/sam/Documents/test/2673_1252.laz I get: Layer 2673_1252: Untwine error: unordered_map::at: key not found

dvmepi commented 2 years ago

None of those have worked for me: Layer 123123: Untwine error: unordered_map::at: key not found

spatialthoughts commented 2 years ago

I am facing the same issue on QGIS 3.22.8 on MacOS. File doesn't have ASCII names and it is on a local folder. QGIS 3.24 opens it fine but I get Untwine error: unordered_map::at: key not found

hamishcampbell commented 2 years ago

FYI updated to 3.26.0-Buenos Aires on MacOS, confirmed this bug still exists.

Layer points : Untwine error: unordered_map::at: key not found
hobu commented 2 years ago

It won't be fixed until 3.26.1

hamishcampbell commented 2 years ago

Thanks @hobu, much appreciated!

mapninja commented 2 years ago

Having the same issue in 3.26.1

QGIS version 3.26.1-Buenos Aires QGIS code revision b609df9ed4
Qt version 5.15.2
Python version 3.9.5
GDAL/OGR version 3.3.2
PROJ version 8.1.1
EPSG Registry database version v10.028 (2021-07-07)
GEOS version 3.9.1-CAPI-1.14.2
SQLite version 3.35.2
PDAL version 2.3.0
PostgreSQL client version unknown
SpatiaLite version 5.0.1
QWT version 6.1.6
QScintilla2 version 2.11.5
OS version macOS 12.4
       

Active Python plugins processing | 2.12.99 sagaprovider | 2.12.99 grassprovider | 2.12.99 db_manager | 0.1.20 MetaSearch | 0.3.6

QGIS version 3.26.1-Buenos Aires QGIS code revision b609df9ed4 Qt version 5.15.2 Python version 3.9.5 GDAL/OGR version 3.3.2 PROJ version 8.1.1 EPSG Registry database version v10.028 (2021-07-07) GEOS version 3.9.1-CAPI-1.14.2 SQLite version 3.35.2 PDAL version 2.3.0 PostgreSQL client version unknown SpatiaLite version 5.0.1 QWT version 6.1.6 QScintilla2 version 2.11.5 OS version macOS 12.4

Active Python plugins processing 2.12.99 sagaprovider 2.12.99 grassprovider 2.12.99 db_manager 0.1.20 MetaSearch 0.3.6`

wonder-sk commented 2 years ago

Sorry I haven't pulled the upstream fixes yet, so this will likely get fixed in 3.26.2

Spartacus1 commented 2 years ago

Sorry I haven't pulled the upstream fixes yet, so this will likely get fixed in 3.26.2

Thank you. I'am experiencing the same bug in macOS and QGIS 3.26.1. Waiting for the fix then. Best regards

alexbruy commented 1 year ago

Is this still an issue? In my tests on Linux and WIndows with the latest 3.32 and master (2d64df22a4eb4e7e6718f747c9eb1ed4e5f81903) everything works fine.

spatialthoughts commented 1 year ago

I am able to load island.las on QGIS 3.28.9 on Mac without any issues.

hamishcampbell commented 12 months ago

Confirmed fixed.