connormanning / entwine

Entwine - point cloud organization for massive datasets
https://entwine.io
Other
451 stars 128 forks source link

Access S3 open source data - getting "Exception in pool task: No driver for + path" #249

Closed ron-ongjoco-enview closed 1 year ago

ron-ongjoco-enview commented 3 years ago

Following entwine's README, I'm trying to access open source laz files from here: https://registry.opendata.aws/usgs-lidar/m

$ aws s3 ls s3://usgs-lidar-public/USGS_LPC_KS_SCentral_L2_2015_LAS_2017/ept-data/7-56-79-63.laz
2018-12-31 12:06:33       1892 7-56-79-63.laz
$ docker run -it -v ~/entwine:/entwine -v ~/.aws:/root/.aws -e CURL_VERBOSE=1 connormanning/entwine build \
         -i s3://usgs-lidar-public/USGS_LPC_KS_SCentral_L2_2015_LAS_2017/ept-data/7-56-79-63.laz  \
         -o /entwine/red-rocks
Curl config:
    timeout: 5s
    followRedirect: true
    verifyPeer: true
    caBundle: (default)
    caInfo: (default)
Awakening existing build.
Loading red-rocks.json from /entwine/red-rocks/ept-sources/
1/1: s3://usgs-lidar-public/USGS_LPC_KS_SCentral_L2_2015_LAS_2017/ept-data/7-56-79-63.laz
Exception in pool task: No driver for s3://usgs-lidar-public/USGS_LPC_KS_SCentral_L2_2015_LAS_2017/ept-data/7-56-79-63.laz
    - Skipping s3://usgs-lidar-public/USGS_LPC_KS_SCentral_L2_2015_LAS_2017/ept-data/7-56-79-63.laz
Dimensions: [
        X:int32, Y:int32, Z:int32, Intensity:uint16, ReturnNumber:uint8,
        NumberOfReturns:uint8, ScanDirectionFlag:uint8, EdgeOfFlightLine:uint8,
        Classification:uint8, ScanAngleRank:float32, UserData:uint8,
        PointSourceId:uint16, GpsTime:float64, Red:uint16, Green:uint16, Blue:uint16
]
Points: 4,004,326
Bounds: [(482060, 4390187, 1843), (482764, 4391072, 2030)]
Scale: 0.01
SRS: EPSG:26913

Joining
Saving
Wrote 0 points.

Tried with and without passing my aws config via mount but both methods do not work.

connormanning commented 1 year ago

This works with current code.