Error when building from S3

[kevjamco]

I have an LAS file that builds fine locally, and has been uploaded to S3. When building from S3, I get the following error:

libc++abi: terminating with uncaught exception of type nlohmann::detail::out_of_range: [json.exception.out_of_range.403] key 'schema' not found
Abort trap: 6

More specifically, I ran: entwine build -i "s3://bucket/path/to/file.las" -o "s3://bucket/path/to/dir" -v and get the following output:

Curl config:
    timeout: 5s
    followRedirect: true
    verifyPeer: true
    caBundle: (default)
    caInfo: (default)
    Proxy: (default)
*   Trying []:443...
* Connected to[] port 443 (#0)
* ALPN: offers h2
* ALPN: offers http/1.1
*  CAfile: [].pem
*  CApath: none
* SSL connection using TLSv1.2 / []
* ALPN: server accepted http/1.1
* Server certificate:
*  subject: CN=*.s3-us-west-1.amazonaws.com
*  start date: Sep 21 00:00:00 2022 GMT
*  expire date: Aug 30 23:59:59 2023 GMT
*  subjectAltName: host "[].s3-us-west-1.amazonaws.com" matched cert's "*.s3-us-west-1.amazonaws.com"
*  issuer: C=US; O=Amazon; OU=Server CA 1B; CN=Amazon
*  SSL certificate verify ok.
> HEAD /test/entwine-sx10/ept.json HTTP/1.1
Host: [].s3-us-west-1.amazonaws.com
Accept: */*
Accept-Encoding: deflate, gzip
Authorization: [...]

* Mark bundle as not supporting multiuse
< HTTP/1.1 404 Not Found
< x-amz-request-id: []
< x-amz-id-2: []
< Content-Type: application/xml
< Date: Fri, 13 Jan 2023 18:32:47 GMT
< Server: AmazonS3
< 
* Connection #0 to host [].s3-us-west-1.amazonaws.com left intact
1/1: s3://[file].las
* Found bundle for host: 0x600003a90d20 [serially]
* Can not multiplex, even if we wanted to
* Re-using existing connection #0 with host [].s3-us-west-1.amazonaws.com
> GET /[file].las HTTP/1.1
Host: [].s3-us-west-1.amazonaws.com
Accept: */*
Accept-Encoding: deflate, gzip
Authorization: []/us-west-1/s3/aws4_request, SignedHeaders=host;range;x-amz-content-sha256;x-amz-date, Signature=[]
Range: bytes=0-374
X-Amz-Content-Sha256: []
X-Amz-Date: 20230113T183248Z

* Mark bundle as not supporting multiuse
< HTTP/1.1 206 Partial Content
< x-amz-id-2: []
< x-amz-request-id: []
< Date: Fri, 13 Jan 2023 18:32:49 GMT
< Last-Modified: Fri, 13 Jan 2023 01:36:29 GMT
< ETag: "[]-468"
< x-amz-server-side-encryption: AES256
< Accept-Ranges: bytes
< Content-Range: bytes 0-374/3923763130
< Content-Type: binary/octet-stream
< Server: AmazonS3
< Content-Length: 375
< 
* Connection #0 to host [].s3-us-west-1.amazonaws.com left intact
* Found bundle for host: 0x600003a90d20 [serially]
* Can not multiplex, even if we wanted to
* Re-using existing connection #0 with host [].s3-us-west-1.amazonaws.com
> GET [].las HTTP/1.1
Host: [].s3-us-west-1.amazonaws.com
Accept: */*
Accept-Encoding: deflate, gzip
Authorization: AWS4-HMAC-SHA256 Credential=[]/us-west-1/s3/aws4_request, SignedHeaders=host;range;x-amz-content-sha256;x-amz-date, Signature=[]
Range: bytes=375-657
X-Amz-Content-Sha256: []
X-Amz-Date: 20230113T183248Z

* Mark bundle as not supporting multiuse
< HTTP/1.1 206 Partial Content
< x-amz-id-2: []
< x-amz-request-id: []
< Date: Fri, 13 Jan 2023 18:32:49 GMT
< Last-Modified: Fri, 13 Jan 2023 01:36:29 GMT
< ETag: "[]-468"
< x-amz-server-side-encryption: AES256
< Accept-Ranges: bytes
< Content-Range: bytes 375-657/3923763130
< Content-Type: binary/octet-stream
< Server: AmazonS3
< Content-Length: 283
< 
* Connection #0 to host[].s3-us-west-1.amazonaws.com left intact
libc++abi: terminating with uncaught exception of type nlohmann::detail::out_of_range: [json.exception.out_of_range.403] key 'schema' not found
[1]    91210 abort      entwine build -i  -o s3://[]/test/entwine-sx10/ -v

[simmers]

@kevjamco Hi there...did you ever figure this one out?

[kevjamco]

Yes, if I recall: the problem is in the S3 reader in PDAL. I think you can essentially find where this error is generated and comment it out. Then you must build/re-install pdal.

[simmers]

@connormanning was this closed because it it s PDAL issue? Or was something done?

[connormanning]

There have been several updates to the cloud-storage abstraction library since this ticket in both PDAL and Entwine. And when I run the command from the initial ticket, everything works as expected. So while I didn't make any changes specifically in response to this ticket, I think the issue was addressed by one of several changes. If this is not the case and there is still a problem, feel free to reopen this, or open a new one with details and I'd be happy to take a look.