Open barbuz opened 11 months ago
We have a similar use case.
I replicated this issue and tried various combinations and couldn't get it to resolve correctly.
Does the AWS plugin expose all of the necessary parts to validate a whole data package, or is it only at the Resource level such as in the guide here? https://framework.frictionlessdata.io/docs/schemes/aws.html
Thanks for reporting!
Overview
I want to use Frictionless datapackages to provide metadata about some collections hosted on s3, but I'm encountering issues when trying to read these files. I can load the data fine as a
Resource
, and I can even validate it against a localtableschema
, but if I try loading the datapackage I get the following error:I have also tried opening a local copy of the datapackage with its resource path pointing to
s3://rimrep-data-public-development/csiro-seltmp-baseline-surveys-jul22/data.parquet/part.0.parquet
, but then the validation fails with:Finally, I've done some experiments with the CLI but encountered the same errors there too. In particular, trying to validate the remote data against a local
tableschema.json
file worked, but if the tableschema was also hosted on s3 I got the error"No connection adapters were found for 's3://rimrep-data-public-development/csiro-seltmp-baseline-surveys-jul22/tableschema.json'"
All the files used here should be public, so you can try replicating the issue. Please let me know if I'm doing something wrong or if this is an actual bug.