MinIO for testing - Githubissues

ThorodanBrom commented 2 months ago

Apart from using MinIO for testing, another thing that is being explored in this is where the code needs to be modified to allow for path-based access as well
- Reason - each integration tests uploads the files it needs to S3 in the setup phase. Virtual-hosting-based access cannot work for this, so the only option is to use path-based.
- Also #176

mahimatics commented 1 month ago

MinIO integration is in progress Once that is done, we need a K8s setup on baremetal

ThorodanBrom commented 1 month ago

Potential changes for MinIO support

S3Config object to accomodate all the different S3 config options
- Based off https://github.com/datakaveri/ogc-resource-server/issues/185#issuecomment-2390498712
Use awsEndpoint value
s3PathBasedAccess boolean
DataFromS3
Pass S3Config object in constructor
Minor change in the way the request is made to accomodate HTTP/HTTPS - https://vertx.io/docs/apidocs/io/vertx/core/http/HttpClient.html#request-io.vertx.core.http.RequestOptions-
Form URL based on s3PathBasedAccess config
- true - add bucket name to path
- false or missing - add bucket name to endpoint as subdomain
  Processes
Make sure processes make use of the awsEndpoint and s3PathBasedAccess configs accordingly - especially in ogrinfo and ogr2ogr