Writing intermediate steps to ostore is great but not required when developing queries or processing the job locally.
Consider replacing s3://$OBJECTSTORE_BUCKET with $CACHE_PATH (or similar) that could point at local filesystem.
Paths to /vsis3 would also have to be adjusted.
Writing intermediate steps to ostore is great but not required when developing queries or processing the job locally. Consider replacing
s3://$OBJECTSTORE_BUCKET
with$CACHE_PATH
(or similar) that could point at local filesystem. Paths to/vsis3
would also have to be adjusted.