User Guide: Document using HDFS and S3

apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine

https://datafusion.apache.org/ballista

Apache License 2.0

1.4k stars 182 forks source link

Open andygrove opened 1 year ago

andygrove commented 1 year ago

Is your feature request related to a problem or challenge? Please describe what you are trying to do. Once https://github.com/apache/arrow-ballista/pull/290 and https://github.com/apache/arrow-ballista/pull/274 are merged, add a section on HDFS and S3.

Describe the solution you'd like

Describe alternatives you've considered

Additional context

onthebridgetonowhere commented 1 year ago

Probably we need to also document using GCS and Azure, once #308 is merged.

nate-kuhl commented 1 year ago

@andygrove do you know if there is documentation anywhere on how to declare an object store (s3 or HDFS) in Ballista?