datafusion-contrib / datafusion-objectstore-s3

S3 as an ObjectStore for DataFusion
Apache License 2.0
59 stars 13 forks source link

Investigate: Register into ObjectStoreRegistry #15

Closed matthewmturner closed 2 years ago

matthewmturner commented 2 years ago

@seddonm1 i hadnt really dug into this but i believe #20 handles this, right?

seddonm1 commented 2 years ago

yes, its very easy:

    let execution_config = ExecutionConfig::new().with_batch_size(32768);
    let mut execution_ctx = ExecutionContext::with_config(execution_config);
    execution_ctx.register_object_store(
        "s3",
        Arc::new(AmazonS3FileSystem::new(None, None, None, None, None, None).await),
    );
matthewmturner commented 2 years ago

Going to add this to readme as well