EMCECS / presto-s3-connector

Apache License 2.0
8 stars 3 forks source link

S3 select for S3 connector - how to handle query progress #9

Open chipmaurer opened 3 years ago

chipmaurer commented 3 years ago

From Andy: what do we need to return in terms of progress (processed bytes + num records processed). s3 select api on server will return periodic progress stats. do we return this to presto? or are these accounting stats only take into account locally processed data?

We can check this by using MinIO S3 Select to see what they do.