scality / cloudserver

Zenko CloudServer, an open-source Node.js implementation of the Amazon S3 protocol on the front-end and backend storage capabilities to multiple clouds, including Azure and Google.
https://www.zenko.io/cloudserver
Apache License 2.0
1.71k stars 241 forks source link

Add S3 SELECT functionality #3247

Open chriscrawfordAL opened 3 years ago

chriscrawfordAL commented 3 years ago

Feature Request

Proposal

S3 SELECT allows users to pull only specific pieces of information back from S3, not the entire file. Useful when columnar data is stored in S3 in parquet format.

Current behavior

Entire file must be pulled back to process one column

Desired behavior

Be able to pull only sections of a file

Use case

Queries can be sped up to 400% using S3 SELECT

Additional information

dora-korpar commented 3 years ago

Hi @crawdaddy18, Thanks for the feature request. I'll make sure it gets in the proper hands.

ggrebert commented 2 years ago

Also needed for Orange. Is there a roadmap ?

This feature is implemented in min.io

ggrebert commented 7 months ago

@dora-korpar any news ? this issue is open since more than 3 years !

ggrebert commented 7 months ago

is this project died ?