[GLUTEN-7999][VL] Add compression codec extension to velox written parquet file

apache / incubator-gluten

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

https://gluten.apache.org/

Apache License 2.0

1.22k stars 437 forks source link

[GLUTEN-7999][VL] Add compression codec extension to velox written parquet file #8000

Closed liujiayi771 closed 23 hours ago

liujiayi771 commented 2 days ago

What changes were proposed in this pull request?

Fix #7999.

How was this patch tested?

Add file suffix check in CompressionCodecSuite.

github-actions[bot] commented 2 days ago

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

Other pull requests

liujiayi771 commented 2 days ago

After this modification, the name of the parquet files generated by Gluten will change to something like gluten-part-b35dab49-3eb9-434b-abb9-7de2bc180a06.snappy.parquet.

@FelixYBW @JkSelf @zhztheplayer Could you help to review?

github-actions[bot] commented 1 day ago

https://github.com/apache/incubator-gluten/issues/7999