search

toddfarmer / arrow-migration

0 stars 1 forks source link

[Python] Consider adding option to parquet.write_table that sets options for maximum Spark compatibility #1435

Closed toddfarmer closed 7 years ago

toddfarmer commented 7 years ago

Note: This issue was originally created as ARROW-1499. Please see the migration documentation for further details.

Original Issue Description:

These issues should also be appropriately documented in Sphinx.

Something like:

parquet.write_table(table, where, flavor="spark-2.2")

This might allow for others flavors to be added.

toddfarmer commented 7 years ago

Note: Comment by Wes McKinney (wesm): Part of patch for ARROW-1359: https://github.com/apache/arrow/pull/1076

toddfarmer commented 7 years ago

Note: Comment by Wes McKinney (wesm): Done in https://github.com/apache/arrow/commit/4a6a6cb47dcf832213f1fb31f2325ad10a3864bd