search

moj-analytical-services / pydbtools

Python version of dbtools
https://moj-analytical-services.github.io/pydbtools/
10 stars 2 forks source link

Fix dataframe_to_table in _wrangler.py #95

Closed MandarinDuck closed 1 year ago

MandarinDuck commented 1 year ago

+ ".parquet" seems to be messing up the table location for Athena.

With current code, files are created in s3://bucket/key/table_name.parquet/, ~while Athena searches in s3://bucket/key/table_name/ for data.~