DyfanJones / RAthena

Connect R to Athena using Boto3 SDK (DBI Interface)
https://dyfanjones.github.io/RAthena/
Other
35 stars 6 forks source link

Upload and register flat files into Athena #25

Open DyfanJones opened 4 years ago

DyfanJones commented 4 years ago

To be able to upload a flat file saved on users computer and register it in AWS Athena without the requirement of having to upload it first into R.

DyfanJones commented 4 years ago

This method might require a new function outside of the current method to upload files to AWS Athena dbWriteTables.

DyfanJones commented 4 years ago

If this comes into the package then a limited file type will be supported similar to dbWriteTables with the support of (csv, tsv and parquet).

This is down to the requirement of needing to identify the variables and classes so the DDL can be correctly created in AWS Athena.