local caching of queryid to reduce number of calls to Athena to reduce cost

DyfanJones / RAthena

Connect R to Athena using Boto3 SDK (DBI Interface)

https://dyfanjones.github.io/RAthena/

Other

35 stars 6 forks source link

local caching of queryid to reduce number of calls to Athena to reduce cost #82

Closed DyfanJones closed 4 years ago

DyfanJones commented 4 years ago

This is a pyathena inspired request to reduce the cost of using AWS Athena. RAthena however has a slightly different caching method and utilities local caching in R environments instead of using AWS list_query_executions. This is down to dbClearResult clearing S3's Athena output when caching isn't disabled.

DyfanJones commented 4 years ago

Unit Tests:

OK: 74
Failed: 0
Warnings: 0
Skipped: 0

DyfanJones commented 4 years ago

── R CMD check results ──── RAthena 1.7.1.9000 ──── Duration: 4m 40s

0 errors ✓ | 0 warnings ✓ | 0 notes ✓