local caching of queryid to reduce number of calls to Athena to reduce cost

DyfanJones / noctua

Connect R to Athena using paws SDK (DBI Interface)

https://dyfanjones.github.io/noctua/

Other

45 stars 5 forks source link

local caching of queryid to reduce number of calls to Athena to reduce cost #71

Closed DyfanJones closed 4 years ago

DyfanJones commented 4 years ago

This is a pyathena inspired request to reduce the cost of using AWS Athena. noctua however has a slightly different caching method and utilities local caching in R environments instead of using AWS list_query_executions. This is down to dbClearResult clearing S3's Athena output when caching isn't disabled.

DyfanJones commented 4 years ago

Unit Test:

OK: 76
Failed: 0
Warnings: 0
Skipped: 0

DyfanJones commented 4 years ago

── R CMD check results ───── noctua 1.5.1.9000 ──── Duration: 4m 3.4s

0 errors ✓ | 0 warnings ✓ | 0 notes ✓