DyfanJones / noctua

Connect R to Athena using paws SDK (DBI Interface)
https://dyfanjones.github.io/noctua/
Other
45 stars 5 forks source link

connection performance #197

Closed DyfanJones closed 1 year ago

DyfanJones commented 1 year ago

This PR attempts to address the performance of Rstudio connection tab. Currently noctua makes sdk calls to athena to get the table list, catalog and schema. This proves to be fast for small scale data schemas however it is super slow for large data schema. This is down to the restriction of 50 objects per call.

Issue: #197