search

AtlasOfLivingAustralia / galah-R

Query living atlases from R
https://galah.ala.org.au
39 stars 3 forks source link

Investigate possible performance enhancements with `crul::Async` #9

Closed matildastevenson closed 3 years ago

matildastevenson commented 3 years ago

ala_media() and ala_counts() may benefit from requesting asynchronously. More info here: https://docs.ropensci.org/crul/articles/async.html

matildastevenson commented 3 years ago

Using Async::get() does not speed up the overall query time for ala_counts()- it remains very similar to the time taken to call the urls one by one. To speed up this query some improvement on the biocache side is required. See time comparison below Screen Shot 2021-04-21 at 3 48 06 pm

matildastevenson commented 3 years ago

Async is used in media downloads as of commit 48aaf4dc818881cef8d77ea352edf75871e20cea