search

bcgov / shinyrems

An R package to launch shinyrems; an online application that allows a user to access, download, clean, plot and calculate simple statistics using data from the B.C. government Environmental Monitoring System database.
https://bcgov.github.io/shinyrems/
Other
18 stars 4 forks source link

historic/all data unzipping error #125

Closed KarHarker closed 2 years ago

KarHarker commented 3 years ago

Some users (not all) are having issues downloading the historic/all dataset. Data downloads to 100% but then the unzipping step gives this error: 

|=Error: The size of the connection buffer (131072) was not large enough
to fit a complete line:
  * Increase it by setting `Sys.setenv("VROOM_CONNECTION_SIZE")`

Tried to increase "VROOM_CONNECTION_SIZE" in env but still getting the same error

ateucher commented 3 years ago

Is this also happening in rems by itself?

JessicaPenno commented 3 years ago

yes, I just tried to download the historic database using rems and I got the same error as I am getting in ShinyREMs. I have tried increasing the connection size to as large as 10000000 and it still did not work. I got a second warning too:

In addition: Warning message: In file.remove(db_path) : cannot remove file 'my file path'

ateucher commented 3 years ago

@JessicaPenno can you report what version of the readr package you have installed?

JessicaPenno commented 3 years ago

2.0.0 but i see there is a newer one

JessicaPenno commented 3 years ago

with updated readr i still get the vroom error but not the file path error @ateucher

HeatherGranger commented 2 years ago

This should be fixed as long as shinyrems works with rems duckdb #130

HeatherGranger commented 2 years ago

Fixed issue with addition of rems duckdb.