vroom error in saving historic sqlite db

bcgov / rems

An R package to access data from British Columbia's Environmental Monitoring System

Apache License 2.0

19 stars 5 forks source link

vroom error in saving historic sqlite db #65

Closed ateucher closed 2 years ago

ateucher commented 3 years ago

From a user:

This is going to take a while...
Downloading latest 'historic' EMS data
  |======================================================================================================================================| 100%

Unzipping...
Saving historic data at C:\Users\xxxxxx\AppData\Local/rems/rems/historic_db/ems_historic.sqlite
|=Error: The size of the connection buffer (131072) was not large enough
to fit a complete line:
  * Increase it by setting `Sys.setenv("VROOM_CONNECTION_SIZE")`

ateucher commented 3 years ago

Possibly related to setting the skip value here, vis a vis this vroom issue.

KarHarker commented 2 years ago

issue closed with switch to duckdb backend https://github.com/bcgov/rems/pull/63