fs_upload() sudden issue with specific csv file

ropensci-archive / rfigshare

:no_entry: ARCHIVED :no_entry: An R Interface to 'figshare'

https://docs.ropensci.org/rfigshare

41 stars 12 forks source link

fs_upload() sudden issue with specific csv file #108

Closed majazaloznik closed 5 years ago

majazaloznik commented 5 years ago

fs_upload() has stopped working on this file to this deposit fileset. it worked fine until version 18, after that only the two pdfs upload ok, but not the csv file. the file is 774MB, so the size shouldn't be an issue?

majazaloznik commented 5 years ago

OK, was my mistake, the file was 100 times larger than it should have been, after fixing my code it's back to 7MB, which works fine.

Still, I thought individual files can be up to 5 GB, so size should not have been an issue here?

cboettig commented 5 years ago

Thanks for the follow-up. Note that you can usually get substantial reductions in file size by compressing csv's first as well, e.g. readr::write_csv(big_data, "myfile.csv.xz") will automatically compress the file.