search

matiasandina / homecage_quantification

Code for quantifying homecage activity
https://github.com/homecage_quantification
0 stars 0 forks source link

csv text files sizes are somewhat big #15

Closed matiasandina closed 4 years ago

matiasandina commented 4 years ago

check for info that can be retrieved better elsewhere check for compression

matiasandina commented 4 years ago

Eliminated mac column because it can be regenerated from filename In one day of recording in one unit, in an uncompressed .csv, this brings the size down from 52 Mb to 39 Mb

matiasandina commented 4 years ago

Saving into .csv.gz accomplishes a ~20X reduction in size while being able to be easily written and read in R. The decision is to use this for the moment, until a better option comes forward.

Other options including saving as .Rdata but I wanted to keep the plain text nature of it.