Add minify() to safely compress DataFrames

jake-westfall / jwpy

Contains miscellaneous Python code useful to Jake Westfall (and maybe others).

MIT License

0 stars 0 forks source link

Add minify() to safely compress DataFrames #17

Open jake-westfall opened 6 years ago

jake-westfall commented 6 years ago

Takes in a DataFrame, outputs the same DataFrame with all ints and floats safely downcasted, and with all objects converted to categoricals iff nunique < len/2.

jake-westfall commented 6 years ago

Also have parameters:

dates: list of columns to be converted to_datetime
categoricals: list of numeric columns to convert to categorical
objects: list of 'object' columns to keep as objects (do not convert to categorical)