klaundal / lompe

MIT License
15 stars 9 forks source link

Pandas `to_hdf` causing crash on Macs #48

Open billetd opened 4 months ago

billetd commented 4 months ago

Found this when trying to use the AMPERE pre-processing script read_iridium(). It was constantly running into a client crash (python quit unexpectedly) whilst trying to save the AMPERE dataframe to a HDF5 file on line 747. The problem isn't just here though, it's when trying to save any dataframe to a HDF5 (even a very simple one), so it's not a Lompe problem.

This seems like an issue with pytables on Macs, possible related to the M1+ CPU architecture (my speculation, I actually have no idea). Anyway, I managed to fix the crash and get the to_hdf5() method to work everywhere by downgrading pytables to version 3.8:

pip uninstall tables
pip install tables==3.8.0
klaundal commented 4 months ago

Good that you got it to work! I haven't heard about this before, but I have intel cpu...

@FasilGibdaw did you have similar issues with your mac?

FasilGibdaw commented 4 months ago

yes, I had this problem, however, updating pytables was my fix, the version in my system(M3 Max) is 3.9.2.