erwanp / qtplaskin

A graphical tool to explore ZdPlaskin Results
GNU Lesser General Public License v3.0
7 stars 5 forks source link

bug in Pandas when reading files with 'Infinity' #6

Closed githeap closed 3 years ago

githeap commented 5 years ago

By default this fork of QtPlaskin uses pandas.read_csv function to speed up data loading. ZdPlaskin is a Fortran code and uses "Infinity" to represent inf values in output text files. There is an issue #10065 in Pandas with reading such files. Pandas read_csv interprets "Infinity" as a string, not a floating point value.

Untill the issue #10065 is not resolved in Pandas, as a workaround, we fallback to old (slower) data import for datasets containing "Infinity"s. a5b1559

Update: Add a very straightforward fix to Pandas #28181. Hope, someone will come up with smarter solution.

erwanp commented 5 years ago

Well done on getting it approved!

githeap commented 3 years ago

https://github.com/pandas-dev/pandas/pull/28181 was merged in Pandas 1.0