Fixed long loadtime of pd.load_fwf

michaelaye / nbplanetary

A nbdev-based approach to create a core library for planetarypy

https://michaelaye.github.io/nbplanetary/

MIT License

7 stars 1 forks source link

Fixed long loadtime of pd.load_fwf #61

Closed toihr closed 4 months ago

toihr commented 4 months ago

This should fix the incredibly long loadtime by load_fwf from pandas which is caused by the pure python backend. read_csv has a C backend and therefore reads much faster.

Example: RDRCUMINDEX.LBL took 60 minutes to read now only takes 1 minute to read.

review-notebook-app[bot] commented 4 months ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

michaelaye commented 4 months ago

thanks, i'll merge. can you for next time install ruff in vscode so that your code is PEP8 compliant? Thx!