search

jftsang / mdpmflc

A web interface for MercuryDPM
0 stars 0 forks source link

Speed up reading .data. and .fstat. files #25

Closed jftsang closed 3 years ago

jftsang commented 4 years ago

Currently, the whole file is read even if you only need a selection of lines, unless they are the first few. That's because the whole file is read and then shuffle'd.

jftsang commented 3 years ago

Using pd.read_csv is mucch faster.