search

BorgwardtLab / proteinshake

Protein structure datasets for machine learning.
https://proteinshake.ai
BSD 3-Clause "New" or "Revised" License
101 stars 9 forks source link

Stream into file during parsing #68

Open timkucera opened 2 years ago

timkucera commented 2 years ago

The parsing accumulates all (atom) dataframes in RAM, it would be better to write them directly to file as they go.