ContactEngineering / SurfaceTopography

Read and analyze surface topographies
https://contactengineering.github.io/SurfaceTopography/
MIT License
15 stars 9 forks source link

XYZ reader should not parse file twice #339

Open pastewka opened 9 months ago

pastewka commented 9 months ago

The XYZ reader currently parses the file twice: Once when constructing the reader (and the channel information) and second when actually reading the data. The second read step is unnecessary and should be avoided.

Note that readers should not store the topography data when constructing the channel information to avoid huge memory usage in Topobank. However, files are now only touched in Celery workers such that this problem is alleviated.

pastewka commented 1 month ago

See #340