search

zhafen / linefinder

A tool for finding and classifying the worldlines of Lagrangian parcels of mass, in the context of hydrodynamic simulations of galaxy formation.
https://zhafen.github.io/linefinder
MIT License
0 stars 1 forks source link

Load less data when automatically accessing data #54

Open zhafen opened 6 years ago

zhafen commented 6 years ago

Originally reported by Zachary Hafen (Bitbucket: zhafen, GitHub: zhafen)

As it is now, the process of finding data automatically involves opening and loading all the relevant data sets and looking inside them for the data. This is obviously not ideal, and leads to large memory usage.

Potential solutions:

  1. Save information about the saved data in the file header
  2. Allow additional arguments to specify the data file (requires extra knowledge, but easy to implement, and is already partially implemented)
  3. Something else clever.