Closed jmmitc06 closed 2 weeks ago
With the newest addition to the compress_tracks branch this is largely solved when 'hybrid' mode is used. While hybrid mode still uses compressed pickle, its never saved to disk and thus cannot be loaded by a different process.
Pickle for processing intermediates, e.g., extracted mass tracks is probably fine, pickle probably should not be used when moving data to a new process in the interest of safety. JSON is a decent alternative.