Closed okayzed closed 7 years ago
this may be a premature optimization, but since i've been running the program over and over, it's useful to me (and not changing results yet). thought i'd share it
please disregard that last commit (with tsne viz) - i didn't realize it automatically would update this pull request with new commits. this pull request only contains one diff related to mmap
Seems like a perfectly reasonably optimization! Thanks!
using mode "c" means copy-on-write, so the files are loaded off disk using mmap but not re-written to disk when changed.
(for testing, i clear the fs cache using vmtouch tool: https://hoytech.com/vmtouch/)