search

brannondorsey / PassGAN

A Deep Learning Approach for Password Guessing (https://arxiv.org/abs/1709.00440)
MIT License
1.78k stars 362 forks source link

about memory #8

Closed Explorer1092 closed 5 years ago

Explorer1092 commented 6 years ago

When the train.txt file is large (2G), train.py uses a lot of memory. Is this situation normal?

brannondorsey commented 6 years ago

Yes, this is normal. All of the training data is loaded into RAM at once, it isn't line buffered or read from disk and processed with a python generator. Take a look at utils.load_dataset(...) to see exactly what's going on.